-- Logs begin at Tue 2022-04-12 02:22:31 UTC, end at Tue 2022-04-12 03:25:54 UTC. -- Apr 12 02:49:34.758918 dv-cinder-837443-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Apr 12 02:49:34.768631 dv-cinder-837443-1-iscsi devstack@keystone.service[79708]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Apr 12 02:49:34.770610 dv-cinder-837443-1-iscsi devstack@keystone.service[79708]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Apr 12 02:49:34 2022] *** Apr 12 02:49:34.770610 dv-cinder-837443-1-iscsi devstack@keystone.service[79708]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 12 02:49:34.770610 dv-cinder-837443-1-iscsi devstack@keystone.service[79708]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 12 02:49:34.770610 dv-cinder-837443-1-iscsi devstack@keystone.service[79708]: nodename: dv-cinder-837443-1-iscsi Apr 12 02:49:34.770610 dv-cinder-837443-1-iscsi devstack@keystone.service[79708]: machine: x86_64 Apr 12 02:49:34.770610 dv-cinder-837443-1-iscsi devstack@keystone.service[79708]: clock source: unix Apr 12 02:49:34.770610 dv-cinder-837443-1-iscsi devstack@keystone.service[79708]: pcre jit disabled Apr 12 02:49:34.770610 dv-cinder-837443-1-iscsi devstack@keystone.service[79708]: detected number of CPU cores: 4 Apr 12 02:49:34.770610 dv-cinder-837443-1-iscsi devstack@keystone.service[79708]: current working directory: / Apr 12 02:49:34.771076 dv-cinder-837443-1-iscsi devstack@keystone.service[79708]: detected binary path: /usr/bin/uwsgi-core Apr 12 02:49:34.771076 dv-cinder-837443-1-iscsi devstack@keystone.service[79708]: your processes number limit is 47680 Apr 12 02:49:34.771076 dv-cinder-837443-1-iscsi devstack@keystone.service[79708]: your memory page size is 4096 bytes Apr 12 02:49:34.771076 dv-cinder-837443-1-iscsi devstack@keystone.service[79708]: detected max file descriptor number: 2048 Apr 12 02:49:34.771076 dv-cinder-837443-1-iscsi devstack@keystone.service[79708]: lock engine: pthread robust mutexes Apr 12 02:49:34.771076 dv-cinder-837443-1-iscsi devstack@keystone.service[79708]: thunder lock: enabled Apr 12 02:49:34.771076 dv-cinder-837443-1-iscsi devstack@keystone.service[79708]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Apr 12 02:49:34.771076 dv-cinder-837443-1-iscsi devstack@keystone.service[79708]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 12 02:49:34.821836 dv-cinder-837443-1-iscsi devstack@keystone.service[79708]: Python main interpreter initialized at 0x557e67a8e9c0 Apr 12 02:49:34.821836 dv-cinder-837443-1-iscsi devstack@keystone.service[79708]: python threads support enabled Apr 12 02:49:34.821836 dv-cinder-837443-1-iscsi devstack@keystone.service[79708]: your server socket listen backlog is limited to 100 connections Apr 12 02:49:34.821836 dv-cinder-837443-1-iscsi devstack@keystone.service[79708]: your mercy for graceful operations on workers is 90 seconds Apr 12 02:49:34.822176 dv-cinder-837443-1-iscsi devstack@keystone.service[79708]: mapped 403077 bytes (393 KB) for 2 cores Apr 12 02:49:34.822389 dv-cinder-837443-1-iscsi devstack@keystone.service[79708]: *** Operational MODE: preforking *** Apr 12 02:49:34.822593 dv-cinder-837443-1-iscsi devstack@keystone.service[79708]: *** uWSGI is running in multiple interpreter mode *** Apr 12 02:49:34.822593 dv-cinder-837443-1-iscsi devstack@keystone.service[79708]: spawned uWSGI master process (pid: 79708) Apr 12 02:49:34.822795 dv-cinder-837443-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Apr 12 02:49:34.826619 dv-cinder-837443-1-iscsi devstack@keystone.service[79708]: spawned uWSGI worker 1 (pid: 79722, cores: 1) Apr 12 02:49:34.827116 dv-cinder-837443-1-iscsi devstack@keystone.service[79708]: spawned uWSGI worker 2 (pid: 79724, cores: 1) Apr 12 02:49:34.827446 dv-cinder-837443-1-iscsi devstack@keystone.service[79708]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 12 02:49:40.765000 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 02:49:40.765000 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: from cryptography.utils import int_from_bytes Apr 12 02:49:40.765793 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 02:49:40.765793 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: from cryptography.utils import int_from_bytes Apr 12 02:49:40.770683 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 02:49:40.770683 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: from cryptography.utils import int_from_bytes Apr 12 02:49:40.771186 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 02:49:40.771186 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: from cryptography.utils import int_from_bytes Apr 12 02:49:40.815806 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 12 02:49:40.816004 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 12 02:49:40.816205 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] command line args: [] {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 12 02:49:40.816451 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 12 02:49:40.816579 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ================================================================================ {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 12 02:49:40.816859 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] admin_token = **** {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.817060 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] config_dir = [] {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.817251 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.817411 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] config_source = [] {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.817621 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] debug = True {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.817824 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.820085 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.820085 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.820220 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 12 02:49:40.820296 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.820358 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 12 02:49:40.820358 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] command line args: [] {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 12 02:49:40.820471 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.820529 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 12 02:49:40.820585 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] list_limit = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.820649 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ================================================================================ {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 12 02:49:40.820714 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] log_config_append = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.820714 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.820814 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] admin_token = **** {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.820870 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] log_dir = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.820930 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] config_dir = [] {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.820997 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] log_file = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.821060 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.821118 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.821173 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] config_source = [] {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.821234 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.821292 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] debug = True {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.821292 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.821427 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.821493 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.821556 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.821623 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.821687 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.821687 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.821791 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.821791 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.821890 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.821954 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] list_limit = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.822017 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.822075 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] log_config_append = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.822148 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.822211 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.822211 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] log_dir = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.822326 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.822391 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] log_file = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.822449 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.822509 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.822566 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.822632 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.822698 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.822756 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.822817 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.823488 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.823672 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.823944 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.823944 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.824318 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.32/identity {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.824547 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.824752 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] publish_errors = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.824916 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.825142 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.825398 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.825629 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.825828 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.826056 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.826220 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.826411 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.826600 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.826809 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.827001 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.827226 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] standard_threads = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.827394 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.827582 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.827582 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.828258 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.828450 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.828450 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] use_journal = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.828450 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] use_json = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.828450 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] use_stderr = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.829256 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.32/identity {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.829430 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] use_syslog = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.829576 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] publish_errors = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.829728 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.829859 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.829987 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.830185 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.830327 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.830458 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.830585 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.830713 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.830847 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.830984 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.831120 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.831255 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] standard_threads = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.831389 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.831537 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.831537 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.831832 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.831964 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.832092 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.832220 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] use_journal = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.832347 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.832475 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] use_json = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.832475 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] use_stderr = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.832727 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.832855 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] use_syslog = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.832982 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.833109 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 02:49:40.833236 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.833455 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.833588 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.833724 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.833852 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.833979 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.834118 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.834247 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.834375 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.834509 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.834638 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.834772 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.834912 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.835049 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.835188 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.835324 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.835458 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.835587 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.835787 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.835923 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.836062 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.836191 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.836325 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.836453 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.836593 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.836723 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.836905 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.837039 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.837184 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.837320 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.837458 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.837593 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.837723 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.837857 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.837985 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.838119 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.838259 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.838388 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.838515 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.838643 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.838771 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.838915 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.839053 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.839182 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.839328 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.839328 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.839758 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.839895 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.840109 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.840241 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.840369 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.840504 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.840632 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.840762 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.840913 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.841044 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.841172 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.841298 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.841425 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.841553 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.841688 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.841817 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.841944 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.842072 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.842200 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.842327 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.842464 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.842593 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.842731 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.842865 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.842993 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.843134 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.843263 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.843391 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.843518 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.843646 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.843793 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.843939 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.844070 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.844204 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.844339 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.844474 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.845815 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.846047 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.846253 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.846421 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.846610 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.846805 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.846996 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.847221 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.847441 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.847671 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.847924 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.848117 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.848310 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.848550 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.848750 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.848916 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.849106 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.849302 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.849494 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.849722 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.849887 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.850114 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.850315 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.850550 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.850749 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.850925 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.851112 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.851254 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.851394 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.851560 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.851701 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.851853 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.851983 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.852124 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.852291 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.852424 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.852554 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.852682 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.852817 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.852959 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.853105 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.853236 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.853365 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.853494 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.853664 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.853798 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.853937 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.854117 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.854251 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.854381 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.854510 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.854649 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.854779 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.854919 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.855048 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.855295 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.855445 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.855587 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.855749 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.855886 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.855886 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.856130 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.856292 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.856541 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.856541 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.860990 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.861125 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.861269 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.861399 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.861545 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.861545 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.861792 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.861960 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.862096 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.862232 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.862377 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.862507 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.862636 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.862765 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.862893 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.863029 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.863179 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.863316 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.863452 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.863589 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.863737 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.863886 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.864033 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.864176 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.864306 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.864435 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.864564 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.864692 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.864820 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.864972 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.865104 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.865239 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.865369 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.865497 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.865626 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.865762 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.865892 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.866021 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] auth.external = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.866150 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.866354 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.866498 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.866498 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.866756 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.866898 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.867028 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.867158 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.867287 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] auth.password = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.867424 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.867555 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] auth.token = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.867789 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.867941 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.868072 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.868202 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.868340 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.868470 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.868627 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.868777 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.868777 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.869032 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.869163 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.869309 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.869454 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.869586 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.869717 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] credential.caching = True {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.869850 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] auth.external = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.869992 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.870123 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.870265 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.870398 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.870530 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.870671 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.870801 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.870930 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] auth.password = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.871068 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.871200 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] auth.token = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.871330 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.871460 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.871591 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.871745 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.871883 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.872024 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.872155 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.872285 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.872427 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.872573 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.872705 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.872836 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.872836 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.873087 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.873218 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] credential.caching = True {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.873356 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.873487 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.873618 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.873748 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.873885 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.874017 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.874017 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.874284 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] federation.caching = True {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.874415 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.874545 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.874676 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.874805 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.874943 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.875075 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.875205 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.875334 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.875465 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.875596 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.875780 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.875918 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.875918 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.876181 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.876312 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.876442 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.876654 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.876787 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.876918 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.877050 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.877182 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.877311 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.877449 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] identity.caching = True {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.877586 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] federation.caching = True {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.877718 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.877848 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.878001 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.878142 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.878282 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.878413 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.878543 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.878675 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.878810 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.878940 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.879079 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.879217 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.879352 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.879482 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.879612 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.879760 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.879917 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.880052 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.880183 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.880319 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.880451 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.880583 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.880721 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.880853 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] identity.caching = True {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.880983 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.881113 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.881243 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.881380 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.881527 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.881669 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.881801 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.881932 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.882061 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.882204 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.882336 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.882467 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.882596 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.882725 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.882855 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.882992 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.883123 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.883253 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.883383 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.883524 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.883654 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.883816 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.883950 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.884080 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.884210 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.884339 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.884469 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.884607 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.884737 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.884867 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.884998 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.885134 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.885275 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.885413 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.885545 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.885675 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.885810 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.885941 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.886079 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.886217 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.886347 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.886476 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.886614 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.886745 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.886875 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.887016 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.887162 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.887293 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.887423 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.887552 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.887681 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.887905 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.888041 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.888173 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.888303 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.888434 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.888564 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.888702 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.888834 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.889105 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.889367 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.889579 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.889720 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.889720 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.889979 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.890111 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.890243 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.890243 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.890489 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.890629 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.890767 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.890898 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.891028 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.891170 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.891308 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.891448 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.891580 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.user = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.891580 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.891856 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.891856 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.892104 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.892246 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.892379 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.892509 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.892641 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.892641 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.892894 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.892894 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.893162 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.893293 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.893425 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.893425 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.893672 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.893810 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.893941 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.894072 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.894203 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.894333 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.894464 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.894604 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.894746 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.894878 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.895009 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.user = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.895140 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.895270 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.895410 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.895543 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.895674 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.895860 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.895993 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.896124 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.896267 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.896399 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.896531 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.896671 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.896803 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.896942 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.897073 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.897204 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.897341 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.897472 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.897604 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.897744 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.897875 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.898006 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.898136 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.898266 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.898396 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.898544 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.898677 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.898809 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.898940 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.899070 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.899200 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.899338 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.899476 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.899611 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.899759 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.899895 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.900027 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.900168 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.900310 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.900441 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.900571 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.900701 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.900831 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.900969 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.901101 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.901231 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.901360 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] resource.caching = True {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.901490 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.901620 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.901759 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.901759 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.901759 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.902142 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.902275 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.902404 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.902612 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.902746 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.902877 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.903008 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.903139 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.903269 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.903432 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.903569 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.903700 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.903903 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.904036 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.904179 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.904321 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.904454 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] role.caching = True {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.904584 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.904715 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] role.driver = sql {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.904851 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] resource.caching = True {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.904983 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.904983 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.905240 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.905371 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.905503 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.905503 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.905750 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.905899 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.906031 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.906031 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.906280 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.906410 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.906541 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.906680 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.906811 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.906941 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.907073 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.907203 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.907332 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.907471 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.907603 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] role.caching = True {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.907764 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.907901 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] role.driver = sql {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.907901 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.908151 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.908293 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.908426 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.908556 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.908694 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.908826 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.908956 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.909096 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.909228 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.909358 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.909507 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.909641 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.909782 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.909914 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.910044 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.910175 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.910406 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.912871 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.913040 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.913177 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.913177 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.915569 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.915732 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.915890 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.915890 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.917246 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.918465 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.918602 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.918733 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.918865 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.919027 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.919344 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.919498 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.919634 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.919821 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.919821 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.920095 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.920242 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.920373 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.920504 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.920642 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.920773 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] token.caching = True {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.920913 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.921046 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.921177 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.921308 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.921439 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.921570 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.921710 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.921842 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.921983 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.922114 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.922244 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.922374 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.922513 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.922645 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.922776 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.922905 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.923036 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.923167 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.923306 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.923438 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.923567 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.923698 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.923861 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.923994 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.924136 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] token.caching = True {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.924268 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.924400 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.924530 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.924660 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.924800 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.924932 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.925062 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.925192 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.925322 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.925453 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.925601 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] database.connection = **** {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.925747 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.925893 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.926031 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.926165 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.926165 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.926414 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.926545 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.926545 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.926803 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.926935 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.926935 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.927181 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.927181 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.927447 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.927580 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.927580 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.927873 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.928006 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.928006 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.928262 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.928394 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.928524 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.928654 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.928785 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.928785 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.929041 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] database.connection = **** {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.929181 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.929332 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.929465 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.929596 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.929727 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.929857 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.929996 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.930129 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.930260 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.930391 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.930521 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 12 02:49:40.930652 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.930652 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.930652 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.930652 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.930652 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.930652 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.930652 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.930652 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.930652 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.931851 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.931851 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.931851 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.931851 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 02:49:40.931851 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 12 02:49:40.932473 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79724) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:40.932473 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79724) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:40.932473 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79724) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:40.934194 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:40.934521 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:40.934725 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:40.941043 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79724) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:40.943670 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:40.971780 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79724) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:40.972092 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79724) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:40.972564 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:40.972794 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.027090 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.027377 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79724) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.077542 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.078092 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.078182 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79724) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.078360 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79724) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.146798 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.146962 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.147185 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.147366 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.147579 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.147820 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.149382 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79724) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.149616 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79724) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.149842 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79724) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.150076 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79724) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.150382 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79724) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.150697 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79724) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.171527 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.171863 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.171954 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79724) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.172049 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.172139 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79724) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.172226 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.172307 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79724) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.172372 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.172579 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79724) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.172665 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.172727 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79724) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.172796 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.172860 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79724) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.173107 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79724) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.184361 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.184920 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79724) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.197342 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.197502 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79724) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.197570 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.197631 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79724) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.197828 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.197913 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79724) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.197995 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.198059 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79724) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.198209 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.198289 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79724) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.198351 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.198420 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79724) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.198585 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.198667 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79724) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 02:49:41.216410 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.216653 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 12 02:49:41.216816 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.216955 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 12 02:49:41.217085 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.217085 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 12 02:49:41.217344 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.217476 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.217616 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 12 02:49:41.217746 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.217876 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.218005 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.218133 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.218261 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.218399 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.218399 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.229074 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.229289 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.229433 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.229582 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.229717 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.229848 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.229980 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.230121 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.238014 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79724) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 02:49:41.238214 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 02:49:41.241266 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79724) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 02:49:41.241462 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 02:49:41.241621 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.241772 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.241905 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.242036 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.242167 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.242298 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.242428 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.242568 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.242698 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.242827 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.242956 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.243096 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.243248 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.243379 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.243510 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.243642 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.243823 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.243971 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.244104 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.244233 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.270433 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.270672 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.272047 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79724) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 02:49:41.272261 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 02:49:41.272406 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.272541 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.277515 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79724) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 02:49:41.277712 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 02:49:41.277872 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.278009 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.278140 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.278271 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.285412 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79724) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 02:49:41.285627 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 02:49:41.285772 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.285907 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.290224 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79724) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 02:49:41.290423 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 02:49:41.290567 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.290716 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.290851 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.290989 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.291120 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.291263 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.291404 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.291534 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.291663 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.291829 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.291961 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.292103 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.292235 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.292374 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.311017 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.311243 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.311473 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.311733 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.315862 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 02:49:41.316314 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79724) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 02:49:41.319471 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.319750 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.319924 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.320200 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.324757 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 02:49:41.325165 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79724) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 02:49:41.330406 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 02:49:41.331019 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79724) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 02:49:41.334053 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.334348 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.334638 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.334832 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.335068 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.335207 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.335340 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.335483 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.335614 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.335792 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.335792 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.336058 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.458067 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 02:49:41.458397 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79724) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 02:49:41.458574 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.458715 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.458850 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.458983 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.459170 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.459315 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.466782 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.466985 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.468498 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.468709 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.468858 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.468996 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.471760 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79724) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 02:49:41.471960 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 02:49:41.472109 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.472262 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.472431 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.472595 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.472732 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.472866 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.473010 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.473161 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.486035 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79724) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 02:49:41.486258 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 02:49:41.486408 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.486560 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.486706 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.486844 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.486979 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.487114 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.487249 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.487391 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.487527 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.487661 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.487845 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.487995 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.505713 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 02:49:41.505953 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79724) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 02:49:41.508972 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79724) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 02:49:41.509173 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 02:49:41.512258 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.512461 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.513940 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.514141 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.515691 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 02:49:41.516002 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.516250 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.520868 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79724) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 02:49:41.520868 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.520868 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.523568 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.525185 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 02:49:41.526537 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.528142 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79724) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 02:49:41.528341 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.528667 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.528959 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.529201 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.531506 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.531814 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.532097 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.532336 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.538384 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 02:49:41.538663 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.538935 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.541574 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79724) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 02:49:41.541855 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.542127 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.546916 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 02:49:41.547190 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.547471 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.547768 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.548046 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.548308 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.548585 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.548853 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.549117 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.549485 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.549762 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.550018 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.550169 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79724) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 02:49:41.550286 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.550440 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.550580 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.550709 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.550972 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.551292 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.551604 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.551960 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.552232 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.552496 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.552862 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.553129 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.553390 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.553643 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.553896 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79724) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 02:49:41.588529 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x557e67a8e9c0 pid: 79722 (default app) Apr 12 02:49:41.592161 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301d201-1cd4-4457-9f3b-bf930e96085a None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:49:41.592389 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x557e67a8e9c0 pid: 79724 (default app) Apr 12 02:49:41.592484 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301d201-1cd4-4457-9f3b-bf930e96085a None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:49:41.592702 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301d201-1cd4-4457-9f3b-bf930e96085a None None] PATH_INFO: `/v3` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:49:41.597250 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1/1] 10.222.0.32 () {50 vars in 791 bytes} [Tue Apr 12 02:49:41 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:49:49.820804 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe6fc6-8ef0-40f4-a7dd-2514b8523eca None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:49:49.821393 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe6fc6-8ef0-40f4-a7dd-2514b8523eca None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:49:49.821393 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe6fc6-8ef0-40f4-a7dd-2514b8523eca None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:49:49.825999 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1/2] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:49:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:49:49.831863 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc376328-7e00-473d-8358-c751617eeaf5 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:49:49.832325 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc376328-7e00-473d-8358-c751617eeaf5 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:49:49.832497 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc376328-7e00-473d-8358-c751617eeaf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:49:49.863584 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG oslo_db.sqlalchemy.engines [None req-fc376328-7e00-473d-8358-c751617eeaf5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 02:49:50.043906 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG passlib.handlers.bcrypt [None req-fc376328-7e00-473d-8358-c751617eeaf5 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79722) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 12 02:49:50.044330 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG passlib.handlers.bcrypt [None req-fc376328-7e00-473d-8358-c751617eeaf5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79722) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 12 02:49:50.099758 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-fc376328-7e00-473d-8358-c751617eeaf5 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:49:50.101345 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-fc376328-7e00-473d-8358-c751617eeaf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:49:50.225458 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 2/3] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:49:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Apr 12 02:49:50.380442 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe6fc6-8ef0-40f4-a7dd-2514b8523eca None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:49:50.415298 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG oslo_db.sqlalchemy.engines [None req-60fe6fc6-8ef0-40f4-a7dd-2514b8523eca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79724) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 02:49:50.543800 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe6fc6-8ef0-40f4-a7dd-2514b8523eca None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:49:50.548474 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f01947-fa12-45f8-badb-971e212086dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:49:50.549124 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f01947-fa12-45f8-badb-971e212086dd admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:49:50.549401 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f01947-fa12-45f8-badb-971e212086dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:49:50.549656 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f01947-fa12-45f8-badb-971e212086dd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:49:50.558005 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f01947-fa12-45f8-badb-971e212086dd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:49:50.608018 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b9f01947-fa12-45f8-badb-971e212086dd admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 12 02:49:50.608353 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f01947-fa12-45f8-badb-971e212086dd admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:49:50.618144 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 2/4] 10.222.0.32 () {58 vars in 1324 bytes} [Tue Apr 12 02:49:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 02:49:50.625712 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc376328-7e00-473d-8358-c751617eeaf5 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:49:50.640489 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc376328-7e00-473d-8358-c751617eeaf5 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:49:50.646295 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4c352-50a5-4e4e-ae61-2034366e3178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:49:50.647511 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4c352-50a5-4e4e-ae61-2034366e3178 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:49:50.647828 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4c352-50a5-4e4e-ae61-2034366e3178 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:49:50.648104 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4c352-50a5-4e4e-ae61-2034366e3178 admin admin] PATH_INFO: `/v3/projects/c0c2ded0aef5404894a48ce0d4dafe72` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:49:50.649729 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e4c352-50a5-4e4e-ae61-2034366e3178 admin admin] RBAC: Authorizing `identity:get_project(project_id=c0c2ded0aef5404894a48ce0d4dafe72)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:49:50.701954 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.common.rbac_enforcer.enforcer [None req-84e4c352-50a5-4e4e-ae61-2034366e3178 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 12 02:49:50.702290 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e4c352-50a5-4e4e-ae61-2034366e3178 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:49:50.707515 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 3/5] 10.222.0.32 () {56 vars in 1207 bytes} [Tue Apr 12 02:49:50 2022] GET /identity/v3/projects/c0c2ded0aef5404894a48ce0d4dafe72 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:49:52.966898 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0c79b-fdcb-4116-a694-34d0fc8ab22c None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:49:52.967408 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0c79b-fdcb-4116-a694-34d0fc8ab22c None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:49:52.967408 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0c79b-fdcb-4116-a694-34d0fc8ab22c None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:49:52.971592 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 3/6] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:49:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:49:52.977053 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58f427-c422-4124-8465-4d7600236b4a None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:49:52.977492 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58f427-c422-4124-8465-4d7600236b4a None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:49:52.977578 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58f427-c422-4124-8465-4d7600236b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:49:52.996543 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-bf58f427-c422-4124-8465-4d7600236b4a None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:49:52.998163 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-bf58f427-c422-4124-8465-4d7600236b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:49:53.006114 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 4/7] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:49:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Apr 12 02:49:53.028913 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0c79b-fdcb-4116-a694-34d0fc8ab22c None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:49:53.041748 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0c79b-fdcb-4116-a694-34d0fc8ab22c None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:49:53.046555 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeba87c-0288-4144-9e14-de11dce4b38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:49:53.047213 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeba87c-0288-4144-9e14-de11dce4b38b admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:49:53.047490 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeba87c-0288-4144-9e14-de11dce4b38b admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:49:53.047751 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeba87c-0288-4144-9e14-de11dce4b38b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:49:53.057032 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeba87c-0288-4144-9e14-de11dce4b38b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:49:53.058844 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeba87c-0288-4144-9e14-de11dce4b38b admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:49:53.069392 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 4/8] 10.222.0.32 () {58 vars in 1324 bytes} [Tue Apr 12 02:49:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 02:49:53.077274 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58f427-c422-4124-8465-4d7600236b4a None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:49:53.087420 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58f427-c422-4124-8465-4d7600236b4a None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:49:53.092859 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b2f1e-cedd-4a29-aa2e-400e5663d5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:49:53.093760 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b2f1e-cedd-4a29-aa2e-400e5663d5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:49:53.094038 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b2f1e-cedd-4a29-aa2e-400e5663d5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:49:53.094278 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b2f1e-cedd-4a29-aa2e-400e5663d5b8 admin admin] PATH_INFO: `/v3/users/99e456857e814b9bb8e2717b9f3a9a8f` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:49:53.095888 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b2f1e-cedd-4a29-aa2e-400e5663d5b8 admin admin] RBAC: Authorizing `identity:get_user(user_id=99e456857e814b9bb8e2717b9f3a9a8f)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:49:53.097779 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b2f1e-cedd-4a29-aa2e-400e5663d5b8 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:49:53.099440 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 5/9] 10.222.0.32 () {56 vars in 1198 bytes} [Tue Apr 12 02:49:53 2022] GET /identity/v3/users/99e456857e814b9bb8e2717b9f3a9a8f => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:49:55.427480 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7bde4-81fb-4241-99e4-a6ab7d8629da None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:49:55.428056 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7bde4-81fb-4241-99e4-a6ab7d8629da None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:49:55.428132 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7bde4-81fb-4241-99e4-a6ab7d8629da None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:49:55.429509 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 5/10] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:49:55.435343 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970872e-0b27-40ca-8a69-13f8fd324ac6 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:49:55.435874 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970872e-0b27-40ca-8a69-13f8fd324ac6 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:49:55.435874 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970872e-0b27-40ca-8a69-13f8fd324ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:49:55.452637 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-b970872e-0b27-40ca-8a69-13f8fd324ac6 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:49:55.454091 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-b970872e-0b27-40ca-8a69-13f8fd324ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:49:55.490423 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f5516-6bda-4be9-a933-58e6bfab469c None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:49:55.490757 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f5516-6bda-4be9-a933-58e6bfab469c None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:49:55.490949 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f5516-6bda-4be9-a933-58e6bfab469c None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:49:55.492597 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 6/11] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:49:55.497702 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330a665-5e22-4e47-b4f8-95f69d597b1d None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:49:55.497990 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330a665-5e22-4e47-b4f8-95f69d597b1d None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:49:55.498251 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330a665-5e22-4e47-b4f8-95f69d597b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:49:55.538169 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 6/12] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:49:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:49:55.538375 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG passlib.handlers.bcrypt [None req-7330a665-5e22-4e47-b4f8-95f69d597b1d None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79724) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 12 02:49:55.538813 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG passlib.handlers.bcrypt [None req-7330a665-5e22-4e47-b4f8-95f69d597b1d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79724) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 12 02:49:55.562924 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970872e-0b27-40ca-8a69-13f8fd324ac6 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:49:55.585314 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-7330a665-5e22-4e47-b4f8-95f69d597b1d None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:49:55.586942 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-7330a665-5e22-4e47-b4f8-95f69d597b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:49:55.663002 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970872e-0b27-40ca-8a69-13f8fd324ac6 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:49:55.684206 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 7/13] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:49:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:49:55.700451 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb32059-bffc-4e6f-853b-30a540b54f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:49:55.701260 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb32059-bffc-4e6f-853b-30a540b54f1a None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:49:55.701533 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb32059-bffc-4e6f-853b-30a540b54f1a None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:49:55.701799 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb32059-bffc-4e6f-853b-30a540b54f1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:49:55.706045 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330a665-5e22-4e47-b4f8-95f69d597b1d None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:49:55.713947 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb32059-bffc-4e6f-853b-30a540b54f1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:49:55.720834 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-dfb32059-bffc-4e6f-853b-30a540b54f1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 02:49:55.722072 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 7/14] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 02:49:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:49:55.728644 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb32059-bffc-4e6f-853b-30a540b54f1a None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:49:55.803049 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330a665-5e22-4e47-b4f8-95f69d597b1d None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:49:55.823713 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb32059-bffc-4e6f-853b-30a540b54f1a None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:49:55.835317 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26075524-420c-4945-84b7-326e1a3bf3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:49:55.836248 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26075524-420c-4945-84b7-326e1a3bf3e7 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:49:55.836526 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26075524-420c-4945-84b7-326e1a3bf3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:49:55.836794 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26075524-420c-4945-84b7-326e1a3bf3e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:49:55.857253 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9dc12-ea07-49fc-a866-26a11522921c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:49:55.858156 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9dc12-ea07-49fc-a866-26a11522921c None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:49:55.858419 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9dc12-ea07-49fc-a866-26a11522921c None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:49:55.858842 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9dc12-ea07-49fc-a866-26a11522921c None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:49:55.859587 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9dc12-ea07-49fc-a866-26a11522921c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:49:55.859920 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9dc12-ea07-49fc-a866-26a11522921c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:49:55.861317 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9dc12-ea07-49fc-a866-26a11522921c None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:49:55.873304 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 8/15] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:49:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:49:55.878587 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9dc12-ea07-49fc-a866-26a11522921c None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:49:55.900369 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26075524-420c-4945-84b7-326e1a3bf3e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:49:55.901897 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26075524-420c-4945-84b7-326e1a3bf3e7 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:49:55.972153 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9dc12-ea07-49fc-a866-26a11522921c None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:49:55.999022 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 8/16] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:49:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:49:56.006081 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26075524-420c-4945-84b7-326e1a3bf3e7 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:49:56.009556 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a26a1-abec-4e1b-8ae3-19d96245ba8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:49:56.010444 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a26a1-abec-4e1b-8ae3-19d96245ba8d None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:49:56.010715 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a26a1-abec-4e1b-8ae3-19d96245ba8d None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:49:56.010979 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a26a1-abec-4e1b-8ae3-19d96245ba8d None admin] PATH_INFO: `/v3/users/99e456857e814b9bb8e2717b9f3a9a8f` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:49:56.012301 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a26a1-abec-4e1b-8ae3-19d96245ba8d None admin] RBAC: Authorizing `identity:get_user(user_id=99e456857e814b9bb8e2717b9f3a9a8f)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:49:56.013819 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a26a1-abec-4e1b-8ae3-19d96245ba8d None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:49:56.015641 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 9/17] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:49:55 2022] GET /identity/v3/users/99e456857e814b9bb8e2717b9f3a9a8f => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:49:56.020834 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a26a1-abec-4e1b-8ae3-19d96245ba8d None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:49:56.105208 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26075524-420c-4945-84b7-326e1a3bf3e7 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:49:56.123300 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a26a1-abec-4e1b-8ae3-19d96245ba8d None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:49:56.138835 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e19fc-8d09-4db5-bd60-ba3d4f9904f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:49:56.139647 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e19fc-8d09-4db5-bd60-ba3d4f9904f4 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:49:56.139946 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e19fc-8d09-4db5-bd60-ba3d4f9904f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:49:56.140219 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e19fc-8d09-4db5-bd60-ba3d4f9904f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:49:56.156129 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f2145-2b2e-4d2d-a02c-8dc4a19eedb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:49:56.156934 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f2145-2b2e-4d2d-a02c-8dc4a19eedb7 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:49:56.157212 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f2145-2b2e-4d2d-a02c-8dc4a19eedb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:49:56.157478 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f2145-2b2e-4d2d-a02c-8dc4a19eedb7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:49:56.158639 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f2145-2b2e-4d2d-a02c-8dc4a19eedb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:49:56.158738 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e19fc-8d09-4db5-bd60-ba3d4f9904f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:49:56.160131 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f2145-2b2e-4d2d-a02c-8dc4a19eedb7 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:49:56.160313 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e19fc-8d09-4db5-bd60-ba3d4f9904f4 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:49:56.161924 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 10/18] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:49:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:49:56.167456 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f2145-2b2e-4d2d-a02c-8dc4a19eedb7 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:49:56.177989 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-397e19fc-8d09-4db5-bd60-ba3d4f9904f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:49:56.179330 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 9/19] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:49:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:49:56.185002 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e19fc-8d09-4db5-bd60-ba3d4f9904f4 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:49:56.266678 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f2145-2b2e-4d2d-a02c-8dc4a19eedb7 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:49:56.284941 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e19fc-8d09-4db5-bd60-ba3d4f9904f4 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:49:56.305667 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0769a8a-5ada-4353-a0ac-fa03e3606307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:49:56.306338 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0769a8a-5ada-4353-a0ac-fa03e3606307 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:49:56.306606 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0769a8a-5ada-4353-a0ac-fa03e3606307 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:49:56.306891 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0769a8a-5ada-4353-a0ac-fa03e3606307 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:49:56.307753 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0769a8a-5ada-4353-a0ac-fa03e3606307 None admin] RBAC: Adding query filter params (role.id=c0f19d3800f44637822d5162ffe4b497, scope.domain.id=default, user.id=99e456857e814b9bb8e2717b9f3a9a8f) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:49:56.308079 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0769a8a-5ada-4353-a0ac-fa03e3606307 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:49:56.309617 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0769a8a-5ada-4353-a0ac-fa03e3606307 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:49:56.325209 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 11/20] 10.222.0.32 () {56 vars in 1322 bytes} [Tue Apr 12 02:49:56 2022] GET /identity/v3/role_assignments?user.id=99e456857e814b9bb8e2717b9f3a9a8f&scope.domain.id=default&role.id=c0f19d3800f44637822d5162ffe4b497 => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:49:56.325503 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d082aed-de91-4b25-8409-0717f2002624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:49:56.325503 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d082aed-de91-4b25-8409-0717f2002624 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:49:56.325503 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d082aed-de91-4b25-8409-0717f2002624 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:49:56.325503 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d082aed-de91-4b25-8409-0717f2002624 None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:49:56.325884 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d082aed-de91-4b25-8409-0717f2002624 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:49:56.325884 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d082aed-de91-4b25-8409-0717f2002624 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:49:56.325884 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d082aed-de91-4b25-8409-0717f2002624 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:49:56.347429 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 10/21] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:49:58.911500 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dbd32-9d0a-4955-8a6f-2bf5d7ee151f None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:49:58.912459 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dbd32-9d0a-4955-8a6f-2bf5d7ee151f None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:49:58.912979 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dbd32-9d0a-4955-8a6f-2bf5d7ee151f None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:49:58.914536 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 12/22] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:49:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:49:58.920424 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed148db-01cf-4284-9f18-fe023c662a9b None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:49:58.921287 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed148db-01cf-4284-9f18-fe023c662a9b None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:49:58.921754 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed148db-01cf-4284-9f18-fe023c662a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:49:58.951077 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-0ed148db-01cf-4284-9f18-fe023c662a9b None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:49:58.952668 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-0ed148db-01cf-4284-9f18-fe023c662a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:49:59.040088 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 11/23] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:49:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:49:59.074491 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3dbd32-9d0a-4955-8a6f-2bf5d7ee151f None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:49:59.211561 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3dbd32-9d0a-4955-8a6f-2bf5d7ee151f None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:49:59.259491 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc03789-364d-4778-ab71-b2f41003ac57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:49:59.260648 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc03789-364d-4778-ab71-b2f41003ac57 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:49:59.261094 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc03789-364d-4778-ab71-b2f41003ac57 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:49:59.261503 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc03789-364d-4778-ab71-b2f41003ac57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:49:59.278472 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc03789-364d-4778-ab71-b2f41003ac57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:49:59.285952 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-9cc03789-364d-4778-ab71-b2f41003ac57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 02:49:59.287398 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 13/24] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 02:49:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:49:59.293497 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed148db-01cf-4284-9f18-fe023c662a9b None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:49:59.384993 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145dd9b2-0b48-4be8-9c6e-473c724f0673 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:49:59.385653 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145dd9b2-0b48-4be8-9c6e-473c724f0673 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:49:59.386135 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145dd9b2-0b48-4be8-9c6e-473c724f0673 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:49:59.389984 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 14/25] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:49:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:49:59.406676 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9066db5-bc4d-4296-819d-0c5a7963b135 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:49:59.407240 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9066db5-bc4d-4296-819d-0c5a7963b135 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:49:59.407708 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9066db5-bc4d-4296-819d-0c5a7963b135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:49:59.437089 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-d9066db5-bc4d-4296-819d-0c5a7963b135 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:49:59.438628 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-d9066db5-bc4d-4296-819d-0c5a7963b135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:49:59.459752 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed148db-01cf-4284-9f18-fe023c662a9b None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:49:59.525139 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21439403-0c07-426b-9abb-ad26fc58d351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:49:59.525755 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21439403-0c07-426b-9abb-ad26fc58d351 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:49:59.526244 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21439403-0c07-426b-9abb-ad26fc58d351 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:49:59.526652 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21439403-0c07-426b-9abb-ad26fc58d351 None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:49:59.527568 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21439403-0c07-426b-9abb-ad26fc58d351 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:49:59.528096 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21439403-0c07-426b-9abb-ad26fc58d351 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:49:59.530042 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21439403-0c07-426b-9abb-ad26fc58d351 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:49:59.553906 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 12/26] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:49:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:49:59.561942 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21439403-0c07-426b-9abb-ad26fc58d351 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:49:59.572920 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 15/27] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:49:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 02:49:59.593941 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584b52e-0c1d-442e-aa37-168b96d38fd1 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:49:59.594576 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584b52e-0c1d-442e-aa37-168b96d38fd1 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:49:59.595050 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584b52e-0c1d-442e-aa37-168b96d38fd1 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:49:59.598973 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 16/28] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:49:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:49:59.606353 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584b52e-0c1d-442e-aa37-168b96d38fd1 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:49:59.693920 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21439403-0c07-426b-9abb-ad26fc58d351 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:49:59.728008 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea35730-0c02-41e3-b5f1-cf1b5fd1a978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:49:59.728898 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea35730-0c02-41e3-b5f1-cf1b5fd1a978 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:49:59.729169 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea35730-0c02-41e3-b5f1-cf1b5fd1a978 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:49:59.729452 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea35730-0c02-41e3-b5f1-cf1b5fd1a978 None admin] PATH_INFO: `/v3/users/99e456857e814b9bb8e2717b9f3a9a8f` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:49:59.731103 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea35730-0c02-41e3-b5f1-cf1b5fd1a978 None admin] RBAC: Authorizing `identity:get_user(user_id=99e456857e814b9bb8e2717b9f3a9a8f)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:49:59.733021 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea35730-0c02-41e3-b5f1-cf1b5fd1a978 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:49:59.734652 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 13/29] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:49:59 2022] GET /identity/v3/users/99e456857e814b9bb8e2717b9f3a9a8f => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:49:59.735845 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa5f71-8e37-42fc-a80f-13d0ab5e7035 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:49:59.736111 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa5f71-8e37-42fc-a80f-13d0ab5e7035 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:49:59.736380 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa5f71-8e37-42fc-a80f-13d0ab5e7035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:49:59.753526 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-06aa5f71-8e37-42fc-a80f-13d0ab5e7035 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:49:59.754717 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-06aa5f71-8e37-42fc-a80f-13d0ab5e7035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:49:59.782893 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584b52e-0c1d-442e-aa37-168b96d38fd1 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:49:59.822283 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 14/30] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:49:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:49:59.823625 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cee56b-792b-4d7d-92e0-1d40520b9204 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:49:59.823952 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cee56b-792b-4d7d-92e0-1d40520b9204 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:49:59.824225 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cee56b-792b-4d7d-92e0-1d40520b9204 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:49:59.826292 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 15/31] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:49:59.826410 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160ce38-e587-42b6-a843-5c66726e5f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:49:59.827083 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cee56b-792b-4d7d-92e0-1d40520b9204 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:49:59.827658 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160ce38-e587-42b6-a843-5c66726e5f6a None admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:49:59.828385 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160ce38-e587-42b6-a843-5c66726e5f6a None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:49:59.828655 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160ce38-e587-42b6-a843-5c66726e5f6a None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:49:59.829421 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160ce38-e587-42b6-a843-5c66726e5f6a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:49:59.831020 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160ce38-e587-42b6-a843-5c66726e5f6a None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:49:59.936634 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cee56b-792b-4d7d-92e0-1d40520b9204 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:49:59.973625 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 17/32] 10.222.0.32 () {60 vars in 1131 bytes} [Tue Apr 12 02:49:59 2022] POST /identity/v3/roles => generated 219 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 02:49:59.974651 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58953626-9d9c-4215-90b7-d920c06267e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:49:59.975185 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078c05d-a235-496e-b427-1283b1b2ed7c None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:49:59.975470 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078c05d-a235-496e-b427-1283b1b2ed7c None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:49:59.975781 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078c05d-a235-496e-b427-1283b1b2ed7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:49:59.976333 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58953626-9d9c-4215-90b7-d920c06267e9 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:49:59.976810 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58953626-9d9c-4215-90b7-d920c06267e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:49:59.977276 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58953626-9d9c-4215-90b7-d920c06267e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:49:59.979195 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58953626-9d9c-4215-90b7-d920c06267e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:49:59.981188 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58953626-9d9c-4215-90b7-d920c06267e9 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:49:59.983876 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 16/33] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:49:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:49:59.986162 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58953626-9d9c-4215-90b7-d920c06267e9 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:49:59.997578 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-f078c05d-a235-496e-b427-1283b1b2ed7c None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:49:59.999253 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-f078c05d-a235-496e-b427-1283b1b2ed7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:00.070841 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 18/34] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:49:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:00.071573 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078c05d-a235-496e-b427-1283b1b2ed7c None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:00.118637 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58953626-9d9c-4215-90b7-d920c06267e9 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:00.163027 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74905e3f-b314-4a5b-9f92-065245e44ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:00.164326 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74905e3f-b314-4a5b-9f92-065245e44ab9 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:00.164784 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74905e3f-b314-4a5b-9f92-065245e44ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:00.165546 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74905e3f-b314-4a5b-9f92-065245e44ab9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:00.177751 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74905e3f-b314-4a5b-9f92-065245e44ab9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:00.179502 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74905e3f-b314-4a5b-9f92-065245e44ab9 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:00.191136 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078c05d-a235-496e-b427-1283b1b2ed7c None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:00.198536 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-74905e3f-b314-4a5b-9f92-065245e44ab9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:50:00.200607 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 17/35] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:49:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:00.201751 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74905e3f-b314-4a5b-9f92-065245e44ab9 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:00.260828 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94121d3-7d90-4d0b-a668-b9a40d8bf069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:00.261771 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94121d3-7d90-4d0b-a668-b9a40d8bf069 None admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:00.262059 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94121d3-7d90-4d0b-a668-b9a40d8bf069 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:00.262373 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94121d3-7d90-4d0b-a668-b9a40d8bf069 None admin] PATH_INFO: `/v3/domains/default/users/99e456857e814b9bb8e2717b9f3a9a8f/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:00.269623 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94121d3-7d90-4d0b-a668-b9a40d8bf069 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=99e456857e814b9bb8e2717b9f3a9a8f, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:00.271364 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94121d3-7d90-4d0b-a668-b9a40d8bf069 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:00.295232 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 19/36] 10.222.0.32 () {58 vars in 1361 bytes} [Tue Apr 12 02:50:00 2022] PUT /identity/v3/domains/default/users/99e456857e814b9bb8e2717b9f3a9a8f/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 02:50:00.295866 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94121d3-7d90-4d0b-a668-b9a40d8bf069 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:00.334257 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74905e3f-b314-4a5b-9f92-065245e44ab9 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:00.374062 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ce8b0-75c6-4911-a5a8-f198459b2bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:00.375531 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ce8b0-75c6-4911-a5a8-f198459b2bb3 None admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:00.376108 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ce8b0-75c6-4911-a5a8-f198459b2bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:00.376577 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ce8b0-75c6-4911-a5a8-f198459b2bb3 None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:00.377763 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ce8b0-75c6-4911-a5a8-f198459b2bb3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:00.379977 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ce8b0-75c6-4911-a5a8-f198459b2bb3 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:00.489389 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94121d3-7d90-4d0b-a668-b9a40d8bf069 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:00.526713 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 18/37] 10.222.0.32 () {60 vars in 1131 bytes} [Tue Apr 12 02:50:00 2022] POST /identity/v3/roles => generated 225 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 02:50:00.528517 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa3226-1b36-40ce-ab4d-c24f0a6cbba9 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:00.529014 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa3226-1b36-40ce-ab4d-c24f0a6cbba9 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:00.529323 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851a010-f0c7-4d50-9493-afd682703624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:00.529441 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa3226-1b36-40ce-ab4d-c24f0a6cbba9 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:00.530416 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851a010-f0c7-4d50-9493-afd682703624 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:00.530743 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 19/38] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:00.531182 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851a010-f0c7-4d50-9493-afd682703624 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:00.531714 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851a010-f0c7-4d50-9493-afd682703624 None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:00.532733 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851a010-f0c7-4d50-9493-afd682703624 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:00.533299 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851a010-f0c7-4d50-9493-afd682703624 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:00.535513 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851a010-f0c7-4d50-9493-afd682703624 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:00.536434 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018088c5-5c25-43f5-a449-d85b5f9850d9 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:00.537027 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018088c5-5c25-43f5-a449-d85b5f9850d9 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:00.537308 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018088c5-5c25-43f5-a449-d85b5f9850d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:00.560359 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 20/39] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:00.563416 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-018088c5-5c25-43f5-a449-d85b5f9850d9 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:00.565519 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-018088c5-5c25-43f5-a449-d85b5f9850d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:00.566339 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851a010-f0c7-4d50-9493-afd682703624 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:00.661266 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 20/40] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 02:50:00.692527 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851a010-f0c7-4d50-9493-afd682703624 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:00.703675 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018088c5-5c25-43f5-a449-d85b5f9850d9 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:00.741811 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ae3bf-b7b3-4e2f-8636-e695a63150e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:00.742502 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ae3bf-b7b3-4e2f-8636-e695a63150e8 None admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:00.742780 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ae3bf-b7b3-4e2f-8636-e695a63150e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:00.743052 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ae3bf-b7b3-4e2f-8636-e695a63150e8 None admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:00.744951 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ae3bf-b7b3-4e2f-8636-e695a63150e8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:00.746736 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ae3bf-b7b3-4e2f-8636-e695a63150e8 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:00.786340 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 21/41] 10.222.0.32 () {60 vars in 1141 bytes} [Tue Apr 12 02:50:00 2022] POST /identity/v3/projects => generated 301 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 02:50:00.845296 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018088c5-5c25-43f5-a449-d85b5f9850d9 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:00.886678 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134611b2-1da3-4022-8af5-db8efeab2e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:00.887280 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134611b2-1da3-4022-8af5-db8efeab2e40 None admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:00.887919 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134611b2-1da3-4022-8af5-db8efeab2e40 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:00.887919 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134611b2-1da3-4022-8af5-db8efeab2e40 None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:00.888802 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134611b2-1da3-4022-8af5-db8efeab2e40 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:00.890470 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134611b2-1da3-4022-8af5-db8efeab2e40 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:00.909737 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 21/42] 10.222.0.32 () {60 vars in 1131 bytes} [Tue Apr 12 02:50:00 2022] POST /identity/v3/roles => generated 223 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 02:50:01.112478 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8b9d7-0192-4246-8fea-9b0766c70afb None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:01.113020 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8b9d7-0192-4246-8fea-9b0766c70afb None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:01.113020 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8b9d7-0192-4246-8fea-9b0766c70afb None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:01.114387 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 22/43] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:01.119578 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a709d71-b7c8-4a05-b3b6-04bc9ef856dc None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:01.120045 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a709d71-b7c8-4a05-b3b6-04bc9ef856dc None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:01.120224 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a709d71-b7c8-4a05-b3b6-04bc9ef856dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:01.137245 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-2a709d71-b7c8-4a05-b3b6-04bc9ef856dc None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:01.138446 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-2a709d71-b7c8-4a05-b3b6-04bc9ef856dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:01.200553 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 22/44] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:01.224708 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8b9d7-0192-4246-8fea-9b0766c70afb None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:01.328982 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8b9d7-0192-4246-8fea-9b0766c70afb None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:01.362749 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0ada5-e0d7-4875-8cd0-71e8ca6ba3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:01.363541 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0ada5-e0d7-4875-8cd0-71e8ca6ba3f4 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:01.363851 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0ada5-e0d7-4875-8cd0-71e8ca6ba3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:01.364121 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0ada5-e0d7-4875-8cd0-71e8ca6ba3f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:01.365294 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed0ada5-e0d7-4875-8cd0-71e8ca6ba3f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:01.366760 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed0ada5-e0d7-4875-8cd0-71e8ca6ba3f4 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:01.368609 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 23/45] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:50:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:01.374318 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a709d71-b7c8-4a05-b3b6-04bc9ef856dc None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:01.471290 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a709d71-b7c8-4a05-b3b6-04bc9ef856dc None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:01.504240 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3677da3-a407-420f-aa28-de8c1ac3470a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:01.504887 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3677da3-a407-420f-aa28-de8c1ac3470a None admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:01.505163 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3677da3-a407-420f-aa28-de8c1ac3470a None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:01.505428 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3677da3-a407-420f-aa28-de8c1ac3470a None admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:01.506124 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3677da3-a407-420f-aa28-de8c1ac3470a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:01.507568 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3677da3-a407-420f-aa28-de8c1ac3470a None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:01.536202 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 23/46] 10.222.0.32 () {60 vars in 1141 bytes} [Tue Apr 12 02:50:01 2022] POST /identity/v3/projects => generated 312 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 02:50:02.861106 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb3ee7-38e3-4e13-8332-77730105c105 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:02.861641 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb3ee7-38e3-4e13-8332-77730105c105 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:02.861641 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb3ee7-38e3-4e13-8332-77730105c105 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:02.862925 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 24/47] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:02.868239 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6277748-c13f-42a5-8d9f-fc5b5733b25f None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:02.868662 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6277748-c13f-42a5-8d9f-fc5b5733b25f None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:02.868743 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6277748-c13f-42a5-8d9f-fc5b5733b25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:02.886698 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-d6277748-c13f-42a5-8d9f-fc5b5733b25f None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:02.888022 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-d6277748-c13f-42a5-8d9f-fc5b5733b25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:02.956000 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 24/48] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:02.980469 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb3ee7-38e3-4e13-8332-77730105c105 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:03.085772 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb3ee7-38e3-4e13-8332-77730105c105 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:03.122792 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381e282-e91d-4636-8e12-c4d7dd01b060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:03.123522 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381e282-e91d-4636-8e12-c4d7dd01b060 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:03.123826 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381e282-e91d-4636-8e12-c4d7dd01b060 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:03.124096 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381e282-e91d-4636-8e12-c4d7dd01b060 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:03.133975 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381e282-e91d-4636-8e12-c4d7dd01b060 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:03.141202 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-4381e282-e91d-4636-8e12-c4d7dd01b060 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 02:50:03.142428 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 25/49] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 02:50:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:03.148491 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6277748-c13f-42a5-8d9f-fc5b5733b25f None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:03.245988 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6277748-c13f-42a5-8d9f-fc5b5733b25f None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:03.279932 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd584f92-7ad8-431f-97e1-fcb6e8334540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:03.280602 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd584f92-7ad8-431f-97e1-fcb6e8334540 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:03.280881 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd584f92-7ad8-431f-97e1-fcb6e8334540 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:03.281154 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd584f92-7ad8-431f-97e1-fcb6e8334540 None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:03.281907 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd584f92-7ad8-431f-97e1-fcb6e8334540 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:03.282209 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd584f92-7ad8-431f-97e1-fcb6e8334540 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:03.283593 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd584f92-7ad8-431f-97e1-fcb6e8334540 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:03.292042 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 25/50] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:50:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:03.297693 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381e282-e91d-4636-8e12-c4d7dd01b060 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:03.397692 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381e282-e91d-4636-8e12-c4d7dd01b060 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:03.431059 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b3b59-b0db-4205-aaf4-8906f184d0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:03.431967 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b3b59-b0db-4205-aaf4-8906f184d0d0 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:03.432247 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b3b59-b0db-4205-aaf4-8906f184d0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:03.432516 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b3b59-b0db-4205-aaf4-8906f184d0d0 None admin] PATH_INFO: `/v3/users/99e456857e814b9bb8e2717b9f3a9a8f` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:03.433711 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b3b59-b0db-4205-aaf4-8906f184d0d0 None admin] RBAC: Authorizing `identity:get_user(user_id=99e456857e814b9bb8e2717b9f3a9a8f)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:03.435272 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b3b59-b0db-4205-aaf4-8906f184d0d0 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:03.436956 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 26/51] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:50:03 2022] GET /identity/v3/users/99e456857e814b9bb8e2717b9f3a9a8f => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:03.442565 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd584f92-7ad8-431f-97e1-fcb6e8334540 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:03.546228 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd584f92-7ad8-431f-97e1-fcb6e8334540 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:03.580046 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d2292-a63c-4880-bb61-79b21360ff5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:03.580843 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d2292-a63c-4880-bb61-79b21360ff5d None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:03.581090 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d2292-a63c-4880-bb61-79b21360ff5d None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:03.581388 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d2292-a63c-4880-bb61-79b21360ff5d None admin] PATH_INFO: `/v3/domains/default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:03.582595 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d2292-a63c-4880-bb61-79b21360ff5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:03.584066 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d2292-a63c-4880-bb61-79b21360ff5d None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:03.585867 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 26/52] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:50:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:03.591772 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b3b59-b0db-4205-aaf4-8906f184d0d0 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:03.687689 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b3b59-b0db-4205-aaf4-8906f184d0d0 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:03.721257 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54890c63-6f93-429d-a232-a2fbd220a9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:03.721911 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54890c63-6f93-429d-a232-a2fbd220a9d3 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:03.722189 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54890c63-6f93-429d-a232-a2fbd220a9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:03.722461 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54890c63-6f93-429d-a232-a2fbd220a9d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:03.723287 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54890c63-6f93-429d-a232-a2fbd220a9d3 None admin] RBAC: Adding query filter params (role.id=c0f19d3800f44637822d5162ffe4b497, scope.domain.id=default, user.id=99e456857e814b9bb8e2717b9f3a9a8f) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:03.723595 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54890c63-6f93-429d-a232-a2fbd220a9d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:03.725109 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54890c63-6f93-429d-a232-a2fbd220a9d3 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:03.731029 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 27/53] 10.222.0.32 () {56 vars in 1322 bytes} [Tue Apr 12 02:50:03 2022] GET /identity/v3/role_assignments?user.id=99e456857e814b9bb8e2717b9f3a9a8f&scope.domain.id=default&role.id=c0f19d3800f44637822d5162ffe4b497 => generated 530 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:03.832199 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408eb7d-273f-4257-8e88-54cf746adf72 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:03.832457 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408eb7d-273f-4257-8e88-54cf746adf72 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:03.832762 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408eb7d-273f-4257-8e88-54cf746adf72 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:03.834138 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 27/54] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:03.839772 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859133ff-943e-4856-9bfc-73c9af62e966 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:03.840088 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859133ff-943e-4856-9bfc-73c9af62e966 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:03.840361 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859133ff-943e-4856-9bfc-73c9af62e966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:03.857887 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-859133ff-943e-4856-9bfc-73c9af62e966 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:03.859106 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-859133ff-943e-4856-9bfc-73c9af62e966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:03.929354 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 28/55] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:03.954082 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408eb7d-273f-4257-8e88-54cf746adf72 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:04.052485 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408eb7d-273f-4257-8e88-54cf746adf72 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:04.085396 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73263f2-dff5-4679-9da5-155b3c0aac9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:04.086182 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73263f2-dff5-4679-9da5-155b3c0aac9e None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:04.086458 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73263f2-dff5-4679-9da5-155b3c0aac9e None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:04.086723 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73263f2-dff5-4679-9da5-155b3c0aac9e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:04.087921 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73263f2-dff5-4679-9da5-155b3c0aac9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:04.089356 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73263f2-dff5-4679-9da5-155b3c0aac9e None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:04.090989 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 28/56] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:50:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:04.097412 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859133ff-943e-4856-9bfc-73c9af62e966 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:04.201159 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859133ff-943e-4856-9bfc-73c9af62e966 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:04.235863 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6f979-8026-415e-a1c0-1386cff5bbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:04.236444 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6f979-8026-415e-a1c0-1386cff5bbe4 None admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:04.236721 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6f979-8026-415e-a1c0-1386cff5bbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:04.236989 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6f979-8026-415e-a1c0-1386cff5bbe4 None admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:04.237712 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6f979-8026-415e-a1c0-1386cff5bbe4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:04.239175 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6f979-8026-415e-a1c0-1386cff5bbe4 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:04.270131 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 29/57] 10.222.0.32 () {60 vars in 1140 bytes} [Tue Apr 12 02:50:04 2022] POST /identity/v3/projects => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 02:50:06.538589 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643dea65-754a-4a21-9fa0-6e2fcaeedd98 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:06.539128 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643dea65-754a-4a21-9fa0-6e2fcaeedd98 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:06.539128 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643dea65-754a-4a21-9fa0-6e2fcaeedd98 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:06.540513 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 29/58] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:06.546643 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de65b61-fd1b-4875-861c-fff6f96308bb None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:06.547295 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de65b61-fd1b-4875-861c-fff6f96308bb None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:06.547436 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de65b61-fd1b-4875-861c-fff6f96308bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:06.568606 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-6de65b61-fd1b-4875-861c-fff6f96308bb None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:06.569796 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-6de65b61-fd1b-4875-861c-fff6f96308bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:06.638218 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 30/59] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:06.667350 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643dea65-754a-4a21-9fa0-6e2fcaeedd98 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:06.772583 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643dea65-754a-4a21-9fa0-6e2fcaeedd98 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:06.805682 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ade41-5d8d-4579-94eb-4967c67a848b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:06.806388 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ade41-5d8d-4579-94eb-4967c67a848b None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:06.806667 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ade41-5d8d-4579-94eb-4967c67a848b None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:06.806934 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ade41-5d8d-4579-94eb-4967c67a848b None admin] PATH_INFO: `/v3/domains/default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:06.808121 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ade41-5d8d-4579-94eb-4967c67a848b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:06.809606 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ade41-5d8d-4579-94eb-4967c67a848b None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:06.811214 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 30/60] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:50:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:06.817690 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de65b61-fd1b-4875-861c-fff6f96308bb None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:06.936482 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de65b61-fd1b-4875-861c-fff6f96308bb None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:06.970049 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a31b9d-db04-417c-9671-0e05a60f3353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:06.970700 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a31b9d-db04-417c-9671-0e05a60f3353 None admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:06.970943 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a31b9d-db04-417c-9671-0e05a60f3353 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:06.971234 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a31b9d-db04-417c-9671-0e05a60f3353 None admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:06.971952 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a31b9d-db04-417c-9671-0e05a60f3353 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:06.973417 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a31b9d-db04-417c-9671-0e05a60f3353 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:07.004605 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 31/61] 10.222.0.32 () {60 vars in 1132 bytes} [Tue Apr 12 02:50:06 2022] POST /identity/v3/users => generated 275 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 02:50:10.501035 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc629945-4bde-4928-91a5-c6275b37f3e4 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:10.501584 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc629945-4bde-4928-91a5-c6275b37f3e4 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:10.501659 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc629945-4bde-4928-91a5-c6275b37f3e4 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:10.503015 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 31/62] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:10.508357 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1ac07-b509-40b7-98ac-9cc53d560470 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:10.508764 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1ac07-b509-40b7-98ac-9cc53d560470 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:10.508913 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1ac07-b509-40b7-98ac-9cc53d560470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:10.529386 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-c7b1ac07-b509-40b7-98ac-9cc53d560470 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:10.530820 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-c7b1ac07-b509-40b7-98ac-9cc53d560470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:10.610697 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 32/63] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:10.648353 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc629945-4bde-4928-91a5-c6275b37f3e4 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:10.654373 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9210d-63e7-4b3f-ad7e-13b4aefe21c2 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:10.654664 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9210d-63e7-4b3f-ad7e-13b4aefe21c2 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:10.655143 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9210d-63e7-4b3f-ad7e-13b4aefe21c2 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:10.657008 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 33/64] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:50:10.662257 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b2aab-0e0e-4f59-b1ec-dc953f8a658c None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:10.662773 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b2aab-0e0e-4f59-b1ec-dc953f8a658c None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:10.663243 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b2aab-0e0e-4f59-b1ec-dc953f8a658c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:10.687049 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-f33b2aab-0e0e-4f59-b1ec-dc953f8a658c None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:10.688553 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-f33b2aab-0e0e-4f59-b1ec-dc953f8a658c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:10.782034 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc629945-4bde-4928-91a5-c6275b37f3e4 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:10.801339 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 34/65] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 02:50:10.803033 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff590d-ab18-4115-b9d3-a297d5e8a8a6 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:10.803527 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff590d-ab18-4115-b9d3-a297d5e8a8a6 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:10.804027 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff590d-ab18-4115-b9d3-a297d5e8a8a6 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:10.805699 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 35/66] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:10.811291 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9882809-e124-48b1-b83d-297807a46079 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:10.811792 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9882809-e124-48b1-b83d-297807a46079 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:10.812283 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9882809-e124-48b1-b83d-297807a46079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:10.823090 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa929db3-bb7a-4413-9c34-39a13cf48391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:10.825006 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa929db3-bb7a-4413-9c34-39a13cf48391 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:10.831265 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa929db3-bb7a-4413-9c34-39a13cf48391 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:10.831618 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa929db3-bb7a-4413-9c34-39a13cf48391 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:10.838095 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-f9882809-e124-48b1-b83d-297807a46079 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:10.839531 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-f9882809-e124-48b1-b83d-297807a46079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:10.846289 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa929db3-bb7a-4413-9c34-39a13cf48391 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:10.855388 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-aa929db3-bb7a-4413-9c34-39a13cf48391 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 02:50:10.857501 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 32/67] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:50:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:10.859075 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa929db3-bb7a-4413-9c34-39a13cf48391 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:10.926061 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 36/68] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 02:50:10.927295 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9882809-e124-48b1-b83d-297807a46079 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:10.990612 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa929db3-bb7a-4413-9c34-39a13cf48391 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:11.033383 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9882809-e124-48b1-b83d-297807a46079 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:11.033567 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831be9e-b67f-4e7a-a510-1dfea1d2f7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:11.034159 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831be9e-b67f-4e7a-a510-1dfea1d2f7bd None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:11.034441 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831be9e-b67f-4e7a-a510-1dfea1d2f7bd None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:11.034882 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831be9e-b67f-4e7a-a510-1dfea1d2f7bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:11.046539 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831be9e-b67f-4e7a-a510-1dfea1d2f7bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:11.053697 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-3831be9e-b67f-4e7a-a510-1dfea1d2f7bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 02:50:11.055065 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 33/69] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 02:50:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:11.055692 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831be9e-b67f-4e7a-a510-1dfea1d2f7bd None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:11.074756 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8e086-e5a7-40f4-b2ae-cf69421d7908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:11.075836 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8e086-e5a7-40f4-b2ae-cf69421d7908 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:11.076274 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8e086-e5a7-40f4-b2ae-cf69421d7908 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:11.077098 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8e086-e5a7-40f4-b2ae-cf69421d7908 None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:11.078590 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8e086-e5a7-40f4-b2ae-cf69421d7908 None admin] RBAC: Adding query filter params (name=member) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:11.079065 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8e086-e5a7-40f4-b2ae-cf69421d7908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:11.081348 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8e086-e5a7-40f4-b2ae-cf69421d7908 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:11.091898 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 37/70] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 02:50:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:11.092990 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b6ac9-3345-49ea-bbfe-fb218a51c7f0 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:11.093270 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b6ac9-3345-49ea-bbfe-fb218a51c7f0 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:11.093536 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b6ac9-3345-49ea-bbfe-fb218a51c7f0 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:11.094887 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 38/71] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:11.095427 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b6ac9-3345-49ea-bbfe-fb218a51c7f0 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:11.158767 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831be9e-b67f-4e7a-a510-1dfea1d2f7bd None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:11.190908 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f191f82-c51d-4381-955b-49d08fd72722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:11.191703 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f191f82-c51d-4381-955b-49d08fd72722 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:11.192011 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f191f82-c51d-4381-955b-49d08fd72722 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:11.192290 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f191f82-c51d-4381-955b-49d08fd72722 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:11.194204 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b6ac9-3345-49ea-bbfe-fb218a51c7f0 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:11.202110 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f191f82-c51d-4381-955b-49d08fd72722 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:11.209286 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-7f191f82-c51d-4381-955b-49d08fd72722 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 02:50:11.215196 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 34/72] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 02:50:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:11.215196 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f191f82-c51d-4381-955b-49d08fd72722 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:11.233183 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a4d25-db27-4ee2-bf9b-a43c9ad8c612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:11.233850 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a4d25-db27-4ee2-bf9b-a43c9ad8c612 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:11.234123 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a4d25-db27-4ee2-bf9b-a43c9ad8c612 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:11.234387 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a4d25-db27-4ee2-bf9b-a43c9ad8c612 None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:11.235129 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a4d25-db27-4ee2-bf9b-a43c9ad8c612 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:11.235432 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a4d25-db27-4ee2-bf9b-a43c9ad8c612 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:11.236845 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a4d25-db27-4ee2-bf9b-a43c9ad8c612 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:11.244596 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 39/73] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:50:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:11.245749 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56608ad-2106-434b-b5cb-f0ae11db8ec4 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:11.246029 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56608ad-2106-434b-b5cb-f0ae11db8ec4 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:11.246299 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56608ad-2106-434b-b5cb-f0ae11db8ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:11.262571 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-b56608ad-2106-434b-b5cb-f0ae11db8ec4 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:11.263797 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-b56608ad-2106-434b-b5cb-f0ae11db8ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:11.305615 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f191f82-c51d-4381-955b-49d08fd72722 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:11.331789 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 40/74] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:11.332666 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56608ad-2106-434b-b5cb-f0ae11db8ec4 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:11.340002 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588b56e-3286-4e6c-8380-a7aa3aef71cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:11.341164 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588b56e-3286-4e6c-8380-a7aa3aef71cb None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:11.341444 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588b56e-3286-4e6c-8380-a7aa3aef71cb None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:11.341700 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588b56e-3286-4e6c-8380-a7aa3aef71cb None admin] PATH_INFO: `/v3/users/7ec35991c252426ba394c75df977df0e` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:11.357333 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588b56e-3286-4e6c-8380-a7aa3aef71cb None admin] RBAC: Authorizing `identity:get_user(user_id=7ec35991c252426ba394c75df977df0e)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:11.358809 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588b56e-3286-4e6c-8380-a7aa3aef71cb None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:11.360555 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 35/75] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:50:11 2022] GET /identity/v3/users/7ec35991c252426ba394c75df977df0e => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:11.361806 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa14d2-03e8-4350-8150-59713f947949 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:11.362258 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa14d2-03e8-4350-8150-59713f947949 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:11.362362 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa14d2-03e8-4350-8150-59713f947949 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:11.363782 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 36/76] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:11.368217 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa14d2-03e8-4350-8150-59713f947949 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:11.431020 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56608ad-2106-434b-b5cb-f0ae11db8ec4 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:11.467816 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa14d2-03e8-4350-8150-59713f947949 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:11.469478 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6d34d-909d-4a77-b373-3ae74da074bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:11.470148 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6d34d-909d-4a77-b373-3ae74da074bc None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:11.470427 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6d34d-909d-4a77-b373-3ae74da074bc None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:11.470692 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6d34d-909d-4a77-b373-3ae74da074bc None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:11.471432 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6d34d-909d-4a77-b373-3ae74da074bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:11.471762 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6d34d-909d-4a77-b373-3ae74da074bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:11.473162 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6d34d-909d-4a77-b373-3ae74da074bc None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:11.481727 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 41/77] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:50:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:11.482534 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6d34d-909d-4a77-b373-3ae74da074bc None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:11.502251 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06625b60-9581-4474-b739-edcc5ddf5c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:11.503118 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06625b60-9581-4474-b739-edcc5ddf5c71 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:11.503397 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06625b60-9581-4474-b739-edcc5ddf5c71 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:11.503637 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06625b60-9581-4474-b739-edcc5ddf5c71 None admin] PATH_INFO: `/v3/users/7ec35991c252426ba394c75df977df0e` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:11.504854 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06625b60-9581-4474-b739-edcc5ddf5c71 None admin] RBAC: Authorizing `identity:get_user(user_id=7ec35991c252426ba394c75df977df0e)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:11.506420 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06625b60-9581-4474-b739-edcc5ddf5c71 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:11.508088 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 37/78] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:50:11 2022] GET /identity/v3/users/7ec35991c252426ba394c75df977df0e => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:11.508873 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06625b60-9581-4474-b739-edcc5ddf5c71 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:11.582772 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6d34d-909d-4a77-b373-3ae74da074bc None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:11.601960 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06625b60-9581-4474-b739-edcc5ddf5c71 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:11.616755 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a43d73-93b4-4c9b-82f4-75bfc8beed70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:11.617558 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a43d73-93b4-4c9b-82f4-75bfc8beed70 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:11.617820 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a43d73-93b4-4c9b-82f4-75bfc8beed70 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:11.618088 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a43d73-93b4-4c9b-82f4-75bfc8beed70 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:11.628562 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a43d73-93b4-4c9b-82f4-75bfc8beed70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:11.633241 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c711834-c583-44c4-a60e-a3b95830b291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:11.633877 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c711834-c583-44c4-a60e-a3b95830b291 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:11.634152 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c711834-c583-44c4-a60e-a3b95830b291 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:11.634421 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c711834-c583-44c4-a60e-a3b95830b291 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:11.635427 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-16a43d73-93b4-4c9b-82f4-75bfc8beed70 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 02:50:11.636663 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 42/79] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:50:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:11.637942 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93de54-675b-4675-ac5d-6c24d8257ab2 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:11.638223 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93de54-675b-4675-ac5d-6c24d8257ab2 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:11.638517 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93de54-675b-4675-ac5d-6c24d8257ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:11.654560 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-8c93de54-675b-4675-ac5d-6c24d8257ab2 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:11.655870 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-8c93de54-675b-4675-ac5d-6c24d8257ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:11.697373 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c711834-c583-44c4-a60e-a3b95830b291 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:11.698801 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c711834-c583-44c4-a60e-a3b95830b291 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:11.721153 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 43/80] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:11.722006 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93de54-675b-4675-ac5d-6c24d8257ab2 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:11.808600 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 38/81] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:50:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:50:11.809554 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c711834-c583-44c4-a60e-a3b95830b291 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:11.821025 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93de54-675b-4675-ac5d-6c24d8257ab2 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:11.856269 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2af37-8364-42e6-b0f2-ca75bb508e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:11.857110 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2af37-8364-42e6-b0f2-ca75bb508e2e None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:11.857408 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2af37-8364-42e6-b0f2-ca75bb508e2e None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:11.857681 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2af37-8364-42e6-b0f2-ca75bb508e2e None admin] PATH_INFO: `/v3/users/99e456857e814b9bb8e2717b9f3a9a8f` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:11.858904 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed2af37-8364-42e6-b0f2-ca75bb508e2e None admin] RBAC: Authorizing `identity:get_user(user_id=99e456857e814b9bb8e2717b9f3a9a8f)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:11.860453 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed2af37-8364-42e6-b0f2-ca75bb508e2e None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:11.862102 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 44/82] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:50:11 2022] GET /identity/v3/users/99e456857e814b9bb8e2717b9f3a9a8f => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:11.862894 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2af37-8364-42e6-b0f2-ca75bb508e2e None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:11.902620 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c711834-c583-44c4-a60e-a3b95830b291 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:11.935414 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88de145-f35d-449c-93f5-4a1ffeb6ffd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:11.936096 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88de145-f35d-449c-93f5-4a1ffeb6ffd0 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:11.936374 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88de145-f35d-449c-93f5-4a1ffeb6ffd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:11.936645 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88de145-f35d-449c-93f5-4a1ffeb6ffd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:11.955248 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2af37-8364-42e6-b0f2-ca75bb508e2e None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:11.987064 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444852e-0868-441b-9456-83548245c230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:11.987696 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444852e-0868-441b-9456-83548245c230 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:11.988008 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444852e-0868-441b-9456-83548245c230 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:11.988284 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444852e-0868-441b-9456-83548245c230 None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:11.989027 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444852e-0868-441b-9456-83548245c230 None admin] RBAC: Adding query filter params (name=member) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:11.989336 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444852e-0868-441b-9456-83548245c230 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:11.990707 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444852e-0868-441b-9456-83548245c230 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:11.998590 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 45/83] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 02:50:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:12.000495 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444852e-0868-441b-9456-83548245c230 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:12.000866 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88de145-f35d-449c-93f5-4a1ffeb6ffd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:12.002256 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88de145-f35d-449c-93f5-4a1ffeb6ffd0 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:12.091626 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444852e-0868-441b-9456-83548245c230 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:12.097581 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 39/84] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:50:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:50:12.098429 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88de145-f35d-449c-93f5-4a1ffeb6ffd0 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:12.124333 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fd5ba-f87a-47f7-99db-8c72ab672889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:12.125047 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fd5ba-f87a-47f7-99db-8c72ab672889 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:12.125323 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fd5ba-f87a-47f7-99db-8c72ab672889 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:12.125587 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fd5ba-f87a-47f7-99db-8c72ab672889 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:12.126805 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2fd5ba-f87a-47f7-99db-8c72ab672889 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:12.128394 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2fd5ba-f87a-47f7-99db-8c72ab672889 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:12.129997 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 46/85] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:50:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:12.130753 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fd5ba-f87a-47f7-99db-8c72ab672889 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:12.192462 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88de145-f35d-449c-93f5-4a1ffeb6ffd0 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:12.225429 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c2852-08bb-4e1e-8066-ebc148a0aef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:12.226286 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c2852-08bb-4e1e-8066-ebc148a0aef7 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:12.226378 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fd5ba-f87a-47f7-99db-8c72ab672889 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:12.226560 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c2852-08bb-4e1e-8066-ebc148a0aef7 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:12.226834 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c2852-08bb-4e1e-8066-ebc148a0aef7 None admin] PATH_INFO: `/v3/projects/3085add0984c4b339583bce0299f7cc3` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:12.228050 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c2852-08bb-4e1e-8066-ebc148a0aef7 None admin] RBAC: Authorizing `identity:get_project(project_id=3085add0984c4b339583bce0299f7cc3)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:12.229501 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c2852-08bb-4e1e-8066-ebc148a0aef7 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:12.231632 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 40/86] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:12 2022] GET /identity/v3/projects/3085add0984c4b339583bce0299f7cc3 => generated 298 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:12.232321 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c2852-08bb-4e1e-8066-ebc148a0aef7 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:12.259885 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ceff02-ea2c-4f40-b1dd-2b3578738706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:12.260530 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ceff02-ea2c-4f40-b1dd-2b3578738706 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:12.260799 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ceff02-ea2c-4f40-b1dd-2b3578738706 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:12.261074 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ceff02-ea2c-4f40-b1dd-2b3578738706 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:12.325879 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ceff02-ea2c-4f40-b1dd-2b3578738706 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:12.326095 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c2852-08bb-4e1e-8066-ebc148a0aef7 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:12.327354 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ceff02-ea2c-4f40-b1dd-2b3578738706 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:12.359510 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c425c17-cbf8-41c1-9a1e-6981d51e855c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:12.360377 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c425c17-cbf8-41c1-9a1e-6981d51e855c None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:12.360682 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c425c17-cbf8-41c1-9a1e-6981d51e855c None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:12.360945 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c425c17-cbf8-41c1-9a1e-6981d51e855c None admin] PATH_INFO: `/v3/users/7ec35991c252426ba394c75df977df0e` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:12.362145 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c425c17-cbf8-41c1-9a1e-6981d51e855c None admin] RBAC: Authorizing `identity:get_user(user_id=7ec35991c252426ba394c75df977df0e)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:12.363576 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c425c17-cbf8-41c1-9a1e-6981d51e855c None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:12.365224 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 41/87] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:50:12 2022] GET /identity/v3/users/7ec35991c252426ba394c75df977df0e => generated 275 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:12.365947 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c425c17-cbf8-41c1-9a1e-6981d51e855c None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:12.426026 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 47/88] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:50:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:50:12.426784 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ceff02-ea2c-4f40-b1dd-2b3578738706 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:12.461539 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c425c17-cbf8-41c1-9a1e-6981d51e855c None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:12.492363 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d0235-f487-4aa3-a78b-b95f5bb10e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:12.493209 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d0235-f487-4aa3-a78b-b95f5bb10e24 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:12.493483 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d0235-f487-4aa3-a78b-b95f5bb10e24 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:12.493751 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d0235-f487-4aa3-a78b-b95f5bb10e24 None admin] PATH_INFO: `/v3/projects/3085add0984c4b339583bce0299f7cc3` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:12.494924 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d0235-f487-4aa3-a78b-b95f5bb10e24 None admin] RBAC: Authorizing `identity:get_project(project_id=3085add0984c4b339583bce0299f7cc3)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:12.496404 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d0235-f487-4aa3-a78b-b95f5bb10e24 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:12.498232 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 42/89] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:12 2022] GET /identity/v3/projects/3085add0984c4b339583bce0299f7cc3 => generated 298 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:12.498988 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d0235-f487-4aa3-a78b-b95f5bb10e24 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:12.520110 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ceff02-ea2c-4f40-b1dd-2b3578738706 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:12.551348 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925b873-3a92-44d4-bfea-21ea803c2291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:12.552042 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925b873-3a92-44d4-bfea-21ea803c2291 None admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:12.552320 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925b873-3a92-44d4-bfea-21ea803c2291 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:12.552591 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925b873-3a92-44d4-bfea-21ea803c2291 None admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:12.553294 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925b873-3a92-44d4-bfea-21ea803c2291 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:12.554746 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925b873-3a92-44d4-bfea-21ea803c2291 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:12.575767 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 48/90] 10.222.0.32 () {60 vars in 1132 bytes} [Tue Apr 12 02:50:12 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 02:50:12.576577 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925b873-3a92-44d4-bfea-21ea803c2291 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:12.596179 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d0235-f487-4aa3-a78b-b95f5bb10e24 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:12.631412 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdfba3-e508-42dc-b065-2f9d268cb096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:12.632148 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdfba3-e508-42dc-b065-2f9d268cb096 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:12.632436 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdfba3-e508-42dc-b065-2f9d268cb096 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:12.632711 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdfba3-e508-42dc-b065-2f9d268cb096 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:12.633623 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bdfba3-e508-42dc-b065-2f9d268cb096 None admin] RBAC: Adding query filter params (role.id=0a31c1ce37fa41deb4908731f772414b, scope.project.id=3085add0984c4b339583bce0299f7cc3, user.id=7ec35991c252426ba394c75df977df0e) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:12.634033 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bdfba3-e508-42dc-b065-2f9d268cb096 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:12.635584 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bdfba3-e508-42dc-b065-2f9d268cb096 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:12.644973 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 43/91] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:50:12 2022] GET /identity/v3/role_assignments?user.id=7ec35991c252426ba394c75df977df0e&scope.project.id=3085add0984c4b339583bce0299f7cc3&role.id=0a31c1ce37fa41deb4908731f772414b => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:12.647762 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdfba3-e508-42dc-b065-2f9d268cb096 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:12.685707 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925b873-3a92-44d4-bfea-21ea803c2291 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:12.724951 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df34b6-a0de-4dc6-bc58-74ba087adb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:12.725205 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df34b6-a0de-4dc6-bc58-74ba087adb27 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:12.725500 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df34b6-a0de-4dc6-bc58-74ba087adb27 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:12.725768 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df34b6-a0de-4dc6-bc58-74ba087adb27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:12.765423 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdfba3-e508-42dc-b065-2f9d268cb096 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:12.800399 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df34b6-a0de-4dc6-bc58-74ba087adb27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:12.801759 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df34b6-a0de-4dc6-bc58-74ba087adb27 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:12.803799 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b3d5a-bf1b-4a65-8004-2d833aaa2897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:12.805128 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b3d5a-bf1b-4a65-8004-2d833aaa2897 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:12.805128 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b3d5a-bf1b-4a65-8004-2d833aaa2897 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:12.805128 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b3d5a-bf1b-4a65-8004-2d833aaa2897 None admin] PATH_INFO: `/v3/projects/3085add0984c4b339583bce0299f7cc3` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:12.813628 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b3d5a-bf1b-4a65-8004-2d833aaa2897 None admin] RBAC: Authorizing `identity:get_project(project_id=3085add0984c4b339583bce0299f7cc3)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:12.813628 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b3d5a-bf1b-4a65-8004-2d833aaa2897 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:12.813628 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 44/92] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:12 2022] GET /identity/v3/projects/3085add0984c4b339583bce0299f7cc3 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:12.813628 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b3d5a-bf1b-4a65-8004-2d833aaa2897 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:12.908385 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 49/93] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:50:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:50:12.909605 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df34b6-a0de-4dc6-bc58-74ba087adb27 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:12.945797 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b3d5a-bf1b-4a65-8004-2d833aaa2897 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:12.980855 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c24a1b-b223-40b8-98e1-82850ac8967d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:12.982273 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c24a1b-b223-40b8-98e1-82850ac8967d None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:12.982756 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c24a1b-b223-40b8-98e1-82850ac8967d None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:12.983304 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c24a1b-b223-40b8-98e1-82850ac8967d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:12.984444 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c24a1b-b223-40b8-98e1-82850ac8967d None admin] RBAC: Adding query filter params (role.id=60b6ad9d4f6d40b4a37fb5045c7f4523, scope.project.id=3085add0984c4b339583bce0299f7cc3, user.id=7ec35991c252426ba394c75df977df0e) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:12.984948 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c24a1b-b223-40b8-98e1-82850ac8967d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:12.986597 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c24a1b-b223-40b8-98e1-82850ac8967d None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:12.993086 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 45/94] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:50:12 2022] GET /identity/v3/role_assignments?user.id=7ec35991c252426ba394c75df977df0e&scope.project.id=3085add0984c4b339583bce0299f7cc3&role.id=60b6ad9d4f6d40b4a37fb5045c7f4523 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:12.994305 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c24a1b-b223-40b8-98e1-82850ac8967d None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:13.041057 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df34b6-a0de-4dc6-bc58-74ba087adb27 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:13.085055 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc629c66-5d21-4bc4-bd52-57c883d19908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:13.085793 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc629c66-5d21-4bc4-bd52-57c883d19908 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:13.086074 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc629c66-5d21-4bc4-bd52-57c883d19908 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:13.086364 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc629c66-5d21-4bc4-bd52-57c883d19908 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:13.087202 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc629c66-5d21-4bc4-bd52-57c883d19908 None admin] RBAC: Adding query filter params (role.id=c0f19d3800f44637822d5162ffe4b497, scope.project.id=3085add0984c4b339583bce0299f7cc3, user.id=99e456857e814b9bb8e2717b9f3a9a8f) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:13.087509 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc629c66-5d21-4bc4-bd52-57c883d19908 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:13.089030 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc629c66-5d21-4bc4-bd52-57c883d19908 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:13.096666 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 50/95] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:50:12 2022] GET /identity/v3/role_assignments?user.id=99e456857e814b9bb8e2717b9f3a9a8f&scope.project.id=3085add0984c4b339583bce0299f7cc3&role.id=c0f19d3800f44637822d5162ffe4b497 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:13.154488 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c24a1b-b223-40b8-98e1-82850ac8967d None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:13.204591 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cfc5f5-016f-4575-a8b6-0ab8e87cefc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:13.205475 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfc5f5-016f-4575-a8b6-0ab8e87cefc1 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:13.205751 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfc5f5-016f-4575-a8b6-0ab8e87cefc1 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:13.206018 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfc5f5-016f-4575-a8b6-0ab8e87cefc1 None admin] PATH_INFO: `/v3/projects/d06784617c94405181344d7eebab0c3e` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:13.212767 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cfc5f5-016f-4575-a8b6-0ab8e87cefc1 None admin] RBAC: Authorizing `identity:get_project(project_id=d06784617c94405181344d7eebab0c3e)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:13.214271 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cfc5f5-016f-4575-a8b6-0ab8e87cefc1 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:13.216645 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 46/96] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:12 2022] GET /identity/v3/projects/d06784617c94405181344d7eebab0c3e => generated 312 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:13.223299 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc629c66-5d21-4bc4-bd52-57c883d19908 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:13.397055 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc629c66-5d21-4bc4-bd52-57c883d19908 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:13.430903 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce856cb-7073-43cf-b490-d69129ca8ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:13.431567 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce856cb-7073-43cf-b490-d69129ca8ca6 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:13.431881 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce856cb-7073-43cf-b490-d69129ca8ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:13.432152 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce856cb-7073-43cf-b490-d69129ca8ca6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:13.432987 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce856cb-7073-43cf-b490-d69129ca8ca6 None admin] RBAC: Adding query filter params (role.id=0a31c1ce37fa41deb4908731f772414b, scope.project.id=d06784617c94405181344d7eebab0c3e, user.id=7ec35991c252426ba394c75df977df0e) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:13.433296 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce856cb-7073-43cf-b490-d69129ca8ca6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:13.434851 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce856cb-7073-43cf-b490-d69129ca8ca6 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:13.440698 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 51/97] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:50:13 2022] GET /identity/v3/role_assignments?user.id=7ec35991c252426ba394c75df977df0e&scope.project.id=d06784617c94405181344d7eebab0c3e&role.id=0a31c1ce37fa41deb4908731f772414b => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:15.657349 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b2598-c05c-4b99-8da5-6b4d3b2b12e0 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:15.658319 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b2598-c05c-4b99-8da5-6b4d3b2b12e0 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:15.658785 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b2598-c05c-4b99-8da5-6b4d3b2b12e0 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:15.660386 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 47/98] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:15.665881 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3114c2-a5ca-4eb1-8801-cd18c7417c31 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:15.666716 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3114c2-a5ca-4eb1-8801-cd18c7417c31 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:15.667186 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3114c2-a5ca-4eb1-8801-cd18c7417c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:15.685015 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-7c3114c2-a5ca-4eb1-8801-cd18c7417c31 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:15.686562 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-7c3114c2-a5ca-4eb1-8801-cd18c7417c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:15.752898 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 52/99] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:15.777243 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b2598-c05c-4b99-8da5-6b4d3b2b12e0 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:15.883422 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b2598-c05c-4b99-8da5-6b4d3b2b12e0 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:15.916799 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847aecf-7698-49d2-bfd3-84e85dcf840c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:15.917947 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847aecf-7698-49d2-bfd3-84e85dcf840c None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:15.918618 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847aecf-7698-49d2-bfd3-84e85dcf840c None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:15.919075 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847aecf-7698-49d2-bfd3-84e85dcf840c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:15.929530 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847aecf-7698-49d2-bfd3-84e85dcf840c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:15.936964 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-0847aecf-7698-49d2-bfd3-84e85dcf840c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 12 02:50:15.938433 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 48/100] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:50:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:15.944395 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3114c2-a5ca-4eb1-8801-cd18c7417c31 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:15.982726 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921f7de-53e7-414c-aa1a-b81bcceb021f None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:15.983051 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921f7de-53e7-414c-aa1a-b81bcceb021f None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:15.983277 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921f7de-53e7-414c-aa1a-b81bcceb021f None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:15.984696 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 49/101] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:50:15.989684 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e15d3-3bf6-4f85-bf87-2d49ed0c43fd None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:15.989972 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e15d3-3bf6-4f85-bf87-2d49ed0c43fd None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:15.990307 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e15d3-3bf6-4f85-bf87-2d49ed0c43fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:16.036906 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-5f7e15d3-3bf6-4f85-bf87-2d49ed0c43fd None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:16.038160 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-5f7e15d3-3bf6-4f85-bf87-2d49ed0c43fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:16.049241 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3114c2-a5ca-4eb1-8801-cd18c7417c31 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:16.090483 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aec0ca-08be-4971-a806-3c4688b1d5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:16.092103 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aec0ca-08be-4971-a806-3c4688b1d5c8 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:16.093251 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aec0ca-08be-4971-a806-3c4688b1d5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:16.093251 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aec0ca-08be-4971-a806-3c4688b1d5c8 None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:16.094439 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aec0ca-08be-4971-a806-3c4688b1d5c8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:16.094951 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aec0ca-08be-4971-a806-3c4688b1d5c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:16.096883 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aec0ca-08be-4971-a806-3c4688b1d5c8 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:16.107109 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 53/102] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 02:50:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:16.113132 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aec0ca-08be-4971-a806-3c4688b1d5c8 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:16.217159 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 50/103] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Apr 12 02:50:16.219107 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aec0ca-08be-4971-a806-3c4688b1d5c8 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:16.230357 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3146cea-facd-4654-bebc-403c1f4451ea None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:16.230758 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3146cea-facd-4654-bebc-403c1f4451ea None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:16.231307 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3146cea-facd-4654-bebc-403c1f4451ea None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:16.232816 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 51/104] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:50:16.238040 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5483833-acfd-4940-b64a-e597ad976703 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:16.238399 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5483833-acfd-4940-b64a-e597ad976703 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:16.238747 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5483833-acfd-4940-b64a-e597ad976703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:16.255613 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f707788-d62a-4143-8a16-3752dbd912f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:16.256851 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f707788-d62a-4143-8a16-3752dbd912f7 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:16.257304 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f707788-d62a-4143-8a16-3752dbd912f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:16.257747 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f707788-d62a-4143-8a16-3752dbd912f7 None admin] PATH_INFO: `/v3/users/6dca511a232e4bd0af0e569bb164c76c` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:16.273250 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-a5483833-acfd-4940-b64a-e597ad976703 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:16.274365 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f707788-d62a-4143-8a16-3752dbd912f7 None admin] RBAC: Authorizing `identity:get_user(user_id=6dca511a232e4bd0af0e569bb164c76c)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:16.274750 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-a5483833-acfd-4940-b64a-e597ad976703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:16.275800 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f707788-d62a-4143-8a16-3752dbd912f7 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:16.278220 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 54/105] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:50:16 2022] GET /identity/v3/users/6dca511a232e4bd0af0e569bb164c76c => generated 289 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:16.280226 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f707788-d62a-4143-8a16-3752dbd912f7 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:16.393769 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f707788-d62a-4143-8a16-3752dbd912f7 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:16.436310 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14d745-db1e-4020-b8d3-e28a72feba10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:16.437484 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14d745-db1e-4020-b8d3-e28a72feba10 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:16.438047 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14d745-db1e-4020-b8d3-e28a72feba10 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:16.438493 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14d745-db1e-4020-b8d3-e28a72feba10 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:16.440671 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 52/106] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 02:50:16.441473 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5483833-acfd-4940-b64a-e597ad976703 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:16.450166 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14d745-db1e-4020-b8d3-e28a72feba10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:16.459105 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-ba14d745-db1e-4020-b8d3-e28a72feba10 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 02:50:16.460644 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 55/107] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:50:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:16.469161 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14d745-db1e-4020-b8d3-e28a72feba10 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:16.586926 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14d745-db1e-4020-b8d3-e28a72feba10 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:16.626151 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7b2f1-da84-4700-a46b-fe2bc11e09db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:16.627228 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7b2f1-da84-4700-a46b-fe2bc11e09db None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:16.627680 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7b2f1-da84-4700-a46b-fe2bc11e09db None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:16.628482 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7b2f1-da84-4700-a46b-fe2bc11e09db None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:16.629662 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba7b2f1-da84-4700-a46b-fe2bc11e09db None admin] RBAC: Adding query filter params (name=member) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:16.630495 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba7b2f1-da84-4700-a46b-fe2bc11e09db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:16.633137 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba7b2f1-da84-4700-a46b-fe2bc11e09db None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:16.645766 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 56/108] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 02:50:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:16.646821 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7b2f1-da84-4700-a46b-fe2bc11e09db None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:16.650881 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5483833-acfd-4940-b64a-e597ad976703 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:16.690714 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12154449-4c83-4260-9062-d3bd3d90e283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:16.692191 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12154449-4c83-4260-9062-d3bd3d90e283 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:16.692709 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12154449-4c83-4260-9062-d3bd3d90e283 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:16.693248 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12154449-4c83-4260-9062-d3bd3d90e283 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:16.751977 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7b2f1-da84-4700-a46b-fe2bc11e09db None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:16.765953 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12154449-4c83-4260-9062-d3bd3d90e283 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:16.767572 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12154449-4c83-4260-9062-d3bd3d90e283 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:16.786292 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d136f-9e44-4e39-8abe-a104d98e95ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:16.787097 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d136f-9e44-4e39-8abe-a104d98e95ad None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:16.787376 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d136f-9e44-4e39-8abe-a104d98e95ad None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:16.787650 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d136f-9e44-4e39-8abe-a104d98e95ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:16.798227 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d136f-9e44-4e39-8abe-a104d98e95ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:16.805218 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-376d136f-9e44-4e39-8abe-a104d98e95ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 02:50:16.806449 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 57/109] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 02:50:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:16.807809 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac5563-0203-4721-84dd-29f1d95898a0 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:16.808096 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac5563-0203-4721-84dd-29f1d95898a0 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:16.808370 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac5563-0203-4721-84dd-29f1d95898a0 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:16.809887 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 58/110] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:16.814179 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac5563-0203-4721-84dd-29f1d95898a0 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:16.875806 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 53/111] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:50:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:50:16.877122 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12154449-4c83-4260-9062-d3bd3d90e283 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:16.914066 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac5563-0203-4721-84dd-29f1d95898a0 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:16.945968 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6818b3a5-2e15-418f-ab92-b53a0c130b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:16.946849 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818b3a5-2e15-418f-ab92-b53a0c130b50 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:16.947125 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818b3a5-2e15-418f-ab92-b53a0c130b50 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:16.947394 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818b3a5-2e15-418f-ab92-b53a0c130b50 None admin] PATH_INFO: `/v3/users/7ec35991c252426ba394c75df977df0e` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:16.948587 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6818b3a5-2e15-418f-ab92-b53a0c130b50 None admin] RBAC: Authorizing `identity:get_user(user_id=7ec35991c252426ba394c75df977df0e)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:16.950119 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6818b3a5-2e15-418f-ab92-b53a0c130b50 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:16.951801 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 59/112] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:50:16 2022] GET /identity/v3/users/7ec35991c252426ba394c75df977df0e => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:16.957693 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b92f5e-f70d-4e26-91ef-7f49e9b7ef7c None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:16.957978 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b92f5e-f70d-4e26-91ef-7f49e9b7ef7c None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:16.958251 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b92f5e-f70d-4e26-91ef-7f49e9b7ef7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:16.974142 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-d5b92f5e-f70d-4e26-91ef-7f49e9b7ef7c None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:16.974826 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12154449-4c83-4260-9062-d3bd3d90e283 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:16.975317 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-d5b92f5e-f70d-4e26-91ef-7f49e9b7ef7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:17.012488 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c9df7-f290-44a1-839e-ee762f444b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:17.013087 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c9df7-f290-44a1-839e-ee762f444b0d None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:17.013367 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c9df7-f290-44a1-839e-ee762f444b0d None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:17.013646 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c9df7-f290-44a1-839e-ee762f444b0d None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:17.014398 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c9df7-f290-44a1-839e-ee762f444b0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:17.014700 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c9df7-f290-44a1-839e-ee762f444b0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:17.016113 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c9df7-f290-44a1-839e-ee762f444b0d None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:17.024795 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 54/113] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:50:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:17.026107 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b467d15-8b01-4091-bf82-298219d15544 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:17.026398 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b467d15-8b01-4091-bf82-298219d15544 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:17.026665 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b467d15-8b01-4091-bf82-298219d15544 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:17.031785 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 55/114] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:17.031785 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b467d15-8b01-4091-bf82-298219d15544 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:17.046594 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 60/115] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:17.047452 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b92f5e-f70d-4e26-91ef-7f49e9b7ef7c None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:17.143360 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b92f5e-f70d-4e26-91ef-7f49e9b7ef7c None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:17.143691 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b467d15-8b01-4091-bf82-298219d15544 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:17.175225 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ccbe5-0bd1-41f7-8b77-251c32996963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:17.176152 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ccbe5-0bd1-41f7-8b77-251c32996963 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:17.176319 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6bcc00-e727-4db0-ab12-dbb76d49e665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:17.176422 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ccbe5-0bd1-41f7-8b77-251c32996963 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:17.176673 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ccbe5-0bd1-41f7-8b77-251c32996963 None admin] PATH_INFO: `/v3/projects/3085add0984c4b339583bce0299f7cc3` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:17.177175 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6bcc00-e727-4db0-ab12-dbb76d49e665 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:17.177456 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6bcc00-e727-4db0-ab12-dbb76d49e665 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:17.177732 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6bcc00-e727-4db0-ab12-dbb76d49e665 None admin] PATH_INFO: `/v3/projects/3085add0984c4b339583bce0299f7cc3` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:17.177830 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ccbe5-0bd1-41f7-8b77-251c32996963 None admin] RBAC: Authorizing `identity:get_project(project_id=3085add0984c4b339583bce0299f7cc3)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:17.178890 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6bcc00-e727-4db0-ab12-dbb76d49e665 None admin] RBAC: Authorizing `identity:get_project(project_id=3085add0984c4b339583bce0299f7cc3)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:17.179295 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ccbe5-0bd1-41f7-8b77-251c32996963 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:17.180378 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6bcc00-e727-4db0-ab12-dbb76d49e665 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:17.181036 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 61/116] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:17 2022] GET /identity/v3/projects/3085add0984c4b339583bce0299f7cc3 => generated 298 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:17.181795 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ccbe5-0bd1-41f7-8b77-251c32996963 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:17.182217 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 56/117] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:17 2022] GET /identity/v3/projects/3085add0984c4b339583bce0299f7cc3 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:17.188275 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3cf01-613c-447e-a0ef-b4baed11295a None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:17.188561 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3cf01-613c-447e-a0ef-b4baed11295a None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:17.188842 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3cf01-613c-447e-a0ef-b4baed11295a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:17.205316 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-10f3cf01-613c-447e-a0ef-b4baed11295a None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:17.206533 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-10f3cf01-613c-447e-a0ef-b4baed11295a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:17.270973 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 57/118] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:17.271991 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3cf01-613c-447e-a0ef-b4baed11295a None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:17.273935 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ccbe5-0bd1-41f7-8b77-251c32996963 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:17.307106 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3bedb1-9cb4-4397-99e9-c5f171881ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:17.308008 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bedb1-9cb4-4397-99e9-c5f171881ba6 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:17.308281 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bedb1-9cb4-4397-99e9-c5f171881ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:17.308543 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bedb1-9cb4-4397-99e9-c5f171881ba6 None admin] PATH_INFO: `/v3/users/99e456857e814b9bb8e2717b9f3a9a8f` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:17.310300 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3bedb1-9cb4-4397-99e9-c5f171881ba6 None admin] RBAC: Authorizing `identity:get_user(user_id=99e456857e814b9bb8e2717b9f3a9a8f)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:17.312189 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3bedb1-9cb4-4397-99e9-c5f171881ba6 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:17.314034 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 62/119] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:50:17 2022] GET /identity/v3/users/99e456857e814b9bb8e2717b9f3a9a8f => generated 247 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:17.315086 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea7d7a-1e49-4325-b38f-66d7e995ade6 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:17.315367 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea7d7a-1e49-4325-b38f-66d7e995ade6 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:17.315637 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea7d7a-1e49-4325-b38f-66d7e995ade6 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:17.316868 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 63/120] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:17.318808 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea7d7a-1e49-4325-b38f-66d7e995ade6 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:17.371237 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3cf01-613c-447e-a0ef-b4baed11295a None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:17.405502 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977b337-cef6-4499-a908-a50b1dd394bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:17.406324 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977b337-cef6-4499-a908-a50b1dd394bb None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:17.406594 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977b337-cef6-4499-a908-a50b1dd394bb None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:17.406863 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977b337-cef6-4499-a908-a50b1dd394bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:17.408069 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977b337-cef6-4499-a908-a50b1dd394bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:17.409504 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977b337-cef6-4499-a908-a50b1dd394bb None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:17.411120 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 58/121] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:50:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:17.412551 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977b337-cef6-4499-a908-a50b1dd394bb None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:17.424694 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea7d7a-1e49-4325-b38f-66d7e995ade6 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:17.456328 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3b90b-4bbe-4d5f-84ed-d5ac9a488855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:17.457234 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3b90b-4bbe-4d5f-84ed-d5ac9a488855 None admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:17.457505 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3b90b-4bbe-4d5f-84ed-d5ac9a488855 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:17.457772 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3b90b-4bbe-4d5f-84ed-d5ac9a488855 None admin] PATH_INFO: `/v3/projects/3085add0984c4b339583bce0299f7cc3/users/7ec35991c252426ba394c75df977df0e/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:17.459825 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3b90b-4bbe-4d5f-84ed-d5ac9a488855 None admin] RBAC: Authorizing `identity:create_grant(project_id=3085add0984c4b339583bce0299f7cc3, user_id=7ec35991c252426ba394c75df977df0e, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:17.461293 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3b90b-4bbe-4d5f-84ed-d5ac9a488855 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:17.473999 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 64/122] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 02:50:17 2022] PUT /identity/v3/projects/3085add0984c4b339583bce0299f7cc3/users/7ec35991c252426ba394c75df977df0e/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 02:50:17.474786 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3b90b-4bbe-4d5f-84ed-d5ac9a488855 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:17.509626 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977b337-cef6-4499-a908-a50b1dd394bb None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:17.547246 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025bea5-0870-4109-a9a9-89a9b651abd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:17.548197 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025bea5-0870-4109-a9a9-89a9b651abd3 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:17.548660 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025bea5-0870-4109-a9a9-89a9b651abd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:17.549130 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025bea5-0870-4109-a9a9-89a9b651abd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:17.549981 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025bea5-0870-4109-a9a9-89a9b651abd3 None admin] RBAC: Adding query filter params (role.id=33cab6a3207a4cd69442cac65e246a23, scope.project.id=3085add0984c4b339583bce0299f7cc3, user.id=6dca511a232e4bd0af0e569bb164c76c) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:17.550304 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025bea5-0870-4109-a9a9-89a9b651abd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:17.551804 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025bea5-0870-4109-a9a9-89a9b651abd3 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:17.567754 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 59/123] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:50:17 2022] GET /identity/v3/role_assignments?user.id=6dca511a232e4bd0af0e569bb164c76c&scope.project.id=3085add0984c4b339583bce0299f7cc3&role.id=33cab6a3207a4cd69442cac65e246a23 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:17.567754 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025bea5-0870-4109-a9a9-89a9b651abd3 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:17.598825 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3b90b-4bbe-4d5f-84ed-d5ac9a488855 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:17.636108 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab2d0f-9309-4be7-a8a4-c77579c9d5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:17.639366 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab2d0f-9309-4be7-a8a4-c77579c9d5e5 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:17.639774 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab2d0f-9309-4be7-a8a4-c77579c9d5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:17.640062 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab2d0f-9309-4be7-a8a4-c77579c9d5e5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:17.653881 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab2d0f-9309-4be7-a8a4-c77579c9d5e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:17.661721 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-b0ab2d0f-9309-4be7-a8a4-c77579c9d5e5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 02:50:17.663241 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 65/124] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 02:50:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:17.664438 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54baf9ef-0739-41df-859d-c8090b8e21fd None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:17.664767 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54baf9ef-0739-41df-859d-c8090b8e21fd None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:17.665045 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54baf9ef-0739-41df-859d-c8090b8e21fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:17.683740 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-54baf9ef-0739-41df-859d-c8090b8e21fd None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:17.685173 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-54baf9ef-0739-41df-859d-c8090b8e21fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:17.685281 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025bea5-0870-4109-a9a9-89a9b651abd3 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:17.721305 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fe1f3-8e3d-45da-b3df-96fd73d6ff19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:17.722189 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fe1f3-8e3d-45da-b3df-96fd73d6ff19 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:17.722472 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fe1f3-8e3d-45da-b3df-96fd73d6ff19 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:17.722745 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fe1f3-8e3d-45da-b3df-96fd73d6ff19 None admin] PATH_INFO: `/v3/projects/3085add0984c4b339583bce0299f7cc3` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:17.728627 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fe1f3-8e3d-45da-b3df-96fd73d6ff19 None admin] RBAC: Authorizing `identity:get_project(project_id=3085add0984c4b339583bce0299f7cc3)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:17.730119 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fe1f3-8e3d-45da-b3df-96fd73d6ff19 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:17.732266 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 60/125] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:17 2022] GET /identity/v3/projects/3085add0984c4b339583bce0299f7cc3 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:17.733109 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fe1f3-8e3d-45da-b3df-96fd73d6ff19 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:17.759398 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 66/126] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:17.761083 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54baf9ef-0739-41df-859d-c8090b8e21fd None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:17.852124 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fe1f3-8e3d-45da-b3df-96fd73d6ff19 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:17.874787 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54baf9ef-0739-41df-859d-c8090b8e21fd None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:17.889703 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31091e9b-16b3-4344-bf29-592ca290d615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:17.890574 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31091e9b-16b3-4344-bf29-592ca290d615 None admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:17.890863 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31091e9b-16b3-4344-bf29-592ca290d615 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:17.891146 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31091e9b-16b3-4344-bf29-592ca290d615 None admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:17.892503 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31091e9b-16b3-4344-bf29-592ca290d615 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:17.894147 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31091e9b-16b3-4344-bf29-592ca290d615 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:17.912418 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded9c0c-6019-4700-a1d4-1d4937479234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:17.913243 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded9c0c-6019-4700-a1d4-1d4937479234 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:17.913625 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded9c0c-6019-4700-a1d4-1d4937479234 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:17.913820 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded9c0c-6019-4700-a1d4-1d4937479234 None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:17.914608 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded9c0c-6019-4700-a1d4-1d4937479234 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:17.914916 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded9c0c-6019-4700-a1d4-1d4937479234 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:17.916486 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded9c0c-6019-4700-a1d4-1d4937479234 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:17.925512 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 67/127] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:50:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:17.926364 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded9c0c-6019-4700-a1d4-1d4937479234 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:17.928808 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 61/128] 10.222.0.32 () {60 vars in 1141 bytes} [Tue Apr 12 02:50:17 2022] POST /identity/v3/projects => generated 302 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 02:50:17.930992 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31091e9b-16b3-4344-bf29-592ca290d615 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:18.066355 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31091e9b-16b3-4344-bf29-592ca290d615 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:18.103075 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66708c6-274e-491d-864c-1ab527967402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:18.103851 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66708c6-274e-491d-864c-1ab527967402 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:18.104134 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66708c6-274e-491d-864c-1ab527967402 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:18.104411 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66708c6-274e-491d-864c-1ab527967402 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:18.116069 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66708c6-274e-491d-864c-1ab527967402 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:18.123339 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-e66708c6-274e-491d-864c-1ab527967402 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 02:50:18.124635 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 62/129] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:50:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:18.125427 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66708c6-274e-491d-864c-1ab527967402 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:18.139195 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded9c0c-6019-4700-a1d4-1d4937479234 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:18.185313 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bead415-83d4-41e7-bdc6-5e22f6da6ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:18.186549 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bead415-83d4-41e7-bdc6-5e22f6da6ce2 None admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:18.186958 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bead415-83d4-41e7-bdc6-5e22f6da6ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:18.187361 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bead415-83d4-41e7-bdc6-5e22f6da6ce2 None admin] PATH_INFO: `/v3/projects/3085add0984c4b339583bce0299f7cc3/users/99e456857e814b9bb8e2717b9f3a9a8f/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:18.190317 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bead415-83d4-41e7-bdc6-5e22f6da6ce2 None admin] RBAC: Authorizing `identity:create_grant(project_id=3085add0984c4b339583bce0299f7cc3, user_id=99e456857e814b9bb8e2717b9f3a9a8f, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:18.192406 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bead415-83d4-41e7-bdc6-5e22f6da6ce2 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:18.210383 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 68/130] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 02:50:17 2022] PUT /identity/v3/projects/3085add0984c4b339583bce0299f7cc3/users/99e456857e814b9bb8e2717b9f3a9a8f/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 02:50:18.211618 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bead415-83d4-41e7-bdc6-5e22f6da6ce2 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:18.259956 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66708c6-274e-491d-864c-1ab527967402 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:18.329929 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b548ae-8e29-493c-bebf-e0647ab41984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:18.332356 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b548ae-8e29-493c-bebf-e0647ab41984 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:18.332638 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b548ae-8e29-493c-bebf-e0647ab41984 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:18.332917 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b548ae-8e29-493c-bebf-e0647ab41984 None admin] PATH_INFO: `/v3/users/7ec35991c252426ba394c75df977df0e` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:18.335818 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b548ae-8e29-493c-bebf-e0647ab41984 None admin] RBAC: Authorizing `identity:get_user(user_id=7ec35991c252426ba394c75df977df0e)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:18.337415 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b548ae-8e29-493c-bebf-e0647ab41984 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:18.342621 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 63/131] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:50:18 2022] GET /identity/v3/users/7ec35991c252426ba394c75df977df0e => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:18.350389 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b548ae-8e29-493c-bebf-e0647ab41984 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:18.394803 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bead415-83d4-41e7-bdc6-5e22f6da6ce2 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:18.431687 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5e409-d695-4b48-a458-2db2b28148fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:18.432720 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5e409-d695-4b48-a458-2db2b28148fc None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:18.433142 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5e409-d695-4b48-a458-2db2b28148fc None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:18.433553 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5e409-d695-4b48-a458-2db2b28148fc None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:18.434568 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d5e409-d695-4b48-a458-2db2b28148fc None admin] RBAC: Adding query filter params (name=member) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:18.435019 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d5e409-d695-4b48-a458-2db2b28148fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:18.436647 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d5e409-d695-4b48-a458-2db2b28148fc None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:18.445942 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 69/132] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 02:50:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:18.453594 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5e409-d695-4b48-a458-2db2b28148fc None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:18.581134 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5e409-d695-4b48-a458-2db2b28148fc None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:18.606024 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b548ae-8e29-493c-bebf-e0647ab41984 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:18.629518 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943ea3b-3b37-412e-bd19-8c39e40cdc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:18.630411 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943ea3b-3b37-412e-bd19-8c39e40cdc46 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:18.630690 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943ea3b-3b37-412e-bd19-8c39e40cdc46 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:18.630958 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943ea3b-3b37-412e-bd19-8c39e40cdc46 None admin] PATH_INFO: `/v3/users/7ec35991c252426ba394c75df977df0e` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:18.633689 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943ea3b-3b37-412e-bd19-8c39e40cdc46 None admin] RBAC: Authorizing `identity:get_user(user_id=7ec35991c252426ba394c75df977df0e)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:18.638190 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943ea3b-3b37-412e-bd19-8c39e40cdc46 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:18.642520 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 70/133] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:50:18 2022] GET /identity/v3/users/7ec35991c252426ba394c75df977df0e => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:50:18.648182 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943ea3b-3b37-412e-bd19-8c39e40cdc46 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:18.678128 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1e737-9005-4e32-b754-868bb2cc1d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:18.679007 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1e737-9005-4e32-b754-868bb2cc1d4b None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:18.680936 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1e737-9005-4e32-b754-868bb2cc1d4b None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:18.681214 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1e737-9005-4e32-b754-868bb2cc1d4b None admin] PATH_INFO: `/v3/projects/3085add0984c4b339583bce0299f7cc3` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:18.684015 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca1e737-9005-4e32-b754-868bb2cc1d4b None admin] RBAC: Authorizing `identity:get_project(project_id=3085add0984c4b339583bce0299f7cc3)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:18.687491 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca1e737-9005-4e32-b754-868bb2cc1d4b None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:18.693092 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 64/134] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:18 2022] GET /identity/v3/projects/3085add0984c4b339583bce0299f7cc3 => generated 298 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:18.717575 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1e737-9005-4e32-b754-868bb2cc1d4b None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:18.801799 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943ea3b-3b37-412e-bd19-8c39e40cdc46 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:18.848468 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7842ed-d453-4212-811c-57cf66b301c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:18.849381 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7842ed-d453-4212-811c-57cf66b301c9 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:18.849661 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7842ed-d453-4212-811c-57cf66b301c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:18.849927 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7842ed-d453-4212-811c-57cf66b301c9 None admin] PATH_INFO: `/v3/projects/d06784617c94405181344d7eebab0c3e` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:18.851139 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7842ed-d453-4212-811c-57cf66b301c9 None admin] RBAC: Authorizing `identity:get_project(project_id=d06784617c94405181344d7eebab0c3e)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:18.852640 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7842ed-d453-4212-811c-57cf66b301c9 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:18.854464 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 71/135] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:18 2022] GET /identity/v3/projects/d06784617c94405181344d7eebab0c3e => generated 312 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:50:18.864286 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1e737-9005-4e32-b754-868bb2cc1d4b None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:18.876599 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7842ed-d453-4212-811c-57cf66b301c9 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:18.907407 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b667821-81cf-4dca-8928-49cfc2b12684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:18.908288 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b667821-81cf-4dca-8928-49cfc2b12684 None admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:18.908563 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b667821-81cf-4dca-8928-49cfc2b12684 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:18.908833 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b667821-81cf-4dca-8928-49cfc2b12684 None admin] PATH_INFO: `/v3/projects/3085add0984c4b339583bce0299f7cc3/users/7ec35991c252426ba394c75df977df0e/roles/60b6ad9d4f6d40b4a37fb5045c7f4523` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:18.913284 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b667821-81cf-4dca-8928-49cfc2b12684 None admin] RBAC: Authorizing `identity:create_grant(project_id=3085add0984c4b339583bce0299f7cc3, user_id=7ec35991c252426ba394c75df977df0e, role_id=60b6ad9d4f6d40b4a37fb5045c7f4523)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:18.917243 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b667821-81cf-4dca-8928-49cfc2b12684 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:18.953097 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 65/136] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 02:50:18 2022] PUT /identity/v3/projects/3085add0984c4b339583bce0299f7cc3/users/7ec35991c252426ba394c75df977df0e/roles/60b6ad9d4f6d40b4a37fb5045c7f4523 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 02:50:19.013321 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7842ed-d453-4212-811c-57cf66b301c9 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:19.051303 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8e011-9c36-4730-967c-881e158d86e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:19.052300 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8e011-9c36-4730-967c-881e158d86e8 None admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:19.052573 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8e011-9c36-4730-967c-881e158d86e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:19.052840 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8e011-9c36-4730-967c-881e158d86e8 None admin] PATH_INFO: `/v3/projects/d06784617c94405181344d7eebab0c3e/users/7ec35991c252426ba394c75df977df0e/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:19.061571 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8e011-9c36-4730-967c-881e158d86e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=d06784617c94405181344d7eebab0c3e, user_id=7ec35991c252426ba394c75df977df0e, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:19.063138 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8e011-9c36-4730-967c-881e158d86e8 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:19.094384 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 72/137] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 02:50:18 2022] PUT /identity/v3/projects/d06784617c94405181344d7eebab0c3e/users/7ec35991c252426ba394c75df977df0e/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 02:50:20.501769 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44e82e-9d27-4773-9928-5f5b66360d04 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:20.502359 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44e82e-9d27-4773-9928-5f5b66360d04 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:20.502359 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44e82e-9d27-4773-9928-5f5b66360d04 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:20.503779 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 66/138] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:20.521614 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84428479-57fa-4dc2-abf5-221a1f392847 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:20.522711 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84428479-57fa-4dc2-abf5-221a1f392847 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:20.523178 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84428479-57fa-4dc2-abf5-221a1f392847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:20.543490 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-84428479-57fa-4dc2-abf5-221a1f392847 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:20.545261 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-84428479-57fa-4dc2-abf5-221a1f392847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:20.634080 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 73/139] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 02:50:20.670293 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44e82e-9d27-4773-9928-5f5b66360d04 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:20.792379 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44e82e-9d27-4773-9928-5f5b66360d04 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:20.814218 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60696060-91e2-4ff4-9425-95c5dbef5b67 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:20.814854 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60696060-91e2-4ff4-9425-95c5dbef5b67 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:20.815309 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60696060-91e2-4ff4-9425-95c5dbef5b67 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:20.817170 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 74/140] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:20.823927 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cc2cb-55d1-4893-983d-947d3a425171 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:20.824550 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cc2cb-55d1-4893-983d-947d3a425171 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:20.825538 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cc2cb-55d1-4893-983d-947d3a425171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:20.846319 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-a95cc2cb-55d1-4893-983d-947d3a425171 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:20.847879 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-a95cc2cb-55d1-4893-983d-947d3a425171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:20.853849 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625b7cc-9a05-49f7-90b6-90d0bc0324e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:20.854701 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625b7cc-9a05-49f7-90b6-90d0bc0324e5 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:20.854997 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625b7cc-9a05-49f7-90b6-90d0bc0324e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:20.855268 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625b7cc-9a05-49f7-90b6-90d0bc0324e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:20.880292 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625b7cc-9a05-49f7-90b6-90d0bc0324e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:20.889934 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-3625b7cc-9a05-49f7-90b6-90d0bc0324e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 02:50:20.893868 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 67/141] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:50:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:20.900283 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625b7cc-9a05-49f7-90b6-90d0bc0324e5 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:20.977593 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 75/142] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 02:50:20.994239 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d208e76-0ea1-4a05-8738-37a5666d2755 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:20.994825 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d208e76-0ea1-4a05-8738-37a5666d2755 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:20.995290 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d208e76-0ea1-4a05-8738-37a5666d2755 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:20.997224 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 76/143] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:50:21.002338 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b811b-4479-4923-ab57-f5bdc51ec06a None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:21.002831 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b811b-4479-4923-ab57-f5bdc51ec06a None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:21.003305 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b811b-4479-4923-ab57-f5bdc51ec06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:21.037148 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-c92b811b-4479-4923-ab57-f5bdc51ec06a None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:21.047821 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-c92b811b-4479-4923-ab57-f5bdc51ec06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:21.050687 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625b7cc-9a05-49f7-90b6-90d0bc0324e5 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:21.093221 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821e953-669e-4dff-a317-211482cd8507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:21.093994 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821e953-669e-4dff-a317-211482cd8507 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:21.094294 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821e953-669e-4dff-a317-211482cd8507 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:21.094915 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821e953-669e-4dff-a317-211482cd8507 None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:21.097044 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821e953-669e-4dff-a317-211482cd8507 None admin] RBAC: Adding query filter params (name=member) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:21.097350 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821e953-669e-4dff-a317-211482cd8507 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:21.098757 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821e953-669e-4dff-a317-211482cd8507 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:21.116304 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 68/144] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 02:50:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:21.118202 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821e953-669e-4dff-a317-211482cd8507 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:21.160396 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 77/145] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 02:50:21.162484 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b811b-4479-4923-ab57-f5bdc51ec06a None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:21.242316 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821e953-669e-4dff-a317-211482cd8507 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:21.275166 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95b008-9b7b-4632-8bbb-7742465fa3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:21.276270 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95b008-9b7b-4632-8bbb-7742465fa3b1 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:21.276557 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95b008-9b7b-4632-8bbb-7742465fa3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:21.276832 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95b008-9b7b-4632-8bbb-7742465fa3b1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:21.287316 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95b008-9b7b-4632-8bbb-7742465fa3b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:21.294476 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-8e95b008-9b7b-4632-8bbb-7742465fa3b1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 12 02:50:21.295716 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 69/146] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:50:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:21.296613 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95b008-9b7b-4632-8bbb-7742465fa3b1 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:21.309254 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b811b-4479-4923-ab57-f5bdc51ec06a None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:21.373094 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103168ad-2fd0-4847-bd2e-1ee1835718be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:21.373990 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103168ad-2fd0-4847-bd2e-1ee1835718be None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:21.374269 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103168ad-2fd0-4847-bd2e-1ee1835718be None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:21.374540 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103168ad-2fd0-4847-bd2e-1ee1835718be None admin] PATH_INFO: `/v3/users/7ec35991c252426ba394c75df977df0e` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:21.380450 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103168ad-2fd0-4847-bd2e-1ee1835718be None admin] RBAC: Authorizing `identity:get_user(user_id=7ec35991c252426ba394c75df977df0e)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:21.381945 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103168ad-2fd0-4847-bd2e-1ee1835718be None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:21.383785 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 78/147] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:50:21 2022] GET /identity/v3/users/7ec35991c252426ba394c75df977df0e => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:21.384409 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103168ad-2fd0-4847-bd2e-1ee1835718be None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:21.394437 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95b008-9b7b-4632-8bbb-7742465fa3b1 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:21.427190 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605c621-5753-4e56-accc-de5f97dd2bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:21.428027 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605c621-5753-4e56-accc-de5f97dd2bd3 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:21.428314 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605c621-5753-4e56-accc-de5f97dd2bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:21.428594 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605c621-5753-4e56-accc-de5f97dd2bd3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:21.429779 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605c621-5753-4e56-accc-de5f97dd2bd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:21.431247 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605c621-5753-4e56-accc-de5f97dd2bd3 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:21.432899 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 70/148] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:50:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:21.433792 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605c621-5753-4e56-accc-de5f97dd2bd3 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:21.530449 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605c621-5753-4e56-accc-de5f97dd2bd3 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:21.554011 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103168ad-2fd0-4847-bd2e-1ee1835718be None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:21.563259 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdca8c-d101-48cb-88bd-00e35e72aa9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:21.563886 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdca8c-d101-48cb-88bd-00e35e72aa9b None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:21.564171 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdca8c-d101-48cb-88bd-00e35e72aa9b None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:21.564446 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdca8c-d101-48cb-88bd-00e35e72aa9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:21.588194 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26fca2-fe19-4934-9424-cf8f90ef003d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:21.588867 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26fca2-fe19-4934-9424-cf8f90ef003d None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:21.589152 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26fca2-fe19-4934-9424-cf8f90ef003d None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:21.589419 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26fca2-fe19-4934-9424-cf8f90ef003d None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:21.590223 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26fca2-fe19-4934-9424-cf8f90ef003d None admin] RBAC: Adding query filter params (name=reader) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:21.590523 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26fca2-fe19-4934-9424-cf8f90ef003d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:21.591940 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26fca2-fe19-4934-9424-cf8f90ef003d None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:21.600366 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 79/149] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 02:50:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:21.601189 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26fca2-fe19-4934-9424-cf8f90ef003d None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:21.632495 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebdca8c-d101-48cb-88bd-00e35e72aa9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:21.633965 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebdca8c-d101-48cb-88bd-00e35e72aa9b None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:21.716152 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26fca2-fe19-4934-9424-cf8f90ef003d None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:21.734101 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 71/150] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:50:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:50:21.735160 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdca8c-d101-48cb-88bd-00e35e72aa9b None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:21.772282 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba78028-393f-4ddd-b75a-3761edaba7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:21.772963 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba78028-393f-4ddd-b75a-3761edaba7b0 None admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:21.773238 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba78028-393f-4ddd-b75a-3761edaba7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:21.773508 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba78028-393f-4ddd-b75a-3761edaba7b0 None admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:21.774214 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba78028-393f-4ddd-b75a-3761edaba7b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:21.775676 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba78028-393f-4ddd-b75a-3761edaba7b0 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:21.802079 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 80/151] 10.222.0.32 () {60 vars in 1132 bytes} [Tue Apr 12 02:50:21 2022] POST /identity/v3/users => generated 283 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 02:50:21.802938 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba78028-393f-4ddd-b75a-3761edaba7b0 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:21.871387 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdca8c-d101-48cb-88bd-00e35e72aa9b None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:21.946393 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac288f8-0702-46e1-bc5e-0b6192b82d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:21.947290 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac288f8-0702-46e1-bc5e-0b6192b82d21 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:21.947567 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac288f8-0702-46e1-bc5e-0b6192b82d21 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:21.947868 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac288f8-0702-46e1-bc5e-0b6192b82d21 None admin] PATH_INFO: `/v3/users/6dca511a232e4bd0af0e569bb164c76c` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:21.952612 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac288f8-0702-46e1-bc5e-0b6192b82d21 None admin] RBAC: Authorizing `identity:get_user(user_id=6dca511a232e4bd0af0e569bb164c76c)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:21.954415 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac288f8-0702-46e1-bc5e-0b6192b82d21 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:21.956194 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 72/152] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:50:21 2022] GET /identity/v3/users/6dca511a232e4bd0af0e569bb164c76c => generated 289 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:21.961658 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac288f8-0702-46e1-bc5e-0b6192b82d21 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:21.971750 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba78028-393f-4ddd-b75a-3761edaba7b0 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:22.030784 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734dad81-e29f-4879-9fe6-679ce17ff38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:22.032094 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734dad81-e29f-4879-9fe6-679ce17ff38b None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:22.032578 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734dad81-e29f-4879-9fe6-679ce17ff38b None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:22.033019 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734dad81-e29f-4879-9fe6-679ce17ff38b None admin] PATH_INFO: `/v3/projects/3085add0984c4b339583bce0299f7cc3` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:22.034532 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734dad81-e29f-4879-9fe6-679ce17ff38b None admin] RBAC: Authorizing `identity:get_project(project_id=3085add0984c4b339583bce0299f7cc3)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:22.036357 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734dad81-e29f-4879-9fe6-679ce17ff38b None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:22.038372 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 81/153] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:21 2022] GET /identity/v3/projects/3085add0984c4b339583bce0299f7cc3 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:22.062233 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734dad81-e29f-4879-9fe6-679ce17ff38b None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:22.088408 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac288f8-0702-46e1-bc5e-0b6192b82d21 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:22.141597 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56c354-f31d-4733-99f5-288c9399730e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:22.142446 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56c354-f31d-4733-99f5-288c9399730e None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:22.142733 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56c354-f31d-4733-99f5-288c9399730e None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:22.143002 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56c354-f31d-4733-99f5-288c9399730e None admin] PATH_INFO: `/v3/projects/3085add0984c4b339583bce0299f7cc3` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:22.148541 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56c354-f31d-4733-99f5-288c9399730e None admin] RBAC: Authorizing `identity:get_project(project_id=3085add0984c4b339583bce0299f7cc3)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:22.150024 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56c354-f31d-4733-99f5-288c9399730e None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:22.152022 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 73/154] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:21 2022] GET /identity/v3/projects/3085add0984c4b339583bce0299f7cc3 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:22.157454 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56c354-f31d-4733-99f5-288c9399730e None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:22.234848 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734dad81-e29f-4879-9fe6-679ce17ff38b None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:22.275211 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40bc2f-c6d6-4999-932e-5cbb0fd7042f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:22.276492 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40bc2f-c6d6-4999-932e-5cbb0fd7042f None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:22.277100 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40bc2f-c6d6-4999-932e-5cbb0fd7042f None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:22.277627 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40bc2f-c6d6-4999-932e-5cbb0fd7042f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:22.278973 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40bc2f-c6d6-4999-932e-5cbb0fd7042f None admin] RBAC: Adding query filter params (role.id=0a31c1ce37fa41deb4908731f772414b, scope.project.id=3085add0984c4b339583bce0299f7cc3, user.id=7ec35991c252426ba394c75df977df0e) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:22.279499 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40bc2f-c6d6-4999-932e-5cbb0fd7042f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:22.281214 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40bc2f-c6d6-4999-932e-5cbb0fd7042f None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:22.288517 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 82/155] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:50:22 2022] GET /identity/v3/role_assignments?user.id=7ec35991c252426ba394c75df977df0e&scope.project.id=3085add0984c4b339583bce0299f7cc3&role.id=0a31c1ce37fa41deb4908731f772414b => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:22.333014 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56c354-f31d-4733-99f5-288c9399730e None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:22.369641 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc32d40-7238-44c5-ab6b-f68afa409950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:22.370922 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc32d40-7238-44c5-ab6b-f68afa409950 None admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:22.371514 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc32d40-7238-44c5-ab6b-f68afa409950 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:22.372020 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc32d40-7238-44c5-ab6b-f68afa409950 None admin] PATH_INFO: `/v3/projects/3085add0984c4b339583bce0299f7cc3/users/6dca511a232e4bd0af0e569bb164c76c/roles/33cab6a3207a4cd69442cac65e246a23` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:22.374349 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc32d40-7238-44c5-ab6b-f68afa409950 None admin] RBAC: Authorizing `identity:create_grant(project_id=3085add0984c4b339583bce0299f7cc3, user_id=6dca511a232e4bd0af0e569bb164c76c, role_id=33cab6a3207a4cd69442cac65e246a23)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:22.376126 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc32d40-7238-44c5-ab6b-f68afa409950 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:22.380541 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d1378-913d-438b-9b40-67cb3c0484b2 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:22.381139 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d1378-913d-438b-9b40-67cb3c0484b2 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:22.381624 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d1378-913d-438b-9b40-67cb3c0484b2 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:22.383376 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 83/156] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:22.399108 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 74/157] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 02:50:22 2022] PUT /identity/v3/projects/3085add0984c4b339583bce0299f7cc3/users/6dca511a232e4bd0af0e569bb164c76c/roles/33cab6a3207a4cd69442cac65e246a23 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 02:50:22.403222 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8dd3b-b5c1-4805-b0a1-c66da364203a None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:22.403222 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8dd3b-b5c1-4805-b0a1-c66da364203a None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:22.403222 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8dd3b-b5c1-4805-b0a1-c66da364203a None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:22.403222 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 84/158] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:22.405450 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c7193-17e9-45bc-ae59-e15c59bb6c52 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:22.405753 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c7193-17e9-45bc-ae59-e15c59bb6c52 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:22.406059 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c7193-17e9-45bc-ae59-e15c59bb6c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:22.408514 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7726a-7d04-4dbe-9ea9-17984306841c None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:22.408795 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7726a-7d04-4dbe-9ea9-17984306841c None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:22.409078 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7726a-7d04-4dbe-9ea9-17984306841c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:22.427785 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-e44c7193-17e9-45bc-ae59-e15c59bb6c52 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:22.429186 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-e44c7193-17e9-45bc-ae59-e15c59bb6c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:22.444562 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-13e7726a-7d04-4dbe-9ea9-17984306841c None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:22.445841 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-13e7726a-7d04-4dbe-9ea9-17984306841c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:22.534684 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 75/159] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:22.558614 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 85/160] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:22.565416 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c7193-17e9-45bc-ae59-e15c59bb6c52 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:22.602111 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7726a-7d04-4dbe-9ea9-17984306841c None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:22.670505 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c7193-17e9-45bc-ae59-e15c59bb6c52 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:22.707571 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29f18f-c7ce-47eb-ad63-d63b941c95d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:22.708783 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29f18f-c7ce-47eb-ad63-d63b941c95d1 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:22.709258 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29f18f-c7ce-47eb-ad63-d63b941c95d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:22.709824 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29f18f-c7ce-47eb-ad63-d63b941c95d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:22.722682 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29f18f-c7ce-47eb-ad63-d63b941c95d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:22.731053 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-cd29f18f-c7ce-47eb-ad63-d63b941c95d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 02:50:22.733288 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 76/161] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 02:50:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:22.739867 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29f18f-c7ce-47eb-ad63-d63b941c95d1 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:22.778726 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7726a-7d04-4dbe-9ea9-17984306841c None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:22.825075 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7abca-f878-4314-8934-e5ec64fa11a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:22.826481 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7abca-f878-4314-8934-e5ec64fa11a9 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:22.826969 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7abca-f878-4314-8934-e5ec64fa11a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:22.827443 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7abca-f878-4314-8934-e5ec64fa11a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:22.856248 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7abca-f878-4314-8934-e5ec64fa11a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:22.864619 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-f2e7abca-f878-4314-8934-e5ec64fa11a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 02:50:22.866219 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 86/162] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:50:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:22.871520 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7abca-f878-4314-8934-e5ec64fa11a9 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:22.901941 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29f18f-c7ce-47eb-ad63-d63b941c95d1 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:22.948842 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a202fa-7219-4572-b0fc-906c9f421abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:22.949621 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a202fa-7219-4572-b0fc-906c9f421abd None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:22.949901 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a202fa-7219-4572-b0fc-906c9f421abd None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:22.950169 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a202fa-7219-4572-b0fc-906c9f421abd None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:22.950940 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a202fa-7219-4572-b0fc-906c9f421abd None admin] RBAC: Adding query filter params (name=admin) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:22.951231 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a202fa-7219-4572-b0fc-906c9f421abd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:22.952669 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a202fa-7219-4572-b0fc-906c9f421abd None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:22.964109 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 77/163] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:50:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:50:22.966060 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd764d-4f2d-4501-9a68-25e88e721216 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:22.966060 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd764d-4f2d-4501-9a68-25e88e721216 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:22.966250 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd764d-4f2d-4501-9a68-25e88e721216 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:22.967426 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 78/164] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:22.969638 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd764d-4f2d-4501-9a68-25e88e721216 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:23.005609 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7abca-f878-4314-8934-e5ec64fa11a9 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:23.047965 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28022ad-3735-4265-8a3b-6f64593a7524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:23.048941 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28022ad-3735-4265-8a3b-6f64593a7524 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:23.049399 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28022ad-3735-4265-8a3b-6f64593a7524 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:23.049838 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28022ad-3735-4265-8a3b-6f64593a7524 None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:23.050919 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28022ad-3735-4265-8a3b-6f64593a7524 None admin] RBAC: Adding query filter params (name=member) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:23.051401 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28022ad-3735-4265-8a3b-6f64593a7524 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:23.053720 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28022ad-3735-4265-8a3b-6f64593a7524 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:23.065169 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 87/165] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 02:50:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:23.067048 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1072f2-c572-4e3b-98d5-fc461c21811c None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:23.071981 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1072f2-c572-4e3b-98d5-fc461c21811c None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:23.072195 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1072f2-c572-4e3b-98d5-fc461c21811c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:23.092751 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-1e1072f2-c572-4e3b-98d5-fc461c21811c None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:23.094112 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-1e1072f2-c572-4e3b-98d5-fc461c21811c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:23.099710 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd764d-4f2d-4501-9a68-25e88e721216 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:23.141688 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f0aa1-d70c-493f-a999-0617fa47ec21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:23.143195 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f0aa1-d70c-493f-a999-0617fa47ec21 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:23.143651 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f0aa1-d70c-493f-a999-0617fa47ec21 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:23.144118 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f0aa1-d70c-493f-a999-0617fa47ec21 None admin] PATH_INFO: `/v3/users/99e456857e814b9bb8e2717b9f3a9a8f` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:23.146030 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f0aa1-d70c-493f-a999-0617fa47ec21 None admin] RBAC: Authorizing `identity:get_user(user_id=99e456857e814b9bb8e2717b9f3a9a8f)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:23.148239 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f0aa1-d70c-493f-a999-0617fa47ec21 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:23.150510 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 79/166] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:50:22 2022] GET /identity/v3/users/99e456857e814b9bb8e2717b9f3a9a8f => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:50:23.151827 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f0aa1-d70c-493f-a999-0617fa47ec21 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:23.171334 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 88/167] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:23.174393 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1072f2-c572-4e3b-98d5-fc461c21811c None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:23.266198 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f0aa1-d70c-493f-a999-0617fa47ec21 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:23.303575 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c798cb-3106-4c9a-bae3-0deca86df703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:23.305514 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c798cb-3106-4c9a-bae3-0deca86df703 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:23.305937 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c798cb-3106-4c9a-bae3-0deca86df703 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:23.306368 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c798cb-3106-4c9a-bae3-0deca86df703 None admin] PATH_INFO: `/v3/users/7ec35991c252426ba394c75df977df0e` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:23.307747 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c798cb-3106-4c9a-bae3-0deca86df703 None admin] RBAC: Authorizing `identity:get_user(user_id=7ec35991c252426ba394c75df977df0e)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:23.309853 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c798cb-3106-4c9a-bae3-0deca86df703 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:23.311695 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 80/168] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:50:23 2022] GET /identity/v3/users/7ec35991c252426ba394c75df977df0e => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:23.312658 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c798cb-3106-4c9a-bae3-0deca86df703 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:23.381843 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1072f2-c572-4e3b-98d5-fc461c21811c None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:23.422326 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c798cb-3106-4c9a-bae3-0deca86df703 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:23.459508 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72b809-2012-44e7-9032-38166425fc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:23.461045 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72b809-2012-44e7-9032-38166425fc1a None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:23.461645 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72b809-2012-44e7-9032-38166425fc1a None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:23.462108 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72b809-2012-44e7-9032-38166425fc1a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:23.473891 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a72b809-2012-44e7-9032-38166425fc1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:23.476999 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d1255-a9d4-4cb7-98ac-f12a1ce0358f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:23.477682 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d1255-a9d4-4cb7-98ac-f12a1ce0358f None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:23.477949 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d1255-a9d4-4cb7-98ac-f12a1ce0358f None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:23.478215 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d1255-a9d4-4cb7-98ac-f12a1ce0358f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:23.482990 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-5a72b809-2012-44e7-9032-38166425fc1a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 02:50:23.484870 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 81/169] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 02:50:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:23.485875 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72b809-2012-44e7-9032-38166425fc1a None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:23.596561 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72b809-2012-44e7-9032-38166425fc1a None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:23.634069 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb45509-9de6-428a-9d19-4d9f4583b509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:23.634741 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb45509-9de6-428a-9d19-4d9f4583b509 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:23.635020 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb45509-9de6-428a-9d19-4d9f4583b509 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:23.635291 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb45509-9de6-428a-9d19-4d9f4583b509 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:23.637323 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d1255-a9d4-4cb7-98ac-f12a1ce0358f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:23.639009 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d1255-a9d4-4cb7-98ac-f12a1ce0358f None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:23.710066 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb45509-9de6-428a-9d19-4d9f4583b509 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:23.711545 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb45509-9de6-428a-9d19-4d9f4583b509 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:23.820505 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 82/170] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:50:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:50:23.821394 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb45509-9de6-428a-9d19-4d9f4583b509 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:23.835363 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 89/171] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:50:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:50:23.836251 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d1255-a9d4-4cb7-98ac-f12a1ce0358f None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:23.938681 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb45509-9de6-428a-9d19-4d9f4583b509 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:23.953047 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d1255-a9d4-4cb7-98ac-f12a1ce0358f None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:23.980884 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c689f-c37a-496f-a683-05fb7e62eaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:23.982307 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c689f-c37a-496f-a683-05fb7e62eaa9 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:23.982693 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c689f-c37a-496f-a683-05fb7e62eaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:23.983071 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c689f-c37a-496f-a683-05fb7e62eaa9 None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:23.984044 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c689f-c37a-496f-a683-05fb7e62eaa9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:23.984450 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c689f-c37a-496f-a683-05fb7e62eaa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:23.985650 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4b736-d5be-4147-84aa-058c95d8a752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:23.986026 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c689f-c37a-496f-a683-05fb7e62eaa9 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:23.986508 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4b736-d5be-4147-84aa-058c95d8a752 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:23.986779 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4b736-d5be-4147-84aa-058c95d8a752 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:23.987044 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4b736-d5be-4147-84aa-058c95d8a752 None admin] PATH_INFO: `/v3/projects/d06784617c94405181344d7eebab0c3e` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:23.988275 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc4b736-d5be-4147-84aa-058c95d8a752 None admin] RBAC: Authorizing `identity:get_project(project_id=d06784617c94405181344d7eebab0c3e)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:23.989734 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc4b736-d5be-4147-84aa-058c95d8a752 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:23.991812 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 90/172] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:23 2022] GET /identity/v3/projects/d06784617c94405181344d7eebab0c3e => generated 312 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:23.992594 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4b736-d5be-4147-84aa-058c95d8a752 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:23.994654 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 83/173] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:50:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:24.001458 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c689f-c37a-496f-a683-05fb7e62eaa9 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:24.106267 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4b736-d5be-4147-84aa-058c95d8a752 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:24.118736 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c689f-c37a-496f-a683-05fb7e62eaa9 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:24.148576 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527f227-cee8-4ce4-8a73-c712925517ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:24.149647 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527f227-cee8-4ce4-8a73-c712925517ab None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:24.150019 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527f227-cee8-4ce4-8a73-c712925517ab None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:24.150396 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527f227-cee8-4ce4-8a73-c712925517ab None admin] PATH_INFO: `/v3/projects/3085add0984c4b339583bce0299f7cc3` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:24.151770 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b69a4-b5e8-41c8-a6a6-7a4f29ebe8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:24.151986 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527f227-cee8-4ce4-8a73-c712925517ab None admin] RBAC: Authorizing `identity:get_project(project_id=3085add0984c4b339583bce0299f7cc3)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:24.152449 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b69a4-b5e8-41c8-a6a6-7a4f29ebe8e8 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:24.152722 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b69a4-b5e8-41c8-a6a6-7a4f29ebe8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:24.152990 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b69a4-b5e8-41c8-a6a6-7a4f29ebe8e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:24.153395 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527f227-cee8-4ce4-8a73-c712925517ab None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:24.153848 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b69a4-b5e8-41c8-a6a6-7a4f29ebe8e8 None admin] RBAC: Adding query filter params (role.id=0a31c1ce37fa41deb4908731f772414b, scope.project.id=d06784617c94405181344d7eebab0c3e, user.id=7ec35991c252426ba394c75df977df0e) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:24.154153 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b69a4-b5e8-41c8-a6a6-7a4f29ebe8e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:24.155414 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 91/174] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:23 2022] GET /identity/v3/projects/3085add0984c4b339583bce0299f7cc3 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:24.155698 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b69a4-b5e8-41c8-a6a6-7a4f29ebe8e8 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:24.156051 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527f227-cee8-4ce4-8a73-c712925517ab None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:24.163321 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 84/175] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:50:23 2022] GET /identity/v3/role_assignments?user.id=7ec35991c252426ba394c75df977df0e&scope.project.id=d06784617c94405181344d7eebab0c3e&role.id=0a31c1ce37fa41deb4908731f772414b => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:24.164044 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b69a4-b5e8-41c8-a6a6-7a4f29ebe8e8 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:24.271904 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b69a4-b5e8-41c8-a6a6-7a4f29ebe8e8 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:24.294668 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527f227-cee8-4ce4-8a73-c712925517ab None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:24.309788 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666f635-5ca8-4b24-8de2-a360bc9087d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:24.310450 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666f635-5ca8-4b24-8de2-a360bc9087d8 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:24.310725 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666f635-5ca8-4b24-8de2-a360bc9087d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:24.310995 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666f635-5ca8-4b24-8de2-a360bc9087d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:24.311858 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666f635-5ca8-4b24-8de2-a360bc9087d8 None admin] RBAC: Adding query filter params (role.id=c0f19d3800f44637822d5162ffe4b497, scope.project.id=3085add0984c4b339583bce0299f7cc3, user.id=99e456857e814b9bb8e2717b9f3a9a8f) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:24.312166 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666f635-5ca8-4b24-8de2-a360bc9087d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:24.313612 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666f635-5ca8-4b24-8de2-a360bc9087d8 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:24.320106 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 85/176] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:50:24 2022] GET /identity/v3/role_assignments?user.id=99e456857e814b9bb8e2717b9f3a9a8f&scope.project.id=3085add0984c4b339583bce0299f7cc3&role.id=c0f19d3800f44637822d5162ffe4b497 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:24.339337 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c91145-c06f-4520-a56d-e5d173891162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:24.340483 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c91145-c06f-4520-a56d-e5d173891162 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:24.340761 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c91145-c06f-4520-a56d-e5d173891162 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:24.341028 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c91145-c06f-4520-a56d-e5d173891162 None admin] PATH_INFO: `/v3/users/7ec35991c252426ba394c75df977df0e` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:24.342338 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c91145-c06f-4520-a56d-e5d173891162 None admin] RBAC: Authorizing `identity:get_user(user_id=7ec35991c252426ba394c75df977df0e)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:24.343883 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c91145-c06f-4520-a56d-e5d173891162 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:24.345943 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 92/177] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:50:24 2022] GET /identity/v3/users/7ec35991c252426ba394c75df977df0e => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:24.351639 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666f635-5ca8-4b24-8de2-a360bc9087d8 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:24.493019 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666f635-5ca8-4b24-8de2-a360bc9087d8 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:24.547484 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b707983-c46c-451c-8af0-c711b9e937ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:24.548100 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b707983-c46c-451c-8af0-c711b9e937ed None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:24.548376 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b707983-c46c-451c-8af0-c711b9e937ed None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:24.548644 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b707983-c46c-451c-8af0-c711b9e937ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:24.625514 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b707983-c46c-451c-8af0-c711b9e937ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:24.627158 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b707983-c46c-451c-8af0-c711b9e937ed None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:24.728876 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 86/178] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:50:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:50:24.734256 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c91145-c06f-4520-a56d-e5d173891162 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:24.847188 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c91145-c06f-4520-a56d-e5d173891162 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:24.887655 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cef920-9feb-4422-a37c-4238a02eb7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:24.888701 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cef920-9feb-4422-a37c-4238a02eb7ae None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:24.888979 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cef920-9feb-4422-a37c-4238a02eb7ae None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:24.889248 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cef920-9feb-4422-a37c-4238a02eb7ae None admin] PATH_INFO: `/v3/projects/3085add0984c4b339583bce0299f7cc3` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:24.890473 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cef920-9feb-4422-a37c-4238a02eb7ae None admin] RBAC: Authorizing `identity:get_project(project_id=3085add0984c4b339583bce0299f7cc3)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:24.891968 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cef920-9feb-4422-a37c-4238a02eb7ae None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:24.893845 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 93/179] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:24 2022] GET /identity/v3/projects/3085add0984c4b339583bce0299f7cc3 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:24.899890 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b707983-c46c-451c-8af0-c711b9e937ed None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:25.000373 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b707983-c46c-451c-8af0-c711b9e937ed None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:25.039125 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42ac76-8e52-4f08-a47d-3c7bd69b50b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:25.039814 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42ac76-8e52-4f08-a47d-3c7bd69b50b2 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:25.040095 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42ac76-8e52-4f08-a47d-3c7bd69b50b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:25.040362 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42ac76-8e52-4f08-a47d-3c7bd69b50b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:25.041198 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42ac76-8e52-4f08-a47d-3c7bd69b50b2 None admin] RBAC: Adding query filter params (role.id=60b6ad9d4f6d40b4a37fb5045c7f4523, scope.project.id=3085add0984c4b339583bce0299f7cc3, user.id=7ec35991c252426ba394c75df977df0e) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:25.041500 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42ac76-8e52-4f08-a47d-3c7bd69b50b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:25.042954 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42ac76-8e52-4f08-a47d-3c7bd69b50b2 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:25.050243 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 87/180] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:50:24 2022] GET /identity/v3/role_assignments?user.id=7ec35991c252426ba394c75df977df0e&scope.project.id=3085add0984c4b339583bce0299f7cc3&role.id=60b6ad9d4f6d40b4a37fb5045c7f4523 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:25.883030 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a190a06-bcd4-4598-9411-9622f06bfd21 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:25.883572 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a190a06-bcd4-4598-9411-9622f06bfd21 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:25.883572 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a190a06-bcd4-4598-9411-9622f06bfd21 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:25.885174 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 94/181] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:25.891784 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aad3a1-4025-4c08-b2ab-07acf2cb104d None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:25.892324 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aad3a1-4025-4c08-b2ab-07acf2cb104d None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:25.892324 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aad3a1-4025-4c08-b2ab-07acf2cb104d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:25.912379 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-f3aad3a1-4025-4c08-b2ab-07acf2cb104d None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:25.913595 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-f3aad3a1-4025-4c08-b2ab-07acf2cb104d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:25.925202 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcae04-ad66-4dba-9841-a5ff27b7317a None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:25.925883 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcae04-ad66-4dba-9841-a5ff27b7317a None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:25.926371 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcae04-ad66-4dba-9841-a5ff27b7317a None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:25.928272 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 95/182] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:25.934475 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bd9ff-6270-4ff1-b89f-f66344a4c080 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:25.935010 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bd9ff-6270-4ff1-b89f-f66344a4c080 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:25.935470 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bd9ff-6270-4ff1-b89f-f66344a4c080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:25.953732 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-bc3bd9ff-6270-4ff1-b89f-f66344a4c080 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:25.955303 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-bc3bd9ff-6270-4ff1-b89f-f66344a4c080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:25.988579 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 88/183] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:26.013229 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aad3a1-4025-4c08-b2ab-07acf2cb104d None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:26.023203 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 96/184] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 02:50:26.047842 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bd9ff-6270-4ff1-b89f-f66344a4c080 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:26.109752 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aad3a1-4025-4c08-b2ab-07acf2cb104d None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:26.143853 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcf4e8-a563-48d1-9c1a-1813a089420f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:26.144570 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcf4e8-a563-48d1-9c1a-1813a089420f None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:26.144847 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcf4e8-a563-48d1-9c1a-1813a089420f None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:26.144964 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bd9ff-6270-4ff1-b89f-f66344a4c080 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:26.145124 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcf4e8-a563-48d1-9c1a-1813a089420f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:26.155549 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dcf4e8-a563-48d1-9c1a-1813a089420f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:26.162655 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-15dcf4e8-a563-48d1-9c1a-1813a089420f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 02:50:26.164254 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 89/185] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 02:50:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:50:26.170020 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcf4e8-a563-48d1-9c1a-1813a089420f None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:26.178330 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532405f6-f685-4a37-9f0a-810296cb7472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:26.179141 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532405f6-f685-4a37-9f0a-810296cb7472 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:26.179414 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532405f6-f685-4a37-9f0a-810296cb7472 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:26.179675 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532405f6-f685-4a37-9f0a-810296cb7472 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:26.190417 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532405f6-f685-4a37-9f0a-810296cb7472 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:26.197391 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-532405f6-f685-4a37-9f0a-810296cb7472 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 12 02:50:26.198909 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 97/186] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:50:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:50:26.205011 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532405f6-f685-4a37-9f0a-810296cb7472 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:26.267502 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcf4e8-a563-48d1-9c1a-1813a089420f None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:26.300276 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532405f6-f685-4a37-9f0a-810296cb7472 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:26.302280 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d8440-8891-439f-ad3b-3da5de6e8963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:26.302948 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d8440-8891-439f-ad3b-3da5de6e8963 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:26.303226 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d8440-8891-439f-ad3b-3da5de6e8963 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:26.303498 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d8440-8891-439f-ad3b-3da5de6e8963 None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:26.304289 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d8440-8891-439f-ad3b-3da5de6e8963 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:26.304591 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d8440-8891-439f-ad3b-3da5de6e8963 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:26.305979 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d8440-8891-439f-ad3b-3da5de6e8963 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:26.313838 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 90/187] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:50:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:50:26.313838 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd656e0-1bf5-4b3e-bd64-7025843bab93 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:26.313838 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd656e0-1bf5-4b3e-bd64-7025843bab93 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:26.313838 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd656e0-1bf5-4b3e-bd64-7025843bab93 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:26.313838 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 91/188] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:26.313838 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afac25-d914-4df8-b44d-663b4e5cb564 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:26.318632 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afac25-d914-4df8-b44d-663b4e5cb564 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:26.318709 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afac25-d914-4df8-b44d-663b4e5cb564 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:26.319942 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 92/189] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:26.321615 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afac25-d914-4df8-b44d-663b4e5cb564 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:26.338728 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3537eb-ec26-4917-8d65-022a681dbfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:26.339395 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3537eb-ec26-4917-8d65-022a681dbfd6 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:26.339667 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3537eb-ec26-4917-8d65-022a681dbfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:26.340049 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3537eb-ec26-4917-8d65-022a681dbfd6 None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:26.340798 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3537eb-ec26-4917-8d65-022a681dbfd6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:26.341088 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3537eb-ec26-4917-8d65-022a681dbfd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:26.342491 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3537eb-ec26-4917-8d65-022a681dbfd6 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:26.350219 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 98/190] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 02:50:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:50:26.351443 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456a7a4-17de-4382-9812-67eced92b259 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:26.351742 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456a7a4-17de-4382-9812-67eced92b259 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:26.352026 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456a7a4-17de-4382-9812-67eced92b259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:26.367953 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-f456a7a4-17de-4382-9812-67eced92b259 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:26.369117 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-f456a7a4-17de-4382-9812-67eced92b259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:26.419249 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afac25-d914-4df8-b44d-663b4e5cb564 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:26.433831 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 99/191] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:26.435072 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4beb5b-062a-4c38-bf81-5d3af49969c9 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:26.435311 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4beb5b-062a-4c38-bf81-5d3af49969c9 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:26.435592 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4beb5b-062a-4c38-bf81-5d3af49969c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:26.451360 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-9c4beb5b-062a-4c38-bf81-5d3af49969c9 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:26.452683 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-9c4beb5b-062a-4c38-bf81-5d3af49969c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:26.453124 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f9bf8-bf73-49c4-a786-498f9f347cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:26.453895 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f9bf8-bf73-49c4-a786-498f9f347cec None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:26.454174 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f9bf8-bf73-49c4-a786-498f9f347cec None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:26.454437 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f9bf8-bf73-49c4-a786-498f9f347cec None admin] PATH_INFO: `/v3/users/dbd1753be164451a958de92482f594cc` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:26.468443 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f9bf8-bf73-49c4-a786-498f9f347cec None admin] RBAC: Authorizing `identity:get_user(user_id=dbd1753be164451a958de92482f594cc)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:26.469902 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f9bf8-bf73-49c4-a786-498f9f347cec None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:26.471628 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 93/192] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:50:26 2022] GET /identity/v3/users/dbd1753be164451a958de92482f594cc => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:26.476240 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f9bf8-bf73-49c4-a786-498f9f347cec None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:26.523067 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 100/193] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:26.523067 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4beb5b-062a-4c38-bf81-5d3af49969c9 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:26.568234 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f9bf8-bf73-49c4-a786-498f9f347cec None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:26.602508 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c8929-4559-42f7-abcd-8d858695eb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:26.603389 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c8929-4559-42f7-abcd-8d858695eb69 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:26.603663 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c8929-4559-42f7-abcd-8d858695eb69 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:26.603928 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c8929-4559-42f7-abcd-8d858695eb69 None admin] PATH_INFO: `/v3/users/6dca511a232e4bd0af0e569bb164c76c` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:26.605146 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c8929-4559-42f7-abcd-8d858695eb69 None admin] RBAC: Authorizing `identity:get_user(user_id=6dca511a232e4bd0af0e569bb164c76c)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:26.606978 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c8929-4559-42f7-abcd-8d858695eb69 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:26.608802 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 94/194] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:50:26 2022] GET /identity/v3/users/6dca511a232e4bd0af0e569bb164c76c => generated 289 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:26.609476 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c8929-4559-42f7-abcd-8d858695eb69 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:26.619627 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4beb5b-062a-4c38-bf81-5d3af49969c9 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:26.653377 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a0ecc5-cc05-46dc-ab1b-530e3f8e8d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:26.654184 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0ecc5-cc05-46dc-ab1b-530e3f8e8d08 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:26.654455 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0ecc5-cc05-46dc-ab1b-530e3f8e8d08 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:26.654724 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0ecc5-cc05-46dc-ab1b-530e3f8e8d08 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:26.664611 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a0ecc5-cc05-46dc-ab1b-530e3f8e8d08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:26.672885 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-a7a0ecc5-cc05-46dc-ab1b-530e3f8e8d08 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 02:50:26.674034 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 101/195] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 02:50:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:26.674801 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a0ecc5-cc05-46dc-ab1b-530e3f8e8d08 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:26.706685 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c8929-4559-42f7-abcd-8d858695eb69 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:26.740550 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edef7f6-d4fa-4954-bcc5-bdc3529ff8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:26.741200 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edef7f6-d4fa-4954-bcc5-bdc3529ff8b1 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:26.741470 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edef7f6-d4fa-4954-bcc5-bdc3529ff8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:26.741739 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edef7f6-d4fa-4954-bcc5-bdc3529ff8b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:26.773111 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a0ecc5-cc05-46dc-ab1b-530e3f8e8d08 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:26.804696 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4e675-4593-47f9-835c-59088aa3abba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:26.804888 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edef7f6-d4fa-4954-bcc5-bdc3529ff8b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:26.805481 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4e675-4593-47f9-835c-59088aa3abba None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:26.805755 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4e675-4593-47f9-835c-59088aa3abba None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:26.806019 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4e675-4593-47f9-835c-59088aa3abba None admin] PATH_INFO: `/v3/domains/default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:26.806375 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edef7f6-d4fa-4954-bcc5-bdc3529ff8b1 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:26.807168 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e4e675-4593-47f9-835c-59088aa3abba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:26.808768 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e4e675-4593-47f9-835c-59088aa3abba None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:26.810425 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 102/196] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:50:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:26.811170 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4e675-4593-47f9-835c-59088aa3abba None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:26.904462 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 95/197] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:50:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:50:26.905327 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edef7f6-d4fa-4954-bcc5-bdc3529ff8b1 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:26.909376 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4e675-4593-47f9-835c-59088aa3abba None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:26.953543 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8f891-699d-453d-ae60-799380c29795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:26.954195 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8f891-699d-453d-ae60-799380c29795 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:26.954466 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8f891-699d-453d-ae60-799380c29795 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:26.954729 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8f891-699d-453d-ae60-799380c29795 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:26.999357 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edef7f6-d4fa-4954-bcc5-bdc3529ff8b1 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:27.022135 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8f891-699d-453d-ae60-799380c29795 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:27.023617 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8f891-699d-453d-ae60-799380c29795 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:27.031659 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a44d0f-e460-4380-91e8-7123029a0ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:27.032349 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a44d0f-e460-4380-91e8-7123029a0ee9 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:27.032619 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a44d0f-e460-4380-91e8-7123029a0ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:27.032881 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a44d0f-e460-4380-91e8-7123029a0ee9 None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:27.033620 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a44d0f-e460-4380-91e8-7123029a0ee9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:27.033911 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a44d0f-e460-4380-91e8-7123029a0ee9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:27.035256 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a44d0f-e460-4380-91e8-7123029a0ee9 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:27.042872 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 96/198] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:50:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:27.043704 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a44d0f-e460-4380-91e8-7123029a0ee9 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:27.118018 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 103/199] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:50:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:50:27.120225 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8f891-699d-453d-ae60-799380c29795 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:27.138043 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a44d0f-e460-4380-91e8-7123029a0ee9 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:27.170654 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57d89e-1b41-4619-9b68-7d52e2d94cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:27.171309 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57d89e-1b41-4619-9b68-7d52e2d94cef None admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:27.171585 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57d89e-1b41-4619-9b68-7d52e2d94cef None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:27.171873 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57d89e-1b41-4619-9b68-7d52e2d94cef None admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:27.172575 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57d89e-1b41-4619-9b68-7d52e2d94cef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:27.174004 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57d89e-1b41-4619-9b68-7d52e2d94cef None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:27.199788 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 97/200] 10.222.0.32 () {60 vars in 1132 bytes} [Tue Apr 12 02:50:27 2022] POST /identity/v3/users => generated 297 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 02:50:27.200607 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57d89e-1b41-4619-9b68-7d52e2d94cef None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:27.214247 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8f891-699d-453d-ae60-799380c29795 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:27.250506 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb2d62-f1e7-46a2-8832-1af58a6f577b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:27.251436 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb2d62-f1e7-46a2-8832-1af58a6f577b None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:27.251745 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb2d62-f1e7-46a2-8832-1af58a6f577b None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:27.252012 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb2d62-f1e7-46a2-8832-1af58a6f577b None admin] PATH_INFO: `/v3/projects/020fd75d07c34b109048207eb8e5fd24` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:27.253243 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb2d62-f1e7-46a2-8832-1af58a6f577b None admin] RBAC: Authorizing `identity:get_project(project_id=020fd75d07c34b109048207eb8e5fd24)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:27.254756 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb2d62-f1e7-46a2-8832-1af58a6f577b None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:27.256586 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 104/201] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:27 2022] GET /identity/v3/projects/020fd75d07c34b109048207eb8e5fd24 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:27.259124 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb2d62-f1e7-46a2-8832-1af58a6f577b None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:27.314365 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57d89e-1b41-4619-9b68-7d52e2d94cef None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:27.348415 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5eb5d-2070-4474-b1c5-f1ae3f8ea998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:27.349330 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5eb5d-2070-4474-b1c5-f1ae3f8ea998 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:27.349599 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5eb5d-2070-4474-b1c5-f1ae3f8ea998 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:27.349868 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5eb5d-2070-4474-b1c5-f1ae3f8ea998 None admin] PATH_INFO: `/v3/users/dbd1753be164451a958de92482f594cc` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:27.351110 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b5eb5d-2070-4474-b1c5-f1ae3f8ea998 None admin] RBAC: Authorizing `identity:get_user(user_id=dbd1753be164451a958de92482f594cc)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:27.352609 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b5eb5d-2070-4474-b1c5-f1ae3f8ea998 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:27.359130 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 98/202] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:50:27 2022] GET /identity/v3/users/dbd1753be164451a958de92482f594cc => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:27.359130 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5eb5d-2070-4474-b1c5-f1ae3f8ea998 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:27.367168 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb2d62-f1e7-46a2-8832-1af58a6f577b None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:27.403396 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57dba1-061e-4cfc-9aa7-a7026c6ed18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:27.404308 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57dba1-061e-4cfc-9aa7-a7026c6ed18c None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:27.404584 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57dba1-061e-4cfc-9aa7-a7026c6ed18c None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:27.404854 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57dba1-061e-4cfc-9aa7-a7026c6ed18c None admin] PATH_INFO: `/v3/projects/3085add0984c4b339583bce0299f7cc3` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:27.406074 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57dba1-061e-4cfc-9aa7-a7026c6ed18c None admin] RBAC: Authorizing `identity:get_project(project_id=3085add0984c4b339583bce0299f7cc3)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:27.407526 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57dba1-061e-4cfc-9aa7-a7026c6ed18c None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:27.409306 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 105/203] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:27 2022] GET /identity/v3/projects/3085add0984c4b339583bce0299f7cc3 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:27.410022 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57dba1-061e-4cfc-9aa7-a7026c6ed18c None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:27.476676 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5eb5d-2070-4474-b1c5-f1ae3f8ea998 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:27.518609 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57dba1-061e-4cfc-9aa7-a7026c6ed18c None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:27.522093 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aec228-a5f5-429d-8039-d4a7cb7a3964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:27.522902 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aec228-a5f5-429d-8039-d4a7cb7a3964 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:27.523218 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aec228-a5f5-429d-8039-d4a7cb7a3964 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:27.523493 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aec228-a5f5-429d-8039-d4a7cb7a3964 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:27.524945 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aec228-a5f5-429d-8039-d4a7cb7a3964 None admin] RBAC: Adding query filter params (role.id=c0f19d3800f44637822d5162ffe4b497, scope.project.id=020fd75d07c34b109048207eb8e5fd24, user.id=dbd1753be164451a958de92482f594cc) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:27.524945 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aec228-a5f5-429d-8039-d4a7cb7a3964 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:27.526182 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aec228-a5f5-429d-8039-d4a7cb7a3964 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:27.534144 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 99/204] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:50:27 2022] GET /identity/v3/role_assignments?user.id=dbd1753be164451a958de92482f594cc&scope.project.id=020fd75d07c34b109048207eb8e5fd24&role.id=c0f19d3800f44637822d5162ffe4b497 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:27.535118 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aec228-a5f5-429d-8039-d4a7cb7a3964 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:27.564410 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451d6cd-f33d-4ecc-831f-cb803d13b8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:27.565327 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451d6cd-f33d-4ecc-831f-cb803d13b8ff None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:27.565909 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451d6cd-f33d-4ecc-831f-cb803d13b8ff None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:27.566338 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451d6cd-f33d-4ecc-831f-cb803d13b8ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:27.647785 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451d6cd-f33d-4ecc-831f-cb803d13b8ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:27.649606 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451d6cd-f33d-4ecc-831f-cb803d13b8ff None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:27.657712 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aec228-a5f5-429d-8039-d4a7cb7a3964 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:27.707111 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de29617-5b0f-411f-b0d8-79da4c7d81f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:27.707905 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de29617-5b0f-411f-b0d8-79da4c7d81f0 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:27.708763 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de29617-5b0f-411f-b0d8-79da4c7d81f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:27.709136 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de29617-5b0f-411f-b0d8-79da4c7d81f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:27.710323 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de29617-5b0f-411f-b0d8-79da4c7d81f0 None admin] RBAC: Adding query filter params (role.id=33cab6a3207a4cd69442cac65e246a23, scope.project.id=3085add0984c4b339583bce0299f7cc3, user.id=6dca511a232e4bd0af0e569bb164c76c) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:27.710716 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de29617-5b0f-411f-b0d8-79da4c7d81f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:27.712498 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de29617-5b0f-411f-b0d8-79da4c7d81f0 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:27.721574 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 100/205] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:50:27 2022] GET /identity/v3/role_assignments?user.id=6dca511a232e4bd0af0e569bb164c76c&scope.project.id=3085add0984c4b339583bce0299f7cc3&role.id=33cab6a3207a4cd69442cac65e246a23 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:27.765085 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 106/206] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:50:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:50:27.770718 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de29617-5b0f-411f-b0d8-79da4c7d81f0 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:27.930055 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de29617-5b0f-411f-b0d8-79da4c7d81f0 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:27.965200 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69f756-c828-453c-83bb-058085654c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:27.966148 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69f756-c828-453c-83bb-058085654c69 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:27.966419 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69f756-c828-453c-83bb-058085654c69 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:27.966683 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69f756-c828-453c-83bb-058085654c69 None admin] PATH_INFO: `/v3/projects/020fd75d07c34b109048207eb8e5fd24` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:27.967889 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae69f756-c828-453c-83bb-058085654c69 None admin] RBAC: Authorizing `identity:get_project(project_id=020fd75d07c34b109048207eb8e5fd24)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:27.969321 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae69f756-c828-453c-83bb-058085654c69 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:27.971022 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 101/207] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:27 2022] GET /identity/v3/projects/020fd75d07c34b109048207eb8e5fd24 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:27.977090 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451d6cd-f33d-4ecc-831f-cb803d13b8ff None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:28.074435 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451d6cd-f33d-4ecc-831f-cb803d13b8ff None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:28.108289 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35327428-ff4e-4512-b8e0-727627702ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:28.108948 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35327428-ff4e-4512-b8e0-727627702ac7 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:28.109217 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35327428-ff4e-4512-b8e0-727627702ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:28.109482 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35327428-ff4e-4512-b8e0-727627702ac7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:28.110295 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35327428-ff4e-4512-b8e0-727627702ac7 None admin] RBAC: Adding query filter params (role.id=60b6ad9d4f6d40b4a37fb5045c7f4523, scope.project.id=020fd75d07c34b109048207eb8e5fd24, user.id=dbd1753be164451a958de92482f594cc) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:28.110596 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35327428-ff4e-4512-b8e0-727627702ac7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:28.112069 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35327428-ff4e-4512-b8e0-727627702ac7 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:28.124030 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 107/208] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:50:27 2022] GET /identity/v3/role_assignments?user.id=dbd1753be164451a958de92482f594cc&scope.project.id=020fd75d07c34b109048207eb8e5fd24&role.id=60b6ad9d4f6d40b4a37fb5045c7f4523 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:29.844051 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0409ee-c9fe-4e3e-85ed-5e8408622e20 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:29.844565 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0409ee-c9fe-4e3e-85ed-5e8408622e20 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:29.844565 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0409ee-c9fe-4e3e-85ed-5e8408622e20 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:29.845971 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 102/209] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:29.851359 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf22e4-e25a-4db2-b726-371055429301 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:29.851793 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf22e4-e25a-4db2-b726-371055429301 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:29.851872 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf22e4-e25a-4db2-b726-371055429301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:29.869405 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-b8bf22e4-e25a-4db2-b726-371055429301 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:29.870595 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-b8bf22e4-e25a-4db2-b726-371055429301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:29.890204 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ddd93-04bf-47a5-bfe2-1e254e0c4452 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:29.890530 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ddd93-04bf-47a5-bfe2-1e254e0c4452 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:29.893570 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ddd93-04bf-47a5-bfe2-1e254e0c4452 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:29.893570 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 103/210] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:50:29.900841 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f6a33-bfaf-40d9-8895-eae7704af63e None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:29.901113 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f6a33-bfaf-40d9-8895-eae7704af63e None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:29.901553 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f6a33-bfaf-40d9-8895-eae7704af63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:29.924288 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-d63f6a33-bfaf-40d9-8895-eae7704af63e None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:29.925488 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-d63f6a33-bfaf-40d9-8895-eae7704af63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:29.942225 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 108/211] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:29.964457 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423135f-8876-405f-902a-3c7d5f1723b6 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:29.964793 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423135f-8876-405f-902a-3c7d5f1723b6 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:29.965377 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423135f-8876-405f-902a-3c7d5f1723b6 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:29.967016 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 109/212] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:50:29.969619 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423135f-8876-405f-902a-3c7d5f1723b6 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:29.992382 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 104/213] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 02:50:29.993679 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e646bc-f98c-4772-980a-9d6f521aa620 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:29.993956 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e646bc-f98c-4772-980a-9d6f521aa620 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:29.994219 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e646bc-f98c-4772-980a-9d6f521aa620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:30.017021 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-07e646bc-f98c-4772-980a-9d6f521aa620 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:30.018804 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-07e646bc-f98c-4772-980a-9d6f521aa620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:30.083477 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423135f-8876-405f-902a-3c7d5f1723b6 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:30.092016 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 105/214] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:30.099952 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e646bc-f98c-4772-980a-9d6f521aa620 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:30.118815 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87985f-9971-4df4-9a13-6e885a3b05c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:30.119716 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87985f-9971-4df4-9a13-6e885a3b05c7 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:30.119934 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87985f-9971-4df4-9a13-6e885a3b05c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:30.120204 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87985f-9971-4df4-9a13-6e885a3b05c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:30.121467 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87985f-9971-4df4-9a13-6e885a3b05c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:30.123234 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87985f-9971-4df4-9a13-6e885a3b05c7 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:30.126310 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 110/215] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:50:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:30.126310 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87985f-9971-4df4-9a13-6e885a3b05c7 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:30.186710 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e646bc-f98c-4772-980a-9d6f521aa620 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:30.220327 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefe2a4-9dd3-47bb-b20e-c2d7327235b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:30.221137 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefe2a4-9dd3-47bb-b20e-c2d7327235b2 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:30.221421 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefe2a4-9dd3-47bb-b20e-c2d7327235b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:30.221690 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefe2a4-9dd3-47bb-b20e-c2d7327235b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:30.223843 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87985f-9971-4df4-9a13-6e885a3b05c7 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:30.232128 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aefe2a4-9dd3-47bb-b20e-c2d7327235b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:30.239210 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-2aefe2a4-9dd3-47bb-b20e-c2d7327235b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 02:50:30.240478 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 106/216] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:50:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:30.241774 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefe2a4-9dd3-47bb-b20e-c2d7327235b2 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:30.272850 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23fda3-ec40-4606-ac63-bc6b1b4a69ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:30.273991 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23fda3-ec40-4606-ac63-bc6b1b4a69ea None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:30.274338 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23fda3-ec40-4606-ac63-bc6b1b4a69ea None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:30.274676 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23fda3-ec40-4606-ac63-bc6b1b4a69ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:30.285730 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c23fda3-ec40-4606-ac63-bc6b1b4a69ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:30.292660 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-7c23fda3-ec40-4606-ac63-bc6b1b4a69ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 02:50:30.294112 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 111/217] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 02:50:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:30.296378 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23fda3-ec40-4606-ac63-bc6b1b4a69ea None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:30.341695 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefe2a4-9dd3-47bb-b20e-c2d7327235b2 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:30.378533 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd440b5-e652-4307-87e6-5ac556bebf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:30.379160 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd440b5-e652-4307-87e6-5ac556bebf49 None admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:30.379434 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd440b5-e652-4307-87e6-5ac556bebf49 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:30.379701 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd440b5-e652-4307-87e6-5ac556bebf49 None admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:30.380441 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd440b5-e652-4307-87e6-5ac556bebf49 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:30.381915 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd440b5-e652-4307-87e6-5ac556bebf49 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:30.394678 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23fda3-ec40-4606-ac63-bc6b1b4a69ea None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:30.404293 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 107/218] 10.222.0.32 () {60 vars in 1132 bytes} [Tue Apr 12 02:50:30 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 02:50:30.405134 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd440b5-e652-4307-87e6-5ac556bebf49 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:30.440326 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b492f-82c6-4ce8-9aff-63d4597e2075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:30.441378 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b492f-82c6-4ce8-9aff-63d4597e2075 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:30.441879 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b492f-82c6-4ce8-9aff-63d4597e2075 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:30.442376 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b492f-82c6-4ce8-9aff-63d4597e2075 None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:30.443347 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b492f-82c6-4ce8-9aff-63d4597e2075 None admin] RBAC: Adding query filter params (name=member) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:30.443883 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b492f-82c6-4ce8-9aff-63d4597e2075 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:30.445517 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b492f-82c6-4ce8-9aff-63d4597e2075 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:30.455316 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 112/219] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 02:50:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:30.457127 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c890f-f744-47ac-82cf-4e876c33d094 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:30.457616 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c890f-f744-47ac-82cf-4e876c33d094 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:30.458079 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c890f-f744-47ac-82cf-4e876c33d094 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:30.459583 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 113/220] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:30.461031 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c890f-f744-47ac-82cf-4e876c33d094 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:30.516262 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd440b5-e652-4307-87e6-5ac556bebf49 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:30.552396 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffdaef4-7267-4ecd-a0f4-082fe6d7d59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:30.553491 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffdaef4-7267-4ecd-a0f4-082fe6d7d59c None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:30.553741 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffdaef4-7267-4ecd-a0f4-082fe6d7d59c None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:30.554048 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffdaef4-7267-4ecd-a0f4-082fe6d7d59c None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:30.554811 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffdaef4-7267-4ecd-a0f4-082fe6d7d59c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:30.555112 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffdaef4-7267-4ecd-a0f4-082fe6d7d59c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:30.556522 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffdaef4-7267-4ecd-a0f4-082fe6d7d59c None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:30.565877 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 108/221] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:50:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:30.567210 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd13c8-c319-4774-bf59-13932d638df7 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:30.567495 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd13c8-c319-4774-bf59-13932d638df7 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:30.567797 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd13c8-c319-4774-bf59-13932d638df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:30.582033 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c890f-f744-47ac-82cf-4e876c33d094 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:30.585420 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-46bd13c8-c319-4774-bf59-13932d638df7 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:30.586673 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-46bd13c8-c319-4774-bf59-13932d638df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:30.624415 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b90c44-a3cc-4054-a8b3-c215ad581fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:30.625325 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b90c44-a3cc-4054-a8b3-c215ad581fa2 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:30.625602 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b90c44-a3cc-4054-a8b3-c215ad581fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:30.625853 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b90c44-a3cc-4054-a8b3-c215ad581fa2 None admin] PATH_INFO: `/v3/users/f84f1d08ad4d4d8ab58efddbc4bf952b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:30.642054 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b90c44-a3cc-4054-a8b3-c215ad581fa2 None admin] RBAC: Authorizing `identity:get_user(user_id=f84f1d08ad4d4d8ab58efddbc4bf952b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:30.643469 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b90c44-a3cc-4054-a8b3-c215ad581fa2 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:30.646347 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 114/222] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:50:30 2022] GET /identity/v3/users/f84f1d08ad4d4d8ab58efddbc4bf952b => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:50:30.646347 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b90c44-a3cc-4054-a8b3-c215ad581fa2 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:30.660569 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 109/223] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:30.661429 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd13c8-c319-4774-bf59-13932d638df7 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:30.757022 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b90c44-a3cc-4054-a8b3-c215ad581fa2 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:30.766485 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd13c8-c319-4774-bf59-13932d638df7 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:30.794423 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6248b6-656f-4f0d-856f-018300833a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:30.795291 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6248b6-656f-4f0d-856f-018300833a02 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:30.795559 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6248b6-656f-4f0d-856f-018300833a02 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:30.795856 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6248b6-656f-4f0d-856f-018300833a02 None admin] PATH_INFO: `/v3/users/dbd1753be164451a958de92482f594cc` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:30.797044 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6248b6-656f-4f0d-856f-018300833a02 None admin] RBAC: Authorizing `identity:get_user(user_id=dbd1753be164451a958de92482f594cc)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:30.798488 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6248b6-656f-4f0d-856f-018300833a02 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:30.799681 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd9b36-856b-4d2b-beaa-5b5f24519552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:30.800140 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 115/224] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:50:30 2022] GET /identity/v3/users/dbd1753be164451a958de92482f594cc => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:30.800639 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd9b36-856b-4d2b-beaa-5b5f24519552 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:30.800912 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd9b36-856b-4d2b-beaa-5b5f24519552 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:30.801015 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6248b6-656f-4f0d-856f-018300833a02 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:30.801173 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd9b36-856b-4d2b-beaa-5b5f24519552 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:30.867194 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd9b36-856b-4d2b-beaa-5b5f24519552 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:30.868676 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd9b36-856b-4d2b-beaa-5b5f24519552 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:30.899139 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6248b6-656f-4f0d-856f-018300833a02 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:30.934497 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2e4c8-2b04-4640-bbd4-aab9fe7652f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:30.935307 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2e4c8-2b04-4640-bbd4-aab9fe7652f7 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:30.935574 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2e4c8-2b04-4640-bbd4-aab9fe7652f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:30.935930 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2e4c8-2b04-4640-bbd4-aab9fe7652f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:30.947893 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2e4c8-2b04-4640-bbd4-aab9fe7652f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:30.957360 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-9ec2e4c8-2b04-4640-bbd4-aab9fe7652f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 02:50:30.959530 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 116/225] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 02:50:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:30.966293 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2e4c8-2b04-4640-bbd4-aab9fe7652f7 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:30.972488 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 110/226] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:50:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:50:30.973405 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd9b36-856b-4d2b-beaa-5b5f24519552 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:31.070410 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd9b36-856b-4d2b-beaa-5b5f24519552 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:31.072747 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2e4c8-2b04-4640-bbd4-aab9fe7652f7 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:31.106347 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba99cc-c322-49ce-815c-c9f409c519ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:31.107054 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba99cc-c322-49ce-815c-c9f409c519ea None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:31.107323 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba99cc-c322-49ce-815c-c9f409c519ea None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:31.107633 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba99cc-c322-49ce-815c-c9f409c519ea None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:31.108412 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba99cc-c322-49ce-815c-c9f409c519ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:31.108753 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba99cc-c322-49ce-815c-c9f409c519ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:31.110123 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba99cc-c322-49ce-815c-c9f409c519ea None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:31.116374 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9da55-f374-4219-bc3f-5fcd4fc3defa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:31.117570 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9da55-f374-4219-bc3f-5fcd4fc3defa None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:31.117845 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9da55-f374-4219-bc3f-5fcd4fc3defa None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:31.118296 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9da55-f374-4219-bc3f-5fcd4fc3defa None admin] PATH_INFO: `/v3/projects/020fd75d07c34b109048207eb8e5fd24` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:31.119551 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 111/227] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:50:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:31.120424 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f9da55-f374-4219-bc3f-5fcd4fc3defa None admin] RBAC: Authorizing `identity:get_project(project_id=020fd75d07c34b109048207eb8e5fd24)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:31.120610 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba99cc-c322-49ce-815c-c9f409c519ea None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:31.122808 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f9da55-f374-4219-bc3f-5fcd4fc3defa None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:31.130915 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 117/228] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:30 2022] GET /identity/v3/projects/020fd75d07c34b109048207eb8e5fd24 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:31.132364 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9da55-f374-4219-bc3f-5fcd4fc3defa None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:31.222135 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba99cc-c322-49ce-815c-c9f409c519ea None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:31.244314 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9da55-f374-4219-bc3f-5fcd4fc3defa None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:31.256740 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6eb541-29f1-460a-81ae-36bfb908f126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:31.257632 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eb541-29f1-460a-81ae-36bfb908f126 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:31.259196 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eb541-29f1-460a-81ae-36bfb908f126 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:31.259465 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eb541-29f1-460a-81ae-36bfb908f126 None admin] PATH_INFO: `/v3/projects/020fd75d07c34b109048207eb8e5fd24` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:31.260821 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6eb541-29f1-460a-81ae-36bfb908f126 None admin] RBAC: Authorizing `identity:get_project(project_id=020fd75d07c34b109048207eb8e5fd24)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:31.262395 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6eb541-29f1-460a-81ae-36bfb908f126 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:31.264161 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 112/229] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:31 2022] GET /identity/v3/projects/020fd75d07c34b109048207eb8e5fd24 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:31.264901 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6eb541-29f1-460a-81ae-36bfb908f126 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:31.288195 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b0267-8c7d-4e3f-a485-3cecb1de8d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:31.289074 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b0267-8c7d-4e3f-a485-3cecb1de8d6b None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:31.289332 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b0267-8c7d-4e3f-a485-3cecb1de8d6b None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:31.289598 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b0267-8c7d-4e3f-a485-3cecb1de8d6b None admin] PATH_INFO: `/v3/users/dbd1753be164451a958de92482f594cc` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:31.290884 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b0267-8c7d-4e3f-a485-3cecb1de8d6b None admin] RBAC: Authorizing `identity:get_user(user_id=dbd1753be164451a958de92482f594cc)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:31.293081 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b0267-8c7d-4e3f-a485-3cecb1de8d6b None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:31.294841 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 118/230] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:50:31 2022] GET /identity/v3/users/dbd1753be164451a958de92482f594cc => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:50:31.300768 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b0267-8c7d-4e3f-a485-3cecb1de8d6b None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:31.369272 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6eb541-29f1-460a-81ae-36bfb908f126 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:31.404724 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf46c9-19ec-420e-8b0f-cd03470d8e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:31.406079 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf46c9-19ec-420e-8b0f-cd03470d8e7f None admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:31.406596 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf46c9-19ec-420e-8b0f-cd03470d8e7f None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:31.407045 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf46c9-19ec-420e-8b0f-cd03470d8e7f None admin] PATH_INFO: `/v3/projects/020fd75d07c34b109048207eb8e5fd24/users/dbd1753be164451a958de92482f594cc/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:31.409388 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf46c9-19ec-420e-8b0f-cd03470d8e7f None admin] RBAC: Authorizing `identity:create_grant(project_id=020fd75d07c34b109048207eb8e5fd24, user_id=dbd1753be164451a958de92482f594cc, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:31.411060 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf46c9-19ec-420e-8b0f-cd03470d8e7f None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:31.414715 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b0267-8c7d-4e3f-a485-3cecb1de8d6b None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:31.426456 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 113/231] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 02:50:31 2022] PUT /identity/v3/projects/020fd75d07c34b109048207eb8e5fd24/users/dbd1753be164451a958de92482f594cc/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 02:50:31.427350 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf46c9-19ec-420e-8b0f-cd03470d8e7f None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:31.505974 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb406a28-dfaa-4dcf-9667-51267f2c5f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:31.507000 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb406a28-dfaa-4dcf-9667-51267f2c5f2a None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:31.507369 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb406a28-dfaa-4dcf-9667-51267f2c5f2a None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:31.507635 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb406a28-dfaa-4dcf-9667-51267f2c5f2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:31.508501 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb406a28-dfaa-4dcf-9667-51267f2c5f2a None admin] RBAC: Adding query filter params (role.id=0a31c1ce37fa41deb4908731f772414b, scope.project.id=020fd75d07c34b109048207eb8e5fd24, user.id=f84f1d08ad4d4d8ab58efddbc4bf952b) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:31.508807 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb406a28-dfaa-4dcf-9667-51267f2c5f2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:31.510394 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb406a28-dfaa-4dcf-9667-51267f2c5f2a None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:31.529695 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 119/232] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:50:31 2022] GET /identity/v3/role_assignments?user.id=f84f1d08ad4d4d8ab58efddbc4bf952b&scope.project.id=020fd75d07c34b109048207eb8e5fd24&role.id=0a31c1ce37fa41deb4908731f772414b => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:31.545873 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf46c9-19ec-420e-8b0f-cd03470d8e7f None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:31.592638 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84350d70-dece-4e19-afff-5b4e460af266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:31.593539 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84350d70-dece-4e19-afff-5b4e460af266 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:31.593807 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84350d70-dece-4e19-afff-5b4e460af266 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:31.594070 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84350d70-dece-4e19-afff-5b4e460af266 None admin] PATH_INFO: `/v3/projects/020fd75d07c34b109048207eb8e5fd24` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:31.600763 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84350d70-dece-4e19-afff-5b4e460af266 None admin] RBAC: Authorizing `identity:get_project(project_id=020fd75d07c34b109048207eb8e5fd24)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:31.602375 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84350d70-dece-4e19-afff-5b4e460af266 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:31.604420 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 114/233] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:31 2022] GET /identity/v3/projects/020fd75d07c34b109048207eb8e5fd24 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:31.611611 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb406a28-dfaa-4dcf-9667-51267f2c5f2a None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:31.759488 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb406a28-dfaa-4dcf-9667-51267f2c5f2a None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:31.796442 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31be0f2-6f07-4e26-8613-fde1c97dc880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:31.797763 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31be0f2-6f07-4e26-8613-fde1c97dc880 None admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:31.798231 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31be0f2-6f07-4e26-8613-fde1c97dc880 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:31.798710 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31be0f2-6f07-4e26-8613-fde1c97dc880 None admin] PATH_INFO: `/v3/projects/020fd75d07c34b109048207eb8e5fd24/users/dbd1753be164451a958de92482f594cc/roles/60b6ad9d4f6d40b4a37fb5045c7f4523` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:31.801302 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31be0f2-6f07-4e26-8613-fde1c97dc880 None admin] RBAC: Authorizing `identity:create_grant(project_id=020fd75d07c34b109048207eb8e5fd24, user_id=dbd1753be164451a958de92482f594cc, role_id=60b6ad9d4f6d40b4a37fb5045c7f4523)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:31.803038 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31be0f2-6f07-4e26-8613-fde1c97dc880 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:31.825217 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 120/234] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 02:50:31 2022] PUT /identity/v3/projects/020fd75d07c34b109048207eb8e5fd24/users/dbd1753be164451a958de92482f594cc/roles/60b6ad9d4f6d40b4a37fb5045c7f4523 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 02:50:33.080887 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0009eb-38bb-4690-8905-fc486afb8f8d None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:33.081407 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0009eb-38bb-4690-8905-fc486afb8f8d None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:33.081481 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0009eb-38bb-4690-8905-fc486afb8f8d None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:33.083205 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 115/235] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:33.089329 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ac6ae-a02d-41d7-8343-2549007bf36b None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:33.090723 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ac6ae-a02d-41d7-8343-2549007bf36b None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:33.091198 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ac6ae-a02d-41d7-8343-2549007bf36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:33.112511 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-609ac6ae-a02d-41d7-8343-2549007bf36b None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:33.114044 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-609ac6ae-a02d-41d7-8343-2549007bf36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:33.201086 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 121/236] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:33.245250 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0009eb-38bb-4690-8905-fc486afb8f8d None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:33.365426 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0009eb-38bb-4690-8905-fc486afb8f8d None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:33.367189 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a15ef-4bd3-48ab-897f-56a501208ce9 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:33.367666 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a15ef-4bd3-48ab-897f-56a501208ce9 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:33.368162 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a15ef-4bd3-48ab-897f-56a501208ce9 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:33.369829 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 122/237] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:50:33.375176 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79d474-48ac-4d71-92f7-81a92ccb635e None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:33.375675 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79d474-48ac-4d71-92f7-81a92ccb635e None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:33.376179 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79d474-48ac-4d71-92f7-81a92ccb635e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:33.403051 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-1f79d474-48ac-4d71-92f7-81a92ccb635e None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:33.404226 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-1f79d474-48ac-4d71-92f7-81a92ccb635e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:33.406405 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36c219-4b7e-4674-8f17-c0d31d7dde8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:33.407211 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36c219-4b7e-4674-8f17-c0d31d7dde8a None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:33.407480 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36c219-4b7e-4674-8f17-c0d31d7dde8a None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:33.407754 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36c219-4b7e-4674-8f17-c0d31d7dde8a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:33.424537 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36c219-4b7e-4674-8f17-c0d31d7dde8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:33.431340 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-1e36c219-4b7e-4674-8f17-c0d31d7dde8a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 12 02:50:33.437020 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 116/238] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:50:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:33.449278 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36c219-4b7e-4674-8f17-c0d31d7dde8a None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:33.489141 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 123/239] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 02:50:33.535926 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79d474-48ac-4d71-92f7-81a92ccb635e None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:33.615380 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36c219-4b7e-4674-8f17-c0d31d7dde8a None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:33.672486 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79d474-48ac-4d71-92f7-81a92ccb635e None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:33.700456 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f6584-4087-45a1-bdcb-75756b8c6005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:33.701131 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f6584-4087-45a1-bdcb-75756b8c6005 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:33.701464 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f6584-4087-45a1-bdcb-75756b8c6005 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:33.701731 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f6584-4087-45a1-bdcb-75756b8c6005 None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:33.702536 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f6584-4087-45a1-bdcb-75756b8c6005 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:33.703172 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f6584-4087-45a1-bdcb-75756b8c6005 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:33.704584 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f6584-4087-45a1-bdcb-75756b8c6005 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:33.709487 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57e3ce-da19-490b-8176-c6721d2b30b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:33.710280 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57e3ce-da19-490b-8176-c6721d2b30b1 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:33.711012 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57e3ce-da19-490b-8176-c6721d2b30b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:33.711289 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57e3ce-da19-490b-8176-c6721d2b30b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:33.717669 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57e3ce-da19-490b-8176-c6721d2b30b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:33.719160 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57e3ce-da19-490b-8176-c6721d2b30b1 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:33.720876 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 124/240] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:50:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:33.723257 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 117/241] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 02:50:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:50:33.728359 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57e3ce-da19-490b-8176-c6721d2b30b1 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:33.730068 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f6584-4087-45a1-bdcb-75756b8c6005 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:33.851594 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f6584-4087-45a1-bdcb-75756b8c6005 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:33.897878 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9fbcc-5856-4134-8e09-3a0930bad317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:33.898764 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9fbcc-5856-4134-8e09-3a0930bad317 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:33.899032 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9fbcc-5856-4134-8e09-3a0930bad317 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:33.899295 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9fbcc-5856-4134-8e09-3a0930bad317 None admin] PATH_INFO: `/v3/users/5a2d70e34d0a4ec9b2532b7a748bc02c` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:33.926280 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9fbcc-5856-4134-8e09-3a0930bad317 None admin] RBAC: Authorizing `identity:get_user(user_id=5a2d70e34d0a4ec9b2532b7a748bc02c)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:33.927658 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9fbcc-5856-4134-8e09-3a0930bad317 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:33.929622 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 118/242] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:50:33 2022] GET /identity/v3/users/5a2d70e34d0a4ec9b2532b7a748bc02c => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:33.936101 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9fbcc-5856-4134-8e09-3a0930bad317 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:33.962165 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57e3ce-da19-490b-8176-c6721d2b30b1 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:34.009329 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd8c86-9e4e-4351-ac14-c1fd26355a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:34.010015 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd8c86-9e4e-4351-ac14-c1fd26355a86 None admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:34.010286 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd8c86-9e4e-4351-ac14-c1fd26355a86 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:34.010551 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd8c86-9e4e-4351-ac14-c1fd26355a86 None admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:34.011252 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd8c86-9e4e-4351-ac14-c1fd26355a86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:34.012799 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd8c86-9e4e-4351-ac14-c1fd26355a86 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:34.052474 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 125/243] 10.222.0.32 () {60 vars in 1132 bytes} [Tue Apr 12 02:50:33 2022] POST /identity/v3/users => generated 293 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 02:50:34.061899 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9fbcc-5856-4134-8e09-3a0930bad317 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:34.108448 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0186426-8a55-4cb5-b267-1f92b2e818dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:34.109311 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0186426-8a55-4cb5-b267-1f92b2e818dd None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:34.109513 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0186426-8a55-4cb5-b267-1f92b2e818dd None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:34.110050 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0186426-8a55-4cb5-b267-1f92b2e818dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:34.194894 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0186426-8a55-4cb5-b267-1f92b2e818dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:34.196414 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0186426-8a55-4cb5-b267-1f92b2e818dd None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:34.257652 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31fee5-e4b1-4870-a440-8f8ee98d7fdc None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:34.258301 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31fee5-e4b1-4870-a440-8f8ee98d7fdc None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:34.258301 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31fee5-e4b1-4870-a440-8f8ee98d7fdc None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:34.259863 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 126/244] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:34.265524 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de15230-4ec0-4782-99f7-fccbeab0c9a2 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:34.265801 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de15230-4ec0-4782-99f7-fccbeab0c9a2 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:34.266070 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de15230-4ec0-4782-99f7-fccbeab0c9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:34.304713 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-5de15230-4ec0-4782-99f7-fccbeab0c9a2 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:34.306336 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 119/245] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:50:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:50:34.306607 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-5de15230-4ec0-4782-99f7-fccbeab0c9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:34.307749 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0186426-8a55-4cb5-b267-1f92b2e818dd None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:34.411878 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0186426-8a55-4cb5-b267-1f92b2e818dd None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:34.423363 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 127/246] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 02:50:34.424788 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b599d9-218f-4400-b92e-6ae3a4f9dd16 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:34.425069 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b599d9-218f-4400-b92e-6ae3a4f9dd16 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:34.425393 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b599d9-218f-4400-b92e-6ae3a4f9dd16 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:34.426854 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 128/247] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:34.432129 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad13dd-b6a2-4c41-9066-960ae8c5efb6 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:34.432456 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad13dd-b6a2-4c41-9066-960ae8c5efb6 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:34.432732 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad13dd-b6a2-4c41-9066-960ae8c5efb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:34.450260 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-b7ad13dd-b6a2-4c41-9066-960ae8c5efb6 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:34.451554 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-b7ad13dd-b6a2-4c41-9066-960ae8c5efb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:34.452702 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af84002-eb02-4e5f-8630-74f2c9d7e3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:34.454163 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af84002-eb02-4e5f-8630-74f2c9d7e3f9 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:34.454662 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af84002-eb02-4e5f-8630-74f2c9d7e3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:34.455121 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af84002-eb02-4e5f-8630-74f2c9d7e3f9 None admin] PATH_INFO: `/v3/projects/020fd75d07c34b109048207eb8e5fd24` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:34.456614 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af84002-eb02-4e5f-8630-74f2c9d7e3f9 None admin] RBAC: Authorizing `identity:get_project(project_id=020fd75d07c34b109048207eb8e5fd24)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:34.458336 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af84002-eb02-4e5f-8630-74f2c9d7e3f9 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:34.460301 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 120/248] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:34 2022] GET /identity/v3/projects/020fd75d07c34b109048207eb8e5fd24 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:50:34.465311 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af84002-eb02-4e5f-8630-74f2c9d7e3f9 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:34.548062 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 129/249] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 02:50:34.548799 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad13dd-b6a2-4c41-9066-960ae8c5efb6 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:34.591451 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af84002-eb02-4e5f-8630-74f2c9d7e3f9 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:34.634126 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27d4dd-1a8d-4811-ab21-917e11305151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:34.635099 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27d4dd-1a8d-4811-ab21-917e11305151 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:34.635475 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27d4dd-1a8d-4811-ab21-917e11305151 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:34.635878 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27d4dd-1a8d-4811-ab21-917e11305151 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:34.646711 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27d4dd-1a8d-4811-ab21-917e11305151 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:34.653875 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-4e27d4dd-1a8d-4811-ab21-917e11305151 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 02:50:34.655416 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 121/250] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 02:50:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:34.656177 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27d4dd-1a8d-4811-ab21-917e11305151 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:34.690341 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad13dd-b6a2-4c41-9066-960ae8c5efb6 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:34.738660 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bf5c0-1163-4e59-a903-83b74632be2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:34.739327 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bf5c0-1163-4e59-a903-83b74632be2e None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:34.739594 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bf5c0-1163-4e59-a903-83b74632be2e None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:34.741254 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bf5c0-1163-4e59-a903-83b74632be2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:34.741745 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8bf5c0-1163-4e59-a903-83b74632be2e None admin] RBAC: Adding query filter params (role.id=33cab6a3207a4cd69442cac65e246a23, scope.project.id=020fd75d07c34b109048207eb8e5fd24, user.id=5a2d70e34d0a4ec9b2532b7a748bc02c) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:34.742047 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8bf5c0-1163-4e59-a903-83b74632be2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:34.744745 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8bf5c0-1163-4e59-a903-83b74632be2e None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:34.751197 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 130/251] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:50:34 2022] GET /identity/v3/role_assignments?user.id=5a2d70e34d0a4ec9b2532b7a748bc02c&scope.project.id=020fd75d07c34b109048207eb8e5fd24&role.id=33cab6a3207a4cd69442cac65e246a23 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:34.751927 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bf5c0-1163-4e59-a903-83b74632be2e None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:34.790332 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27d4dd-1a8d-4811-ab21-917e11305151 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:34.836178 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb7674-2a5d-4c9e-b8df-0954eed79781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:34.837991 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb7674-2a5d-4c9e-b8df-0954eed79781 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:34.838542 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb7674-2a5d-4c9e-b8df-0954eed79781 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:34.839175 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb7674-2a5d-4c9e-b8df-0954eed79781 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:34.854267 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bf5c0-1163-4e59-a903-83b74632be2e None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:34.858865 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb7674-2a5d-4c9e-b8df-0954eed79781 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:34.868147 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-6cbb7674-2a5d-4c9e-b8df-0954eed79781 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 02:50:34.870735 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 122/252] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:50:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:34.877490 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb7674-2a5d-4c9e-b8df-0954eed79781 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:34.907646 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b458d71-aa15-454b-be6b-78d2432cd45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:34.908350 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b458d71-aa15-454b-be6b-78d2432cd45b None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:34.908731 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b458d71-aa15-454b-be6b-78d2432cd45b None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:34.908997 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b458d71-aa15-454b-be6b-78d2432cd45b None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:34.909792 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b458d71-aa15-454b-be6b-78d2432cd45b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:34.910094 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b458d71-aa15-454b-be6b-78d2432cd45b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:34.911484 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b458d71-aa15-454b-be6b-78d2432cd45b None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:34.931610 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 131/253] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:50:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:34.937252 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b458d71-aa15-454b-be6b-78d2432cd45b None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:34.994648 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb7674-2a5d-4c9e-b8df-0954eed79781 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:35.041038 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cfff2-4d2a-44a9-9b67-0b9527c45ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:35.042138 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cfff2-4d2a-44a9-9b67-0b9527c45ca3 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:35.042617 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cfff2-4d2a-44a9-9b67-0b9527c45ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:35.043127 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cfff2-4d2a-44a9-9b67-0b9527c45ca3 None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:35.044520 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62cfff2-4d2a-44a9-9b67-0b9527c45ca3 None admin] RBAC: Adding query filter params (name=member) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:35.045048 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62cfff2-4d2a-44a9-9b67-0b9527c45ca3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:35.046673 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62cfff2-4d2a-44a9-9b67-0b9527c45ca3 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:35.057014 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 123/254] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 02:50:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:50:35.068806 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cfff2-4d2a-44a9-9b67-0b9527c45ca3 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:35.150635 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b458d71-aa15-454b-be6b-78d2432cd45b None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:35.225827 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff924a9-24e1-4763-9c81-732b391788ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:35.225827 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff924a9-24e1-4763-9c81-732b391788ac None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:35.225827 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff924a9-24e1-4763-9c81-732b391788ac None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:35.225827 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff924a9-24e1-4763-9c81-732b391788ac None admin] PATH_INFO: `/v3/users/dbd1753be164451a958de92482f594cc` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:35.229666 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff924a9-24e1-4763-9c81-732b391788ac None admin] RBAC: Authorizing `identity:get_user(user_id=dbd1753be164451a958de92482f594cc)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:35.231228 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff924a9-24e1-4763-9c81-732b391788ac None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:35.234088 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 132/255] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:50:34 2022] GET /identity/v3/users/dbd1753be164451a958de92482f594cc => generated 283 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:50:35.253332 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff924a9-24e1-4763-9c81-732b391788ac None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:35.275403 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cfff2-4d2a-44a9-9b67-0b9527c45ca3 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:35.322595 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425178fd-6be3-4e23-9c38-9196743a91d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:35.323528 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425178fd-6be3-4e23-9c38-9196743a91d2 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:35.327492 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425178fd-6be3-4e23-9c38-9196743a91d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:35.328186 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425178fd-6be3-4e23-9c38-9196743a91d2 None admin] PATH_INFO: `/v3/users/f84f1d08ad4d4d8ab58efddbc4bf952b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:35.331288 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425178fd-6be3-4e23-9c38-9196743a91d2 None admin] RBAC: Authorizing `identity:get_user(user_id=f84f1d08ad4d4d8ab58efddbc4bf952b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:35.332804 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425178fd-6be3-4e23-9c38-9196743a91d2 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:35.336002 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 124/256] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:50:35 2022] GET /identity/v3/users/f84f1d08ad4d4d8ab58efddbc4bf952b => generated 297 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:50:35.338552 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e31742-0c70-49df-b096-14c84a11d4d0 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:35.338834 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e31742-0c70-49df-b096-14c84a11d4d0 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:35.339104 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e31742-0c70-49df-b096-14c84a11d4d0 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:35.344896 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 125/257] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:35.345741 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e31742-0c70-49df-b096-14c84a11d4d0 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:35.463845 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff924a9-24e1-4763-9c81-732b391788ac None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:35.506703 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e31742-0c70-49df-b096-14c84a11d4d0 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:35.519305 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37caf1-a9d4-4097-a42a-1a2ad76cd233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:35.520320 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37caf1-a9d4-4097-a42a-1a2ad76cd233 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:35.520783 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37caf1-a9d4-4097-a42a-1a2ad76cd233 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:35.521258 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37caf1-a9d4-4097-a42a-1a2ad76cd233 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:35.566917 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a58b41-3f42-4ee0-b75b-71b370a8c693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:35.568169 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a58b41-3f42-4ee0-b75b-71b370a8c693 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:35.568984 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a58b41-3f42-4ee0-b75b-71b370a8c693 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:35.569701 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a58b41-3f42-4ee0-b75b-71b370a8c693 None admin] PATH_INFO: `/v3/projects/020fd75d07c34b109048207eb8e5fd24` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:35.572771 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a58b41-3f42-4ee0-b75b-71b370a8c693 None admin] RBAC: Authorizing `identity:get_project(project_id=020fd75d07c34b109048207eb8e5fd24)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:35.575209 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a58b41-3f42-4ee0-b75b-71b370a8c693 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:35.580720 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 126/258] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:35 2022] GET /identity/v3/projects/020fd75d07c34b109048207eb8e5fd24 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:35.583636 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86258e1e-11dd-415a-a879-0d806331b9d9 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:35.584151 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86258e1e-11dd-415a-a879-0d806331b9d9 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:35.587569 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86258e1e-11dd-415a-a879-0d806331b9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:35.614560 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-86258e1e-11dd-415a-a879-0d806331b9d9 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:35.616741 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-86258e1e-11dd-415a-a879-0d806331b9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:35.639597 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37caf1-a9d4-4097-a42a-1a2ad76cd233 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:35.641086 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37caf1-a9d4-4097-a42a-1a2ad76cd233 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:35.720113 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 127/259] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:35.720959 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86258e1e-11dd-415a-a879-0d806331b9d9 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:35.817884 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86258e1e-11dd-415a-a879-0d806331b9d9 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:35.841967 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 133/260] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:50:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 12 02:50:35.842845 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37caf1-a9d4-4097-a42a-1a2ad76cd233 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:35.856496 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe24a4-fe6d-4a77-8fd1-8d7675d746b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:35.857398 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe24a4-fe6d-4a77-8fd1-8d7675d746b9 None admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:35.857668 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe24a4-fe6d-4a77-8fd1-8d7675d746b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:35.857934 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe24a4-fe6d-4a77-8fd1-8d7675d746b9 None admin] PATH_INFO: `/v3/projects/020fd75d07c34b109048207eb8e5fd24/users/f84f1d08ad4d4d8ab58efddbc4bf952b/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:35.859959 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe24a4-fe6d-4a77-8fd1-8d7675d746b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=020fd75d07c34b109048207eb8e5fd24, user_id=f84f1d08ad4d4d8ab58efddbc4bf952b, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:35.861423 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe24a4-fe6d-4a77-8fd1-8d7675d746b9 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:35.877332 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 128/261] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 02:50:35 2022] PUT /identity/v3/projects/020fd75d07c34b109048207eb8e5fd24/users/f84f1d08ad4d4d8ab58efddbc4bf952b/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 02:50:35.878412 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe24a4-fe6d-4a77-8fd1-8d7675d746b9 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:35.996268 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe24a4-fe6d-4a77-8fd1-8d7675d746b9 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:36.034377 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98d3f2-b5ad-40ed-bcc3-47d281bcd381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:36.035406 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98d3f2-b5ad-40ed-bcc3-47d281bcd381 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:36.035686 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98d3f2-b5ad-40ed-bcc3-47d281bcd381 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:36.035991 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98d3f2-b5ad-40ed-bcc3-47d281bcd381 None admin] PATH_INFO: `/v3/projects/020fd75d07c34b109048207eb8e5fd24` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:36.037204 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98d3f2-b5ad-40ed-bcc3-47d281bcd381 None admin] RBAC: Authorizing `identity:get_project(project_id=020fd75d07c34b109048207eb8e5fd24)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:36.038645 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98d3f2-b5ad-40ed-bcc3-47d281bcd381 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:36.040404 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 129/262] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:35 2022] GET /identity/v3/projects/020fd75d07c34b109048207eb8e5fd24 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:36.047366 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98d3f2-b5ad-40ed-bcc3-47d281bcd381 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:36.065656 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37caf1-a9d4-4097-a42a-1a2ad76cd233 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:36.152595 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f17ec-962f-46d0-9c6a-220ac479755b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:36.153327 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f17ec-962f-46d0-9c6a-220ac479755b None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:36.153604 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f17ec-962f-46d0-9c6a-220ac479755b None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:36.153870 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f17ec-962f-46d0-9c6a-220ac479755b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:36.157262 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98d3f2-b5ad-40ed-bcc3-47d281bcd381 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:36.184819 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f17ec-962f-46d0-9c6a-220ac479755b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:36.192270 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-c98f17ec-962f-46d0-9c6a-220ac479755b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 02:50:36.193533 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 134/263] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 02:50:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:36.194333 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0736c95-4b3a-491c-872d-f227f0994fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:36.195108 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0736c95-4b3a-491c-872d-f227f0994fbe None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:36.195388 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0736c95-4b3a-491c-872d-f227f0994fbe None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:36.195653 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0736c95-4b3a-491c-872d-f227f0994fbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:36.196576 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0736c95-4b3a-491c-872d-f227f0994fbe None admin] RBAC: Adding query filter params (role.id=c0f19d3800f44637822d5162ffe4b497, scope.project.id=020fd75d07c34b109048207eb8e5fd24, user.id=dbd1753be164451a958de92482f594cc) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:36.196881 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0736c95-4b3a-491c-872d-f227f0994fbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:36.198380 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0736c95-4b3a-491c-872d-f227f0994fbe None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:36.204976 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f17ec-962f-46d0-9c6a-220ac479755b None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:36.205483 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 130/264] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:50:36 2022] GET /identity/v3/role_assignments?user.id=dbd1753be164451a958de92482f594cc&scope.project.id=020fd75d07c34b109048207eb8e5fd24&role.id=c0f19d3800f44637822d5162ffe4b497 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:50:36.329323 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f17ec-962f-46d0-9c6a-220ac479755b None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:36.374784 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c33742-c7d6-4580-8de5-7811e6850b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:36.375461 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c33742-c7d6-4580-8de5-7811e6850b67 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:36.375746 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c33742-c7d6-4580-8de5-7811e6850b67 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:36.376010 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c33742-c7d6-4580-8de5-7811e6850b67 None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:36.376789 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c33742-c7d6-4580-8de5-7811e6850b67 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:36.377085 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c33742-c7d6-4580-8de5-7811e6850b67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:36.378507 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c33742-c7d6-4580-8de5-7811e6850b67 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:36.391402 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 135/265] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:50:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:50:36.398442 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0736c95-4b3a-491c-872d-f227f0994fbe None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:36.533608 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0736c95-4b3a-491c-872d-f227f0994fbe None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:36.573396 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a7846-9b0e-4ca9-af2f-8970797562c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:36.574372 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a7846-9b0e-4ca9-af2f-8970797562c3 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:36.574654 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a7846-9b0e-4ca9-af2f-8970797562c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:36.574934 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a7846-9b0e-4ca9-af2f-8970797562c3 None admin] PATH_INFO: `/v3/users/dbd1753be164451a958de92482f594cc` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:36.580490 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a7846-9b0e-4ca9-af2f-8970797562c3 None admin] RBAC: Authorizing `identity:get_user(user_id=dbd1753be164451a958de92482f594cc)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:36.582006 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a7846-9b0e-4ca9-af2f-8970797562c3 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:36.583753 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 131/266] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:50:36 2022] GET /identity/v3/users/dbd1753be164451a958de92482f594cc => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:36.589752 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c33742-c7d6-4580-8de5-7811e6850b67 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:36.750763 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c33742-c7d6-4580-8de5-7811e6850b67 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:36.787500 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241528bf-87dd-4eb8-bec8-c73d971f6870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:36.788141 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241528bf-87dd-4eb8-bec8-c73d971f6870 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:36.788406 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241528bf-87dd-4eb8-bec8-c73d971f6870 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:36.788672 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241528bf-87dd-4eb8-bec8-c73d971f6870 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:36.869908 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241528bf-87dd-4eb8-bec8-c73d971f6870 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:36.871435 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241528bf-87dd-4eb8-bec8-c73d971f6870 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:36.993081 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 136/267] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:50:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:50:36.998882 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a7846-9b0e-4ca9-af2f-8970797562c3 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:37.116788 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a7846-9b0e-4ca9-af2f-8970797562c3 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:37.149608 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819cac6-f488-4c0b-b66e-82b5b75994ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:37.150462 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819cac6-f488-4c0b-b66e-82b5b75994ab None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:37.150731 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819cac6-f488-4c0b-b66e-82b5b75994ab None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:37.150998 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819cac6-f488-4c0b-b66e-82b5b75994ab None admin] PATH_INFO: `/v3/projects/020fd75d07c34b109048207eb8e5fd24` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:37.152268 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d819cac6-f488-4c0b-b66e-82b5b75994ab None admin] RBAC: Authorizing `identity:get_project(project_id=020fd75d07c34b109048207eb8e5fd24)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:37.153716 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d819cac6-f488-4c0b-b66e-82b5b75994ab None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:37.155458 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 132/268] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:36 2022] GET /identity/v3/projects/020fd75d07c34b109048207eb8e5fd24 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:37.161666 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241528bf-87dd-4eb8-bec8-c73d971f6870 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:37.262346 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff93a60-1a86-4995-a481-bbfc69427e6b None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:37.262940 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff93a60-1a86-4995-a481-bbfc69427e6b None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:37.263383 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff93a60-1a86-4995-a481-bbfc69427e6b None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:37.265462 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 133/269] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:50:37.272494 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab23d5-5f80-459e-8e6e-28f0476fb57c None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:37.273006 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab23d5-5f80-459e-8e6e-28f0476fb57c None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:37.273452 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab23d5-5f80-459e-8e6e-28f0476fb57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:37.291933 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241528bf-87dd-4eb8-bec8-c73d971f6870 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:37.293286 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-94ab23d5-5f80-459e-8e6e-28f0476fb57c None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:37.295668 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-94ab23d5-5f80-459e-8e6e-28f0476fb57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:37.350752 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb91038-5efa-4f79-a865-0c995e05dbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:37.352276 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb91038-5efa-4f79-a865-0c995e05dbf4 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:37.352887 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb91038-5efa-4f79-a865-0c995e05dbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:37.353921 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb91038-5efa-4f79-a865-0c995e05dbf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:37.355578 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb91038-5efa-4f79-a865-0c995e05dbf4 None admin] RBAC: Adding query filter params (role.id=60b6ad9d4f6d40b4a37fb5045c7f4523, scope.project.id=020fd75d07c34b109048207eb8e5fd24, user.id=dbd1753be164451a958de92482f594cc) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:37.356926 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb91038-5efa-4f79-a865-0c995e05dbf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:37.359108 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb91038-5efa-4f79-a865-0c995e05dbf4 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:37.373401 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 137/270] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:50:37 2022] GET /identity/v3/role_assignments?user.id=dbd1753be164451a958de92482f594cc&scope.project.id=020fd75d07c34b109048207eb8e5fd24&role.id=60b6ad9d4f6d40b4a37fb5045c7f4523 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:37.413624 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 134/271] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 02:50:37.445232 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb91038-5efa-4f79-a865-0c995e05dbf4 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:37.554475 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb91038-5efa-4f79-a865-0c995e05dbf4 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:37.567017 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57dd0b-00d8-40d3-86d2-2173ddbd6f38 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:37.567324 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57dd0b-00d8-40d3-86d2-2173ddbd6f38 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:37.567566 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57dd0b-00d8-40d3-86d2-2173ddbd6f38 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:37.569130 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 135/272] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:50:37.574899 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60530a1f-5e05-4929-a0be-edc8b5de3cc6 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:37.575620 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60530a1f-5e05-4929-a0be-edc8b5de3cc6 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:37.576551 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60530a1f-5e05-4929-a0be-edc8b5de3cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:37.610653 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-60530a1f-5e05-4929-a0be-edc8b5de3cc6 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:37.611881 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-60530a1f-5e05-4929-a0be-edc8b5de3cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:37.618171 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d94ae-db53-46fd-80a6-b0b283d9ae6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:37.618985 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d94ae-db53-46fd-80a6-b0b283d9ae6c None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:37.619260 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d94ae-db53-46fd-80a6-b0b283d9ae6c None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:37.619526 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d94ae-db53-46fd-80a6-b0b283d9ae6c None admin] PATH_INFO: `/v3/roles/member` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:37.640418 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d94ae-db53-46fd-80a6-b0b283d9ae6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:37.648407 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-193d94ae-db53-46fd-80a6-b0b283d9ae6c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 02:50:37.648670 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 138/273] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:50:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:37.654335 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d94ae-db53-46fd-80a6-b0b283d9ae6c None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:37.721852 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 136/274] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 02:50:37.747556 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60530a1f-5e05-4929-a0be-edc8b5de3cc6 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:37.776781 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d94ae-db53-46fd-80a6-b0b283d9ae6c None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:37.819359 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671dc58-3b55-4579-aadc-e1dd18d6d3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:37.820969 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671dc58-3b55-4579-aadc-e1dd18d6d3e5 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:37.821448 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671dc58-3b55-4579-aadc-e1dd18d6d3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:37.821892 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671dc58-3b55-4579-aadc-e1dd18d6d3e5 None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:37.823239 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671dc58-3b55-4579-aadc-e1dd18d6d3e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:37.824024 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671dc58-3b55-4579-aadc-e1dd18d6d3e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:37.825651 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671dc58-3b55-4579-aadc-e1dd18d6d3e5 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:37.843063 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 139/275] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 02:50:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:50:37.850299 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671dc58-3b55-4579-aadc-e1dd18d6d3e5 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:37.869550 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60530a1f-5e05-4929-a0be-edc8b5de3cc6 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:37.913265 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7b8fd-458a-4052-a9f8-564c94e7649f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:37.914264 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7b8fd-458a-4052-a9f8-564c94e7649f None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:37.914539 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7b8fd-458a-4052-a9f8-564c94e7649f None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:37.914808 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7b8fd-458a-4052-a9f8-564c94e7649f None admin] PATH_INFO: `/v3/domains/default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:37.916691 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7b8fd-458a-4052-a9f8-564c94e7649f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:37.918451 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7b8fd-458a-4052-a9f8-564c94e7649f None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:37.920424 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 137/276] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:50:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:37.921633 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27679abe-3976-4116-b90e-b9c5e1474d83 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:37.921912 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27679abe-3976-4116-b90e-b9c5e1474d83 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:37.922182 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27679abe-3976-4116-b90e-b9c5e1474d83 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:37.923418 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 138/277] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:37.928729 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27679abe-3976-4116-b90e-b9c5e1474d83 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:37.966000 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671dc58-3b55-4579-aadc-e1dd18d6d3e5 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:38.003423 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cddfa-1820-42d8-9f22-b6f27fb00731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:38.004340 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cddfa-1820-42d8-9f22-b6f27fb00731 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:38.004620 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cddfa-1820-42d8-9f22-b6f27fb00731 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:38.004890 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cddfa-1820-42d8-9f22-b6f27fb00731 None admin] PATH_INFO: `/v3/users/1fe30478781d4ef5a9b4907139c55081` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:38.017991 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6cddfa-1820-42d8-9f22-b6f27fb00731 None admin] RBAC: Authorizing `identity:get_user(user_id=1fe30478781d4ef5a9b4907139c55081)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:38.019419 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6cddfa-1820-42d8-9f22-b6f27fb00731 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:38.025883 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 140/278] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:50:37 2022] GET /identity/v3/users/1fe30478781d4ef5a9b4907139c55081 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:50:38.025883 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251e9db-e00d-406f-9b5d-edafedb45ffa None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:38.025883 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251e9db-e00d-406f-9b5d-edafedb45ffa None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:38.025883 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251e9db-e00d-406f-9b5d-edafedb45ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:38.039260 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-f251e9db-e00d-406f-9b5d-edafedb45ffa None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:38.040677 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-f251e9db-e00d-406f-9b5d-edafedb45ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:38.041803 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27679abe-3976-4116-b90e-b9c5e1474d83 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:38.074125 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3774d86-e353-454a-9d61-293854feaeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:38.075830 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3774d86-e353-454a-9d61-293854feaeda None admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:38.076317 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3774d86-e353-454a-9d61-293854feaeda None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:38.076777 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3774d86-e353-454a-9d61-293854feaeda None admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:38.077696 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3774d86-e353-454a-9d61-293854feaeda None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:38.079667 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3774d86-e353-454a-9d61-293854feaeda None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:38.101601 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 139/279] 10.222.0.32 () {60 vars in 1132 bytes} [Tue Apr 12 02:50:37 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 02:50:38.111998 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 141/280] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:38.111998 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251e9db-e00d-406f-9b5d-edafedb45ffa None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:38.133410 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3774d86-e353-454a-9d61-293854feaeda None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:38.243883 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3774d86-e353-454a-9d61-293854feaeda None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:38.254105 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251e9db-e00d-406f-9b5d-edafedb45ffa None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:38.288732 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019a81a-e188-4b1c-9b47-25a1a7ccbd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:38.289547 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019a81a-e188-4b1c-9b47-25a1a7ccbd4c None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:38.289836 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019a81a-e188-4b1c-9b47-25a1a7ccbd4c None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:38.290092 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019a81a-e188-4b1c-9b47-25a1a7ccbd4c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:38.291490 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be790c57-a55e-46f9-bb04-9c55bc405e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:38.292438 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be790c57-a55e-46f9-bb04-9c55bc405e2c None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:38.292931 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be790c57-a55e-46f9-bb04-9c55bc405e2c None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:38.293470 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be790c57-a55e-46f9-bb04-9c55bc405e2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:38.294554 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be790c57-a55e-46f9-bb04-9c55bc405e2c None admin] RBAC: Adding query filter params (role.id=0a31c1ce37fa41deb4908731f772414b, user.id=1fe30478781d4ef5a9b4907139c55081, scope.system=all) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:38.295148 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be790c57-a55e-46f9-bb04-9c55bc405e2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:38.296843 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be790c57-a55e-46f9-bb04-9c55bc405e2c None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:38.302641 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019a81a-e188-4b1c-9b47-25a1a7ccbd4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:38.303443 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 142/281] 10.222.0.32 () {56 vars in 1308 bytes} [Tue Apr 12 02:50:38 2022] GET /identity/v3/role_assignments?user.id=1fe30478781d4ef5a9b4907139c55081&scope.system=all&role.id=0a31c1ce37fa41deb4908731f772414b => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:38.310583 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-c019a81a-e188-4b1c-9b47-25a1a7ccbd4c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 12 02:50:38.312161 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 140/282] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:50:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:50:38.318384 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be790c57-a55e-46f9-bb04-9c55bc405e2c None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:38.430117 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be790c57-a55e-46f9-bb04-9c55bc405e2c None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:38.473395 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e2823-7e9b-4298-bb61-8669f741a56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:38.474079 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e2823-7e9b-4298-bb61-8669f741a56a None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:38.474357 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e2823-7e9b-4298-bb61-8669f741a56a None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:38.474663 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e2823-7e9b-4298-bb61-8669f741a56a None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:38.475378 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e2823-7e9b-4298-bb61-8669f741a56a None admin] RBAC: Adding query filter params (name=reader) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:38.475676 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e2823-7e9b-4298-bb61-8669f741a56a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:38.477108 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e2823-7e9b-4298-bb61-8669f741a56a None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:38.487804 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 143/283] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 02:50:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:38.495260 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019a81a-e188-4b1c-9b47-25a1a7ccbd4c None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:38.603979 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019a81a-e188-4b1c-9b47-25a1a7ccbd4c None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:38.642532 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02017a6c-413a-4a34-9afe-29e0b8af2674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:38.643430 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02017a6c-413a-4a34-9afe-29e0b8af2674 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:38.643705 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02017a6c-413a-4a34-9afe-29e0b8af2674 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:38.644003 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02017a6c-413a-4a34-9afe-29e0b8af2674 None admin] PATH_INFO: `/v3/users/5a2d70e34d0a4ec9b2532b7a748bc02c` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:38.646003 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02017a6c-413a-4a34-9afe-29e0b8af2674 None admin] RBAC: Authorizing `identity:get_user(user_id=5a2d70e34d0a4ec9b2532b7a748bc02c)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:38.647462 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02017a6c-413a-4a34-9afe-29e0b8af2674 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:38.650404 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 141/284] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:50:38 2022] GET /identity/v3/users/5a2d70e34d0a4ec9b2532b7a748bc02c => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:38.655196 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e2823-7e9b-4298-bb61-8669f741a56a None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:38.778968 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e2823-7e9b-4298-bb61-8669f741a56a None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:38.812054 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d21c41-b22f-4bfb-92ba-079aac9fcc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:38.812921 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d21c41-b22f-4bfb-92ba-079aac9fcc42 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:38.813192 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d21c41-b22f-4bfb-92ba-079aac9fcc42 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:38.813456 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d21c41-b22f-4bfb-92ba-079aac9fcc42 None admin] PATH_INFO: `/v3/projects/020fd75d07c34b109048207eb8e5fd24` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:38.814620 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d21c41-b22f-4bfb-92ba-079aac9fcc42 None admin] RBAC: Authorizing `identity:get_project(project_id=020fd75d07c34b109048207eb8e5fd24)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:38.816203 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d21c41-b22f-4bfb-92ba-079aac9fcc42 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:38.818194 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 144/285] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:38 2022] GET /identity/v3/projects/020fd75d07c34b109048207eb8e5fd24 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:38.823833 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02017a6c-413a-4a34-9afe-29e0b8af2674 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:38.947707 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02017a6c-413a-4a34-9afe-29e0b8af2674 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:38.980184 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc756de7-8cb0-429c-9212-aef9acb60924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:38.981241 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc756de7-8cb0-429c-9212-aef9acb60924 None admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:38.981509 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc756de7-8cb0-429c-9212-aef9acb60924 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:38.981771 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc756de7-8cb0-429c-9212-aef9acb60924 None admin] PATH_INFO: `/v3/projects/020fd75d07c34b109048207eb8e5fd24/users/5a2d70e34d0a4ec9b2532b7a748bc02c/roles/33cab6a3207a4cd69442cac65e246a23` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:38.983714 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc756de7-8cb0-429c-9212-aef9acb60924 None admin] RBAC: Authorizing `identity:create_grant(project_id=020fd75d07c34b109048207eb8e5fd24, user_id=5a2d70e34d0a4ec9b2532b7a748bc02c, role_id=33cab6a3207a4cd69442cac65e246a23)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:38.985185 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc756de7-8cb0-429c-9212-aef9acb60924 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:39.002612 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 142/286] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 02:50:38 2022] PUT /identity/v3/projects/020fd75d07c34b109048207eb8e5fd24/users/5a2d70e34d0a4ec9b2532b7a748bc02c/roles/33cab6a3207a4cd69442cac65e246a23 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 02:50:39.157030 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8124eae-4ba3-4a5f-8b72-7f626e7c40f9 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:39.157369 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8124eae-4ba3-4a5f-8b72-7f626e7c40f9 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:39.157540 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8124eae-4ba3-4a5f-8b72-7f626e7c40f9 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:39.159137 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 145/287] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:39.174025 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0cddb0-fae5-4163-a4a4-7898547b586f None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:39.174354 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0cddb0-fae5-4163-a4a4-7898547b586f None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:39.174555 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0cddb0-fae5-4163-a4a4-7898547b586f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:39.211061 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-eb0cddb0-fae5-4163-a4a4-7898547b586f None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:39.212256 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-eb0cddb0-fae5-4163-a4a4-7898547b586f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:39.350451 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 143/288] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 02:50:39.376246 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8124eae-4ba3-4a5f-8b72-7f626e7c40f9 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:39.483661 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8124eae-4ba3-4a5f-8b72-7f626e7c40f9 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:39.518793 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae663c-992c-436a-aac8-cba92b1c2769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:39.518991 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae663c-992c-436a-aac8-cba92b1c2769 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:39.519198 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae663c-992c-436a-aac8-cba92b1c2769 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:39.519742 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae663c-992c-436a-aac8-cba92b1c2769 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:39.530645 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae663c-992c-436a-aac8-cba92b1c2769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:39.537551 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-38ae663c-992c-436a-aac8-cba92b1c2769 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 02:50:39.539073 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 146/289] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:50:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:39.545398 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0cddb0-fae5-4163-a4a4-7898547b586f None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:39.644717 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0cddb0-fae5-4163-a4a4-7898547b586f None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:39.679358 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929117f5-eef4-4fce-ba5d-951aec289c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:39.680128 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929117f5-eef4-4fce-ba5d-951aec289c38 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:39.680403 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929117f5-eef4-4fce-ba5d-951aec289c38 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:39.680672 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929117f5-eef4-4fce-ba5d-951aec289c38 None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:39.681439 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929117f5-eef4-4fce-ba5d-951aec289c38 None admin] RBAC: Adding query filter params (name=member) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:39.681738 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929117f5-eef4-4fce-ba5d-951aec289c38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:39.683166 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929117f5-eef4-4fce-ba5d-951aec289c38 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:39.693255 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 144/290] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 02:50:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:39.699289 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae663c-992c-436a-aac8-cba92b1c2769 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:39.879002 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae663c-992c-436a-aac8-cba92b1c2769 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:39.930325 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51bed7-26bb-484c-ba9f-1ab16b348d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:39.931932 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51bed7-26bb-484c-ba9f-1ab16b348d32 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:39.932606 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51bed7-26bb-484c-ba9f-1ab16b348d32 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:39.933259 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51bed7-26bb-484c-ba9f-1ab16b348d32 None admin] PATH_INFO: `/v3/users/f84f1d08ad4d4d8ab58efddbc4bf952b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:39.940649 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51bed7-26bb-484c-ba9f-1ab16b348d32 None admin] RBAC: Authorizing `identity:get_user(user_id=f84f1d08ad4d4d8ab58efddbc4bf952b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:39.942771 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51bed7-26bb-484c-ba9f-1ab16b348d32 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:39.945091 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 147/291] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:50:39 2022] GET /identity/v3/users/f84f1d08ad4d4d8ab58efddbc4bf952b => generated 297 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:39.950885 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929117f5-eef4-4fce-ba5d-951aec289c38 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:40.091713 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929117f5-eef4-4fce-ba5d-951aec289c38 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:40.140570 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754690d-2bd7-4202-8c2b-7eb3fdde71b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:40.141155 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754690d-2bd7-4202-8c2b-7eb3fdde71b6 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:40.141430 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754690d-2bd7-4202-8c2b-7eb3fdde71b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:40.141707 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754690d-2bd7-4202-8c2b-7eb3fdde71b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:40.221926 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754690d-2bd7-4202-8c2b-7eb3fdde71b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:40.223364 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754690d-2bd7-4202-8c2b-7eb3fdde71b6 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:40.346948 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 145/292] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:50:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:50:40.352277 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51bed7-26bb-484c-ba9f-1ab16b348d32 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:40.498199 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51bed7-26bb-484c-ba9f-1ab16b348d32 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:40.552338 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1361c2-bd66-49e1-9a57-d42bc81ac77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:40.553590 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1361c2-bd66-49e1-9a57-d42bc81ac77a None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:40.554064 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1361c2-bd66-49e1-9a57-d42bc81ac77a None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:40.554528 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1361c2-bd66-49e1-9a57-d42bc81ac77a None admin] PATH_INFO: `/v3/projects/020fd75d07c34b109048207eb8e5fd24` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:40.560455 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1361c2-bd66-49e1-9a57-d42bc81ac77a None admin] RBAC: Authorizing `identity:get_project(project_id=020fd75d07c34b109048207eb8e5fd24)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:40.562175 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1361c2-bd66-49e1-9a57-d42bc81ac77a None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:40.564138 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 148/293] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:40 2022] GET /identity/v3/projects/020fd75d07c34b109048207eb8e5fd24 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:40.569977 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754690d-2bd7-4202-8c2b-7eb3fdde71b6 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:40.724660 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754690d-2bd7-4202-8c2b-7eb3fdde71b6 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:40.774021 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd7f7e-3660-4f0a-bfae-d08cf378c436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:40.774607 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd7f7e-3660-4f0a-bfae-d08cf378c436 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:40.774876 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd7f7e-3660-4f0a-bfae-d08cf378c436 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:40.775139 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd7f7e-3660-4f0a-bfae-d08cf378c436 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:40.776004 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd7f7e-3660-4f0a-bfae-d08cf378c436 None admin] RBAC: Adding query filter params (role.id=0a31c1ce37fa41deb4908731f772414b, scope.project.id=020fd75d07c34b109048207eb8e5fd24, user.id=f84f1d08ad4d4d8ab58efddbc4bf952b) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:40.776382 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd7f7e-3660-4f0a-bfae-d08cf378c436 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:40.777870 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd7f7e-3660-4f0a-bfae-d08cf378c436 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:40.788224 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 146/294] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:50:40 2022] GET /identity/v3/role_assignments?user.id=f84f1d08ad4d4d8ab58efddbc4bf952b&scope.project.id=020fd75d07c34b109048207eb8e5fd24&role.id=0a31c1ce37fa41deb4908731f772414b => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:41.243205 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b9e45-6542-4f2f-b3c7-45cba5adac01 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:41.244264 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b9e45-6542-4f2f-b3c7-45cba5adac01 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:41.244778 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b9e45-6542-4f2f-b3c7-45cba5adac01 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:41.246916 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 149/295] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:41.252808 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac6b0e-7ae5-49b9-9755-864b9b7c70b7 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:41.253086 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac6b0e-7ae5-49b9-9755-864b9b7c70b7 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:41.253351 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac6b0e-7ae5-49b9-9755-864b9b7c70b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:41.274200 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-edac6b0e-7ae5-49b9-9755-864b9b7c70b7 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:41.275389 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-edac6b0e-7ae5-49b9-9755-864b9b7c70b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:41.292587 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d4ac7-0489-49f5-b9a5-c26c3f83005d None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:41.293254 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d4ac7-0489-49f5-b9a5-c26c3f83005d None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:41.293724 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d4ac7-0489-49f5-b9a5-c26c3f83005d None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:41.295640 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 150/296] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:41.301683 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22fcab-aa7d-46c6-8c58-2caf63486f73 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:41.302242 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22fcab-aa7d-46c6-8c58-2caf63486f73 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:41.302712 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22fcab-aa7d-46c6-8c58-2caf63486f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:41.326440 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-4f22fcab-aa7d-46c6-8c58-2caf63486f73 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:41.328356 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-4f22fcab-aa7d-46c6-8c58-2caf63486f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:41.351849 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 147/297] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:41.377635 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac6b0e-7ae5-49b9-9755-864b9b7c70b7 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:41.403487 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 151/298] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:41.425716 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22fcab-aa7d-46c6-8c58-2caf63486f73 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:41.491253 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac6b0e-7ae5-49b9-9755-864b9b7c70b7 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:41.531704 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22fcab-aa7d-46c6-8c58-2caf63486f73 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:41.537089 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec4eb1-c981-46fc-8d36-0d0cf61c99f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:41.538150 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec4eb1-c981-46fc-8d36-0d0cf61c99f5 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:41.538574 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec4eb1-c981-46fc-8d36-0d0cf61c99f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:41.539031 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec4eb1-c981-46fc-8d36-0d0cf61c99f5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:41.553533 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec4eb1-c981-46fc-8d36-0d0cf61c99f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:41.564078 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-4dec4eb1-c981-46fc-8d36-0d0cf61c99f5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 12 02:50:41.565866 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 148/299] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:50:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:41.567178 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cdad6f-a78a-4b14-afee-c14fa8c4d1d8 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:41.567465 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cdad6f-a78a-4b14-afee-c14fa8c4d1d8 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:41.567756 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cdad6f-a78a-4b14-afee-c14fa8c4d1d8 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:41.569254 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44211657-0d3a-460e-b8c6-804b2ac7dc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:41.569378 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 149/300] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:41.570324 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44211657-0d3a-460e-b8c6-804b2ac7dc9a None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:41.570795 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44211657-0d3a-460e-b8c6-804b2ac7dc9a None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:41.571450 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44211657-0d3a-460e-b8c6-804b2ac7dc9a None admin] PATH_INFO: `/v3/roles/member` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:41.572077 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cdad6f-a78a-4b14-afee-c14fa8c4d1d8 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:41.583676 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44211657-0d3a-460e-b8c6-804b2ac7dc9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:41.591583 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-44211657-0d3a-460e-b8c6-804b2ac7dc9a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 02:50:41.593010 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 152/301] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:50:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:50:41.594370 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e893e98-87e6-4dac-848e-bacc21a8b9bc None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:41.594801 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e893e98-87e6-4dac-848e-bacc21a8b9bc None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:41.595268 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e893e98-87e6-4dac-848e-bacc21a8b9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:41.616675 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-6e893e98-87e6-4dac-848e-bacc21a8b9bc None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:41.617946 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-6e893e98-87e6-4dac-848e-bacc21a8b9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:41.676604 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cdad6f-a78a-4b14-afee-c14fa8c4d1d8 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:41.712695 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a15da-3c14-4457-aad1-6678df8fe38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:41.713615 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a15da-3c14-4457-aad1-6678df8fe38f None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:41.713893 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a15da-3c14-4457-aad1-6678df8fe38f None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:41.714137 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a15da-3c14-4457-aad1-6678df8fe38f None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:41.714953 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a15da-3c14-4457-aad1-6678df8fe38f None admin] RBAC: Adding query filter params (name=reader) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:41.715246 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a15da-3c14-4457-aad1-6678df8fe38f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:41.716736 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a15da-3c14-4457-aad1-6678df8fe38f None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:41.730864 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 150/302] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 02:50:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:50:41.730864 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a15da-3c14-4457-aad1-6678df8fe38f None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:41.802146 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 153/303] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:41.809047 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e893e98-87e6-4dac-848e-bacc21a8b9bc None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:41.839113 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a15da-3c14-4457-aad1-6678df8fe38f None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:41.872622 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3db94-02d2-4b24-a486-2e020734d490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:41.873317 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3db94-02d2-4b24-a486-2e020734d490 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:41.873602 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3db94-02d2-4b24-a486-2e020734d490 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:41.873896 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3db94-02d2-4b24-a486-2e020734d490 None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:41.874685 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3db94-02d2-4b24-a486-2e020734d490 None admin] RBAC: Adding query filter params (name=member) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:41.874992 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3db94-02d2-4b24-a486-2e020734d490 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:41.876398 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3db94-02d2-4b24-a486-2e020734d490 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:41.884528 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 151/304] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 02:50:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:41.885323 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3db94-02d2-4b24-a486-2e020734d490 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:41.918843 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e893e98-87e6-4dac-848e-bacc21a8b9bc None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:41.950427 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8268ebd-b598-4b3b-b25d-6df5fad6108f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:41.951298 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8268ebd-b598-4b3b-b25d-6df5fad6108f None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:41.951548 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8268ebd-b598-4b3b-b25d-6df5fad6108f None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:41.951841 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8268ebd-b598-4b3b-b25d-6df5fad6108f None admin] PATH_INFO: `/v3/users/1b2f60a524504edf8ed000a696cc5274` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:41.965803 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8268ebd-b598-4b3b-b25d-6df5fad6108f None admin] RBAC: Authorizing `identity:get_user(user_id=1b2f60a524504edf8ed000a696cc5274)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:41.967269 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8268ebd-b598-4b3b-b25d-6df5fad6108f None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:41.968979 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 154/305] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:50:41 2022] GET /identity/v3/users/1b2f60a524504edf8ed000a696cc5274 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:41.969743 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8268ebd-b598-4b3b-b25d-6df5fad6108f None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:41.985682 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3db94-02d2-4b24-a486-2e020734d490 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:42.018455 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1ed22-47e6-47e6-a5be-3722baf48e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:42.019221 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1ed22-47e6-47e6-a5be-3722baf48e8e None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:42.019528 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1ed22-47e6-47e6-a5be-3722baf48e8e None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:42.019823 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1ed22-47e6-47e6-a5be-3722baf48e8e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:42.020989 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1ed22-47e6-47e6-a5be-3722baf48e8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:42.022422 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1ed22-47e6-47e6-a5be-3722baf48e8e None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:42.024053 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 152/306] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:50:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:42.025363 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbfd72-da97-480a-b4b1-680bfc3022b1 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:42.025612 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbfd72-da97-480a-b4b1-680bfc3022b1 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:42.025916 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbfd72-da97-480a-b4b1-680bfc3022b1 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:42.031360 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 153/307] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:42.031360 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcbfd72-da97-480a-b4b1-680bfc3022b1 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:42.070792 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8268ebd-b598-4b3b-b25d-6df5fad6108f None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:42.103610 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b446684-cfbf-4f5d-87a4-845d574b1082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:42.104507 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b446684-cfbf-4f5d-87a4-845d574b1082 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:42.104779 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b446684-cfbf-4f5d-87a4-845d574b1082 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:42.105039 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b446684-cfbf-4f5d-87a4-845d574b1082 None admin] PATH_INFO: `/v3/users/1fe30478781d4ef5a9b4907139c55081` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:42.106334 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b446684-cfbf-4f5d-87a4-845d574b1082 None admin] RBAC: Authorizing `identity:get_user(user_id=1fe30478781d4ef5a9b4907139c55081)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:42.107787 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b446684-cfbf-4f5d-87a4-845d574b1082 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:42.109552 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 155/308] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:50:41 2022] GET /identity/v3/users/1fe30478781d4ef5a9b4907139c55081 => generated 293 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:42.110116 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b446684-cfbf-4f5d-87a4-845d574b1082 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:42.123379 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcbfd72-da97-480a-b4b1-680bfc3022b1 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:42.154883 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7443b-d060-4dbb-bed3-8b08571376e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:42.155524 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7443b-d060-4dbb-bed3-8b08571376e0 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:42.155822 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7443b-d060-4dbb-bed3-8b08571376e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:42.156079 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7443b-d060-4dbb-bed3-8b08571376e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:42.156893 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c7443b-d060-4dbb-bed3-8b08571376e0 None admin] RBAC: Adding query filter params (role.id=33cab6a3207a4cd69442cac65e246a23, user.id=1b2f60a524504edf8ed000a696cc5274, scope.system=all) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:42.157192 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c7443b-d060-4dbb-bed3-8b08571376e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:42.158605 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c7443b-d060-4dbb-bed3-8b08571376e0 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:42.163329 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 154/309] 10.222.0.32 () {56 vars in 1308 bytes} [Tue Apr 12 02:50:42 2022] GET /identity/v3/role_assignments?user.id=1b2f60a524504edf8ed000a696cc5274&scope.system=all&role.id=33cab6a3207a4cd69442cac65e246a23 => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:42.164511 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3db35e-4836-46bc-968f-d9e4e77ddd48 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:42.164768 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3db35e-4836-46bc-968f-d9e4e77ddd48 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:42.165033 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3db35e-4836-46bc-968f-d9e4e77ddd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:42.182610 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-6e3db35e-4836-46bc-968f-d9e4e77ddd48 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:42.183891 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-6e3db35e-4836-46bc-968f-d9e4e77ddd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:42.208762 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b446684-cfbf-4f5d-87a4-845d574b1082 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:42.244578 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390dc16-2ee9-4ae7-9c1f-b3a242dd2cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:42.245277 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390dc16-2ee9-4ae7-9c1f-b3a242dd2cc1 None admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:42.245563 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390dc16-2ee9-4ae7-9c1f-b3a242dd2cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:42.245817 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390dc16-2ee9-4ae7-9c1f-b3a242dd2cc1 None admin] PATH_INFO: `/v3/groups` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:42.246534 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390dc16-2ee9-4ae7-9c1f-b3a242dd2cc1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:42.248106 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390dc16-2ee9-4ae7-9c1f-b3a242dd2cc1 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:42.267402 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 156/310] 10.222.0.32 () {60 vars in 1134 bytes} [Tue Apr 12 02:50:42 2022] POST /identity/v3/groups => generated 229 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 02:50:42.268803 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390dc16-2ee9-4ae7-9c1f-b3a242dd2cc1 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:42.384080 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 155/311] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:42.409940 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3db35e-4836-46bc-968f-d9e4e77ddd48 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:42.411965 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390dc16-2ee9-4ae7-9c1f-b3a242dd2cc1 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:42.459782 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8469d-fcd3-45ce-aa70-0ebe80d85cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:42.461060 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8469d-fcd3-45ce-aa70-0ebe80d85cd7 None admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:42.461339 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8469d-fcd3-45ce-aa70-0ebe80d85cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:42.461611 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8469d-fcd3-45ce-aa70-0ebe80d85cd7 None admin] PATH_INFO: `/v3/system/users/1fe30478781d4ef5a9b4907139c55081/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:42.463867 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8469d-fcd3-45ce-aa70-0ebe80d85cd7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1fe30478781d4ef5a9b4907139c55081, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:42.465583 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8469d-fcd3-45ce-aa70-0ebe80d85cd7 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:42.477679 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 157/312] 10.222.0.32 () {58 vars in 1334 bytes} [Tue Apr 12 02:50:42 2022] PUT /identity/v3/system/users/1fe30478781d4ef5a9b4907139c55081/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 02:50:42.534498 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3db35e-4836-46bc-968f-d9e4e77ddd48 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:42.573853 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d9950-3d03-40c0-bc99-377f008a9ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:42.575807 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d9950-3d03-40c0-bc99-377f008a9ae1 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:42.576238 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d9950-3d03-40c0-bc99-377f008a9ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:42.576668 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d9950-3d03-40c0-bc99-377f008a9ae1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:42.589290 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d9950-3d03-40c0-bc99-377f008a9ae1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:42.597614 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-f36d9950-3d03-40c0-bc99-377f008a9ae1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 12 02:50:42.599241 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 156/313] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:50:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:42.610478 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8469d-fcd3-45ce-aa70-0ebe80d85cd7 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:42.722182 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8469d-fcd3-45ce-aa70-0ebe80d85cd7 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:42.755614 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef902efd-179e-4cfd-a236-ef8ed69c5310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:42.756566 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef902efd-179e-4cfd-a236-ef8ed69c5310 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:42.756981 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef902efd-179e-4cfd-a236-ef8ed69c5310 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:42.757390 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef902efd-179e-4cfd-a236-ef8ed69c5310 None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:42.758265 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef902efd-179e-4cfd-a236-ef8ed69c5310 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:42.758699 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef902efd-179e-4cfd-a236-ef8ed69c5310 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:42.760246 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef902efd-179e-4cfd-a236-ef8ed69c5310 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:42.768759 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 158/314] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 02:50:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:42.774353 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d9950-3d03-40c0-bc99-377f008a9ae1 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:42.876089 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d9950-3d03-40c0-bc99-377f008a9ae1 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:42.909004 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019cc7b-886c-4b31-b15b-3f2b466ef7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:42.909878 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019cc7b-886c-4b31-b15b-3f2b466ef7d2 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:42.910156 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019cc7b-886c-4b31-b15b-3f2b466ef7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:42.910423 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019cc7b-886c-4b31-b15b-3f2b466ef7d2 None admin] PATH_INFO: `/v3/users/5a2d70e34d0a4ec9b2532b7a748bc02c` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:42.911603 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019cc7b-886c-4b31-b15b-3f2b466ef7d2 None admin] RBAC: Authorizing `identity:get_user(user_id=5a2d70e34d0a4ec9b2532b7a748bc02c)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:42.913062 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019cc7b-886c-4b31-b15b-3f2b466ef7d2 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:42.914976 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 157/315] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:50:42 2022] GET /identity/v3/users/5a2d70e34d0a4ec9b2532b7a748bc02c => generated 297 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:42.920775 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef902efd-179e-4cfd-a236-ef8ed69c5310 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:43.019490 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef902efd-179e-4cfd-a236-ef8ed69c5310 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:43.054490 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80eeab0-7e64-4f1b-85bb-541d78bef136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:43.055445 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80eeab0-7e64-4f1b-85bb-541d78bef136 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:43.055935 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80eeab0-7e64-4f1b-85bb-541d78bef136 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:43.056387 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80eeab0-7e64-4f1b-85bb-541d78bef136 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:43.123286 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80eeab0-7e64-4f1b-85bb-541d78bef136 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:43.125049 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80eeab0-7e64-4f1b-85bb-541d78bef136 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:43.221940 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 159/316] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:50:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:50:43.227509 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019cc7b-886c-4b31-b15b-3f2b466ef7d2 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:43.330849 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019cc7b-886c-4b31-b15b-3f2b466ef7d2 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:43.365416 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f2973-bdd5-4e28-88ad-4e7bb43b4203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:43.366525 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f2973-bdd5-4e28-88ad-4e7bb43b4203 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:43.366962 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f2973-bdd5-4e28-88ad-4e7bb43b4203 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:43.367432 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f2973-bdd5-4e28-88ad-4e7bb43b4203 None admin] PATH_INFO: `/v3/projects/020fd75d07c34b109048207eb8e5fd24` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:43.368788 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f2973-bdd5-4e28-88ad-4e7bb43b4203 None admin] RBAC: Authorizing `identity:get_project(project_id=020fd75d07c34b109048207eb8e5fd24)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:43.370338 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f2973-bdd5-4e28-88ad-4e7bb43b4203 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:43.373043 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 158/317] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:43 2022] GET /identity/v3/projects/020fd75d07c34b109048207eb8e5fd24 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:43.379130 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80eeab0-7e64-4f1b-85bb-541d78bef136 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:43.477329 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80eeab0-7e64-4f1b-85bb-541d78bef136 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:43.510542 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e4039-2d95-492c-8840-68bdf4297bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:43.511217 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e4039-2d95-492c-8840-68bdf4297bbd None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:43.511528 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e4039-2d95-492c-8840-68bdf4297bbd None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:43.511837 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e4039-2d95-492c-8840-68bdf4297bbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:43.512679 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967e4039-2d95-492c-8840-68bdf4297bbd None admin] RBAC: Adding query filter params (role.id=33cab6a3207a4cd69442cac65e246a23, scope.project.id=020fd75d07c34b109048207eb8e5fd24, user.id=5a2d70e34d0a4ec9b2532b7a748bc02c) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:43.512984 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967e4039-2d95-492c-8840-68bdf4297bbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:43.514488 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967e4039-2d95-492c-8840-68bdf4297bbd None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:43.522014 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 160/318] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:50:43 2022] GET /identity/v3/role_assignments?user.id=5a2d70e34d0a4ec9b2532b7a748bc02c&scope.project.id=020fd75d07c34b109048207eb8e5fd24&role.id=33cab6a3207a4cd69442cac65e246a23 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:44.490691 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a46a5-a595-4dc5-911b-fb1198e40db2 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:44.491334 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a46a5-a595-4dc5-911b-fb1198e40db2 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:44.491334 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a46a5-a595-4dc5-911b-fb1198e40db2 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:44.492569 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 159/319] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:44.498296 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d07b8-41d9-4cd1-8e58-3d24e8f16626 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:44.498743 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d07b8-41d9-4cd1-8e58-3d24e8f16626 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:44.498879 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d07b8-41d9-4cd1-8e58-3d24e8f16626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:44.522345 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-dc8d07b8-41d9-4cd1-8e58-3d24e8f16626 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:44.523613 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-dc8d07b8-41d9-4cd1-8e58-3d24e8f16626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:44.599775 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 161/320] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:44.621951 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a46a5-a595-4dc5-911b-fb1198e40db2 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:44.702317 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587af56-0e28-4a8e-a27e-b6e8e03565ac None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:44.702658 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587af56-0e28-4a8e-a27e-b6e8e03565ac None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:44.703159 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587af56-0e28-4a8e-a27e-b6e8e03565ac None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:44.704682 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 162/321] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:50:44.709718 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac933b-3107-4d4e-a43d-22f98f5eea74 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:44.710066 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac933b-3107-4d4e-a43d-22f98f5eea74 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:44.710405 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac933b-3107-4d4e-a43d-22f98f5eea74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:44.724310 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a46a5-a595-4dc5-911b-fb1198e40db2 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:44.726678 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-bdac933b-3107-4d4e-a43d-22f98f5eea74 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:44.727843 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-bdac933b-3107-4d4e-a43d-22f98f5eea74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:44.757667 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d2749-a882-4461-860a-563043a4a47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:44.758376 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d2749-a882-4461-860a-563043a4a47c None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:44.758646 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d2749-a882-4461-860a-563043a4a47c None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:44.758907 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d2749-a882-4461-860a-563043a4a47c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:44.768882 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d2749-a882-4461-860a-563043a4a47c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:44.775614 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-697d2749-a882-4461-860a-563043a4a47c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 12 02:50:44.777052 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 160/322] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:50:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:44.782583 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d2749-a882-4461-860a-563043a4a47c None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:44.793660 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 163/323] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 02:50:44.817194 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac933b-3107-4d4e-a43d-22f98f5eea74 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:44.885396 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d2749-a882-4461-860a-563043a4a47c None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:44.914260 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac933b-3107-4d4e-a43d-22f98f5eea74 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:44.917175 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675fb51f-0e39-42b6-8734-8f018d0540dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:44.917911 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fb51f-0e39-42b6-8734-8f018d0540dd None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:44.918191 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fb51f-0e39-42b6-8734-8f018d0540dd None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:44.918463 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fb51f-0e39-42b6-8734-8f018d0540dd None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:44.919231 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675fb51f-0e39-42b6-8734-8f018d0540dd None admin] RBAC: Adding query filter params (name=reader) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:44.919515 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675fb51f-0e39-42b6-8734-8f018d0540dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:44.920924 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675fb51f-0e39-42b6-8734-8f018d0540dd None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:44.928708 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 161/324] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 02:50:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:50:44.930064 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a8f71-a43d-490e-a908-247b5868dff5 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:44.930347 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a8f71-a43d-490e-a908-247b5868dff5 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:44.930619 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a8f71-a43d-490e-a908-247b5868dff5 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:44.931871 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 162/325] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:44.935617 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a8f71-a43d-490e-a908-247b5868dff5 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:44.947846 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc32d7-38aa-4b85-8874-0edb26970a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:44.948636 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc32d7-38aa-4b85-8874-0edb26970a4c None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:44.949020 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc32d7-38aa-4b85-8874-0edb26970a4c None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:44.949356 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc32d7-38aa-4b85-8874-0edb26970a4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:44.950477 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc32d7-38aa-4b85-8874-0edb26970a4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:44.951946 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc32d7-38aa-4b85-8874-0edb26970a4c None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:44.953848 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 164/326] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:50:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:50:44.954954 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc5b57-8d6a-483a-96a9-420e77b01f8a None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:44.955227 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc5b57-8d6a-483a-96a9-420e77b01f8a None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:44.955490 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc5b57-8d6a-483a-96a9-420e77b01f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:44.970810 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-5ebc5b57-8d6a-483a-96a9-420e77b01f8a None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:44.972000 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-5ebc5b57-8d6a-483a-96a9-420e77b01f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:45.032544 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a8f71-a43d-490e-a908-247b5868dff5 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:45.036485 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 165/327] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:45.051176 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc5b57-8d6a-483a-96a9-420e77b01f8a None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:45.065794 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33e8e0-6ef0-4b2b-badc-fc8921a741d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:45.066672 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33e8e0-6ef0-4b2b-badc-fc8921a741d3 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:45.066941 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33e8e0-6ef0-4b2b-badc-fc8921a741d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:45.067205 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33e8e0-6ef0-4b2b-badc-fc8921a741d3 None admin] PATH_INFO: `/v3/users/1b2f60a524504edf8ed000a696cc5274` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:45.068429 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33e8e0-6ef0-4b2b-badc-fc8921a741d3 None admin] RBAC: Authorizing `identity:get_user(user_id=1b2f60a524504edf8ed000a696cc5274)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:45.069872 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33e8e0-6ef0-4b2b-badc-fc8921a741d3 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:45.071460 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 163/328] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:50:44 2022] GET /identity/v3/users/1b2f60a524504edf8ed000a696cc5274 => generated 293 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:45.076019 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33e8e0-6ef0-4b2b-badc-fc8921a741d3 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:45.143377 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc5b57-8d6a-483a-96a9-420e77b01f8a None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:45.166764 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33e8e0-6ef0-4b2b-badc-fc8921a741d3 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:45.175716 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92c125-6d86-4716-ae60-2d3c5498b665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:45.176390 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92c125-6d86-4716-ae60-2d3c5498b665 None admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:45.176658 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92c125-6d86-4716-ae60-2d3c5498b665 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:45.176916 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92c125-6d86-4716-ae60-2d3c5498b665 None admin] PATH_INFO: `/v3/groups` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:45.177582 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f92c125-6d86-4716-ae60-2d3c5498b665 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:45.179019 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f92c125-6d86-4716-ae60-2d3c5498b665 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:45.194959 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 166/329] 10.222.0.32 () {60 vars in 1134 bytes} [Tue Apr 12 02:50:45 2022] POST /identity/v3/groups => generated 226 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 02:50:45.195951 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92c125-6d86-4716-ae60-2d3c5498b665 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:45.199823 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9cb14a-c495-435f-a8fb-5bc32734c0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:45.200641 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cb14a-c495-435f-a8fb-5bc32734c0d7 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:45.200912 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cb14a-c495-435f-a8fb-5bc32734c0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:45.201204 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cb14a-c495-435f-a8fb-5bc32734c0d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:45.213320 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9cb14a-c495-435f-a8fb-5bc32734c0d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:45.220774 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-9c9cb14a-c495-435f-a8fb-5bc32734c0d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 02:50:45.222243 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 164/330] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:50:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:45.228110 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9cb14a-c495-435f-a8fb-5bc32734c0d7 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:45.305836 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92c125-6d86-4716-ae60-2d3c5498b665 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:45.342671 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9cb14a-c495-435f-a8fb-5bc32734c0d7 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:45.345014 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5312cd1-086d-4b9a-9b32-5f5be2a6229f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:45.345889 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5312cd1-086d-4b9a-9b32-5f5be2a6229f None admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:45.346163 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5312cd1-086d-4b9a-9b32-5f5be2a6229f None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:45.346428 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5312cd1-086d-4b9a-9b32-5f5be2a6229f None admin] PATH_INFO: `/v3/system/users/1b2f60a524504edf8ed000a696cc5274/roles/33cab6a3207a4cd69442cac65e246a23` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:45.347980 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5312cd1-086d-4b9a-9b32-5f5be2a6229f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1b2f60a524504edf8ed000a696cc5274, role_id=33cab6a3207a4cd69442cac65e246a23)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:45.349408 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5312cd1-086d-4b9a-9b32-5f5be2a6229f None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:45.357718 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 167/331] 10.222.0.32 () {58 vars in 1334 bytes} [Tue Apr 12 02:50:45 2022] PUT /identity/v3/system/users/1b2f60a524504edf8ed000a696cc5274/roles/33cab6a3207a4cd69442cac65e246a23 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 02:50:45.381328 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27a20e-ae52-4eba-802a-5d9d7aa02bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:45.382028 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27a20e-ae52-4eba-802a-5d9d7aa02bb6 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:45.382299 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27a20e-ae52-4eba-802a-5d9d7aa02bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:45.382565 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27a20e-ae52-4eba-802a-5d9d7aa02bb6 None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:45.383519 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27a20e-ae52-4eba-802a-5d9d7aa02bb6 None admin] RBAC: Adding query filter params (name=member) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:45.383848 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27a20e-ae52-4eba-802a-5d9d7aa02bb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:45.385286 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27a20e-ae52-4eba-802a-5d9d7aa02bb6 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:45.395780 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 165/332] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 02:50:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:50:45.401722 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5312cd1-086d-4b9a-9b32-5f5be2a6229f None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:45.513184 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5312cd1-086d-4b9a-9b32-5f5be2a6229f None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:45.548960 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd8d9d-5f36-4f54-aa6d-8b976c5413d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:45.549837 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd8d9d-5f36-4f54-aa6d-8b976c5413d8 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:45.550107 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd8d9d-5f36-4f54-aa6d-8b976c5413d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:45.550369 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd8d9d-5f36-4f54-aa6d-8b976c5413d8 None admin] PATH_INFO: `/v3/users/1fe30478781d4ef5a9b4907139c55081` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:45.551553 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd8d9d-5f36-4f54-aa6d-8b976c5413d8 None admin] RBAC: Authorizing `identity:get_user(user_id=1fe30478781d4ef5a9b4907139c55081)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:45.553032 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd8d9d-5f36-4f54-aa6d-8b976c5413d8 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:45.554689 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 168/333] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:50:45 2022] GET /identity/v3/users/1fe30478781d4ef5a9b4907139c55081 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:45.560912 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27a20e-ae52-4eba-802a-5d9d7aa02bb6 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:45.661368 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27a20e-ae52-4eba-802a-5d9d7aa02bb6 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:45.700984 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ddb92-8af0-42b3-99bd-206de7046335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:45.701642 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ddb92-8af0-42b3-99bd-206de7046335 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:45.701915 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ddb92-8af0-42b3-99bd-206de7046335 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:45.702180 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ddb92-8af0-42b3-99bd-206de7046335 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:45.703322 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749ddb92-8af0-42b3-99bd-206de7046335 None admin] RBAC: Adding query filter params (role.id=0a31c1ce37fa41deb4908731f772414b, user.id=1fe30478781d4ef5a9b4907139c55081, scope.system=all) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:45.703631 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749ddb92-8af0-42b3-99bd-206de7046335 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:45.705093 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749ddb92-8af0-42b3-99bd-206de7046335 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:45.717308 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 166/334] 10.222.0.32 () {56 vars in 1308 bytes} [Tue Apr 12 02:50:45 2022] GET /identity/v3/role_assignments?user.id=1fe30478781d4ef5a9b4907139c55081&scope.system=all&role.id=0a31c1ce37fa41deb4908731f772414b => generated 510 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:48.059627 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e6b8d-baf2-49aa-b1dc-5d4e202a856f None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:48.060166 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e6b8d-baf2-49aa-b1dc-5d4e202a856f None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:48.060166 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e6b8d-baf2-49aa-b1dc-5d4e202a856f None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:48.061797 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 169/335] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:48.067203 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9034c61-5a59-4e68-894b-257b39eb2b0d None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:48.067634 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9034c61-5a59-4e68-894b-257b39eb2b0d None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:48.067716 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9034c61-5a59-4e68-894b-257b39eb2b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:48.088617 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-e9034c61-5a59-4e68-894b-257b39eb2b0d None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:48.089976 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-e9034c61-5a59-4e68-894b-257b39eb2b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:48.169513 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 167/336] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:48.211643 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e6b8d-baf2-49aa-b1dc-5d4e202a856f None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:48.317313 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e6b8d-baf2-49aa-b1dc-5d4e202a856f None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:48.356428 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888647b-3f61-406c-8c87-544ddae5b7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:48.357245 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888647b-3f61-406c-8c87-544ddae5b7f2 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:48.357515 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888647b-3f61-406c-8c87-544ddae5b7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:48.357780 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888647b-3f61-406c-8c87-544ddae5b7f2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:48.374868 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0888647b-3f61-406c-8c87-544ddae5b7f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:48.382430 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-0888647b-3f61-406c-8c87-544ddae5b7f2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 02:50:48.383743 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 170/337] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 02:50:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:48.390153 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9034c61-5a59-4e68-894b-257b39eb2b0d None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:48.499265 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9034c61-5a59-4e68-894b-257b39eb2b0d None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:48.510745 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba1502-6e93-44e2-8628-33da1012b9bc None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:48.511115 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba1502-6e93-44e2-8628-33da1012b9bc None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:48.511660 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba1502-6e93-44e2-8628-33da1012b9bc None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:48.513244 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 171/338] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:50:48.520520 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26cae2-3c0d-4067-8d4b-e0d696ae9d2c None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:48.521495 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26cae2-3c0d-4067-8d4b-e0d696ae9d2c None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:48.521495 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26cae2-3c0d-4067-8d4b-e0d696ae9d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:48.544710 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-1f26cae2-3c0d-4067-8d4b-e0d696ae9d2c None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:48.545886 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-1f26cae2-3c0d-4067-8d4b-e0d696ae9d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:48.560994 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5db5f4-6f61-4305-b378-986d6dca30d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:48.561674 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5db5f4-6f61-4305-b378-986d6dca30d9 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:48.561943 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5db5f4-6f61-4305-b378-986d6dca30d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:48.562204 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5db5f4-6f61-4305-b378-986d6dca30d9 None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:48.562952 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5db5f4-6f61-4305-b378-986d6dca30d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:48.563249 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5db5f4-6f61-4305-b378-986d6dca30d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:48.564648 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5db5f4-6f61-4305-b378-986d6dca30d9 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:48.577618 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 168/339] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:50:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:48.579013 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178ae96-b23c-4d5a-98b8-4099ce3d1063 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:48.579358 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178ae96-b23c-4d5a-98b8-4099ce3d1063 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:48.579552 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178ae96-b23c-4d5a-98b8-4099ce3d1063 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:48.581608 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 169/340] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:48.586272 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79a783-9334-4714-98c7-01195d55fd74 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:48.586552 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79a783-9334-4714-98c7-01195d55fd74 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:48.586821 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79a783-9334-4714-98c7-01195d55fd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:48.610601 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-2a79a783-9334-4714-98c7-01195d55fd74 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:48.615824 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-2a79a783-9334-4714-98c7-01195d55fd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:48.644930 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 172/341] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 02:50:48.646276 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26cae2-3c0d-4067-8d4b-e0d696ae9d2c None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:48.759544 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 170/342] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 02:50:48.760462 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79a783-9334-4714-98c7-01195d55fd74 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:48.765164 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26cae2-3c0d-4067-8d4b-e0d696ae9d2c None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:48.804411 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11dd31-56bd-4d1c-8cc4-851b1c78afb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:48.805445 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11dd31-56bd-4d1c-8cc4-851b1c78afb9 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:48.807011 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11dd31-56bd-4d1c-8cc4-851b1c78afb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:48.807490 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11dd31-56bd-4d1c-8cc4-851b1c78afb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:48.939289 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11dd31-56bd-4d1c-8cc4-851b1c78afb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:48.939455 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11dd31-56bd-4d1c-8cc4-851b1c78afb9 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:48.953512 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79a783-9334-4714-98c7-01195d55fd74 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:48.994600 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cacdd45-0e66-4b51-8753-8899c81c4e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:48.995409 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacdd45-0e66-4b51-8753-8899c81c4e14 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:48.995887 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacdd45-0e66-4b51-8753-8899c81c4e14 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:48.996185 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacdd45-0e66-4b51-8753-8899c81c4e14 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:49.006282 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cacdd45-0e66-4b51-8753-8899c81c4e14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:49.015411 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-7cacdd45-0e66-4b51-8753-8899c81c4e14 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 12 02:50:49.016998 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 171/343] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:50:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:49.018105 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cacdd45-0e66-4b51-8753-8899c81c4e14 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:49.069479 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 173/344] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:50:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:50:49.069479 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b783cad-7a83-4edb-abdb-286041319e99 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:49.069479 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b783cad-7a83-4edb-abdb-286041319e99 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:49.069479 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b783cad-7a83-4edb-abdb-286041319e99 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:49.069479 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 174/345] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:49.070241 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b783cad-7a83-4edb-abdb-286041319e99 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:49.139418 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cacdd45-0e66-4b51-8753-8899c81c4e14 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:49.174945 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe67c0-3422-4296-933f-569915ab98a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:49.175773 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe67c0-3422-4296-933f-569915ab98a3 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:49.176134 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe67c0-3422-4296-933f-569915ab98a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:49.176429 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe67c0-3422-4296-933f-569915ab98a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:49.178015 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b783cad-7a83-4edb-abdb-286041319e99 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:49.187604 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe67c0-3422-4296-933f-569915ab98a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:49.194617 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-9bbe67c0-3422-4296-933f-569915ab98a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 02:50:49.196120 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 172/346] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:50:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:49.196916 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe67c0-3422-4296-933f-569915ab98a3 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:49.214606 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68208b11-db74-43b3-8bb3-67af3a56aa9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:49.215620 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68208b11-db74-43b3-8bb3-67af3a56aa9a None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:49.216119 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68208b11-db74-43b3-8bb3-67af3a56aa9a None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:49.216581 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68208b11-db74-43b3-8bb3-67af3a56aa9a None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:49.217531 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68208b11-db74-43b3-8bb3-67af3a56aa9a None admin] RBAC: Adding query filter params (name=reader) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:49.218296 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68208b11-db74-43b3-8bb3-67af3a56aa9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:49.219908 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68208b11-db74-43b3-8bb3-67af3a56aa9a None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:49.228938 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 175/347] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 02:50:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:49.230747 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab513e0-75b0-43b0-8385-82c37cb55cc0 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:49.231229 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab513e0-75b0-43b0-8385-82c37cb55cc0 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:49.231735 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab513e0-75b0-43b0-8385-82c37cb55cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:49.248382 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-0ab513e0-75b0-43b0-8385-82c37cb55cc0 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:49.249862 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-0ab513e0-75b0-43b0-8385-82c37cb55cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:49.307251 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe67c0-3422-4296-933f-569915ab98a3 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:49.316282 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 176/348] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:49.317564 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab513e0-75b0-43b0-8385-82c37cb55cc0 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:49.341539 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903d96b-5c2f-4d2b-9178-37a94b6809fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:49.342379 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903d96b-5c2f-4d2b-9178-37a94b6809fb None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:49.342651 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903d96b-5c2f-4d2b-9178-37a94b6809fb None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:49.342925 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903d96b-5c2f-4d2b-9178-37a94b6809fb None admin] PATH_INFO: `/v3/projects/3085add0984c4b339583bce0299f7cc3` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:49.344162 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903d96b-5c2f-4d2b-9178-37a94b6809fb None admin] RBAC: Authorizing `identity:get_project(project_id=3085add0984c4b339583bce0299f7cc3)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:49.345645 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903d96b-5c2f-4d2b-9178-37a94b6809fb None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:49.347353 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 173/349] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:49 2022] GET /identity/v3/projects/3085add0984c4b339583bce0299f7cc3 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:49.351174 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903d96b-5c2f-4d2b-9178-37a94b6809fb None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:49.431443 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab513e0-75b0-43b0-8385-82c37cb55cc0 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:49.458610 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903d96b-5c2f-4d2b-9178-37a94b6809fb None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:49.464939 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522664bc-7c2b-457f-968c-fcde7ae68cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:49.465610 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522664bc-7c2b-457f-968c-fcde7ae68cc7 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:49.465885 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522664bc-7c2b-457f-968c-fcde7ae68cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:49.466150 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522664bc-7c2b-457f-968c-fcde7ae68cc7 None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:49.466892 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522664bc-7c2b-457f-968c-fcde7ae68cc7 None admin] RBAC: Adding query filter params (name=member) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:49.467189 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522664bc-7c2b-457f-968c-fcde7ae68cc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:49.468619 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522664bc-7c2b-457f-968c-fcde7ae68cc7 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:49.478261 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 177/350] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 02:50:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:49.479098 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522664bc-7c2b-457f-968c-fcde7ae68cc7 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:49.495997 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64f437-a47e-4b2a-b687-d1174d2327e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:49.497259 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64f437-a47e-4b2a-b687-d1174d2327e3 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:49.497804 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64f437-a47e-4b2a-b687-d1174d2327e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:49.498287 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64f437-a47e-4b2a-b687-d1174d2327e3 None admin] PATH_INFO: `/v3/users/1b2f60a524504edf8ed000a696cc5274` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:49.499979 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64f437-a47e-4b2a-b687-d1174d2327e3 None admin] RBAC: Authorizing `identity:get_user(user_id=1b2f60a524504edf8ed000a696cc5274)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:49.501708 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64f437-a47e-4b2a-b687-d1174d2327e3 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:49.503940 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 174/351] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:50:49 2022] GET /identity/v3/users/1b2f60a524504edf8ed000a696cc5274 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:49.504964 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64f437-a47e-4b2a-b687-d1174d2327e3 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:49.600317 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522664bc-7c2b-457f-968c-fcde7ae68cc7 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:49.626412 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64f437-a47e-4b2a-b687-d1174d2327e3 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:49.641121 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be383a-5e7d-4049-9fce-87cd0ca10e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:49.641992 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be383a-5e7d-4049-9fce-87cd0ca10e7a None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:49.642260 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be383a-5e7d-4049-9fce-87cd0ca10e7a None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:49.642527 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be383a-5e7d-4049-9fce-87cd0ca10e7a None admin] PATH_INFO: `/v3/groups/717a058098c241a6b0bf522096228df1` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:49.649746 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be383a-5e7d-4049-9fce-87cd0ca10e7a None admin] RBAC: Authorizing `identity:get_group(group_id=717a058098c241a6b0bf522096228df1)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:49.651212 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be383a-5e7d-4049-9fce-87cd0ca10e7a None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:49.656602 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 178/352] 10.222.0.32 () {56 vars in 1180 bytes} [Tue Apr 12 02:50:49 2022] GET /identity/v3/groups/717a058098c241a6b0bf522096228df1 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:49.657465 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be383a-5e7d-4049-9fce-87cd0ca10e7a None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:49.664640 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48cafd-d97d-4314-a925-6a31a41a7a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:49.665662 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48cafd-d97d-4314-a925-6a31a41a7a5d None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:49.666071 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48cafd-d97d-4314-a925-6a31a41a7a5d None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:49.666469 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48cafd-d97d-4314-a925-6a31a41a7a5d None admin] PATH_INFO: `/v3/roles/member` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:49.682443 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48cafd-d97d-4314-a925-6a31a41a7a5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:49.690850 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-da48cafd-d97d-4314-a925-6a31a41a7a5d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 02:50:49.692347 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 175/353] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:50:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:49.693207 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48cafd-d97d-4314-a925-6a31a41a7a5d None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:49.782514 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be383a-5e7d-4049-9fce-87cd0ca10e7a None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:49.817318 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48cafd-d97d-4314-a925-6a31a41a7a5d None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:49.824913 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e738b51-82f6-40e3-bd99-9ea2ecff595e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:49.825569 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e738b51-82f6-40e3-bd99-9ea2ecff595e None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:49.825843 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e738b51-82f6-40e3-bd99-9ea2ecff595e None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:49.826110 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e738b51-82f6-40e3-bd99-9ea2ecff595e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:49.872787 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0b4f9-2a35-4d28-979e-af4dbc0afad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:49.873455 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0b4f9-2a35-4d28-979e-af4dbc0afad8 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:49.873723 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0b4f9-2a35-4d28-979e-af4dbc0afad8 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:49.873991 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0b4f9-2a35-4d28-979e-af4dbc0afad8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:49.874821 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0b4f9-2a35-4d28-979e-af4dbc0afad8 None admin] RBAC: Adding query filter params (role.id=33cab6a3207a4cd69442cac65e246a23, user.id=1b2f60a524504edf8ed000a696cc5274, scope.system=all) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:49.875129 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0b4f9-2a35-4d28-979e-af4dbc0afad8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:49.876598 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0b4f9-2a35-4d28-979e-af4dbc0afad8 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:49.894008 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 176/354] 10.222.0.32 () {56 vars in 1308 bytes} [Tue Apr 12 02:50:49 2022] GET /identity/v3/role_assignments?user.id=1b2f60a524504edf8ed000a696cc5274&scope.system=all&role.id=33cab6a3207a4cd69442cac65e246a23 => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:49.894008 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2490c3-681c-4b21-99b7-796fd16712c6 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:49.894008 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2490c3-681c-4b21-99b7-796fd16712c6 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:49.894303 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2490c3-681c-4b21-99b7-796fd16712c6 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:49.895903 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 177/355] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:49.896165 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2490c3-681c-4b21-99b7-796fd16712c6 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:49.919306 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e738b51-82f6-40e3-bd99-9ea2ecff595e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:49.920853 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e738b51-82f6-40e3-bd99-9ea2ecff595e None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:50.026544 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2490c3-681c-4b21-99b7-796fd16712c6 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:50.035754 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 179/356] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:50:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:50:50.037081 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e738b51-82f6-40e3-bd99-9ea2ecff595e None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:50.067595 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2dd71-28ea-41e9-a660-1e88477e4332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:50.068279 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2dd71-28ea-41e9-a660-1e88477e4332 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:50.068550 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2dd71-28ea-41e9-a660-1e88477e4332 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:50.068809 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2dd71-28ea-41e9-a660-1e88477e4332 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:50.069647 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2dd71-28ea-41e9-a660-1e88477e4332 None admin] RBAC: Adding query filter params (group.id=717a058098c241a6b0bf522096228df1, role.id=60b6ad9d4f6d40b4a37fb5045c7f4523, scope.project.id=3085add0984c4b339583bce0299f7cc3) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:50.069949 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2dd71-28ea-41e9-a660-1e88477e4332 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:50.071457 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2dd71-28ea-41e9-a660-1e88477e4332 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:50.082053 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 178/357] 10.222.0.32 () {56 vars in 1376 bytes} [Tue Apr 12 02:50:49 2022] GET /identity/v3/role_assignments?group.id=717a058098c241a6b0bf522096228df1&scope.project.id=3085add0984c4b339583bce0299f7cc3&role.id=60b6ad9d4f6d40b4a37fb5045c7f4523 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:50.082053 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b8226-a9ae-4aea-b0f7-527b015b4b79 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:50.082053 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b8226-a9ae-4aea-b0f7-527b015b4b79 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:50.082053 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b8226-a9ae-4aea-b0f7-527b015b4b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:50.099320 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-c41b8226-a9ae-4aea-b0f7-527b015b4b79 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:50.100511 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-c41b8226-a9ae-4aea-b0f7-527b015b4b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:50.170521 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e738b51-82f6-40e3-bd99-9ea2ecff595e None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:50.173469 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 179/358] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:50.174341 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b8226-a9ae-4aea-b0f7-527b015b4b79 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:50.227292 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17083ac4-c3a2-4160-a446-a4ec0ee39bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:50.228041 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17083ac4-c3a2-4160-a446-a4ec0ee39bfa None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:50.228274 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17083ac4-c3a2-4160-a446-a4ec0ee39bfa None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:50.228543 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17083ac4-c3a2-4160-a446-a4ec0ee39bfa None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:50.229475 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17083ac4-c3a2-4160-a446-a4ec0ee39bfa None admin] RBAC: Adding query filter params (name=member) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:50.230288 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17083ac4-c3a2-4160-a446-a4ec0ee39bfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:50.232182 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17083ac4-c3a2-4160-a446-a4ec0ee39bfa None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:50.243889 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 180/359] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 02:50:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:50.246040 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a7265-c220-419b-8fb7-e77978a76ad5 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:50.246318 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a7265-c220-419b-8fb7-e77978a76ad5 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:50.246665 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a7265-c220-419b-8fb7-e77978a76ad5 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:50.248598 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 181/360] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:50.249450 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a7265-c220-419b-8fb7-e77978a76ad5 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:50.307612 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b8226-a9ae-4aea-b0f7-527b015b4b79 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:50.355009 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6f3bb-52ad-4518-b6bf-06615ec34f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:50.355968 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6f3bb-52ad-4518-b6bf-06615ec34f3b None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:50.356324 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6f3bb-52ad-4518-b6bf-06615ec34f3b None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:50.356594 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6f3bb-52ad-4518-b6bf-06615ec34f3b None admin] PATH_INFO: `/v3/projects/3085add0984c4b339583bce0299f7cc3` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:50.357776 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6f3bb-52ad-4518-b6bf-06615ec34f3b None admin] RBAC: Authorizing `identity:get_project(project_id=3085add0984c4b339583bce0299f7cc3)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:50.359200 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6f3bb-52ad-4518-b6bf-06615ec34f3b None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:50.361006 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 180/361] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:50 2022] GET /identity/v3/projects/3085add0984c4b339583bce0299f7cc3 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:50.361768 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6f3bb-52ad-4518-b6bf-06615ec34f3b None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:50.377715 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a7265-c220-419b-8fb7-e77978a76ad5 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:50.427313 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622b2c4-98e4-4560-843a-8a4b5901203b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:50.428171 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622b2c4-98e4-4560-843a-8a4b5901203b None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:50.428447 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622b2c4-98e4-4560-843a-8a4b5901203b None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:50.428711 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622b2c4-98e4-4560-843a-8a4b5901203b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:50.440241 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622b2c4-98e4-4560-843a-8a4b5901203b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:50.447667 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-a622b2c4-98e4-4560-843a-8a4b5901203b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 02:50:50.451041 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 182/362] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 02:50:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:50.453458 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1947d-4b4d-4cfb-b894-877cf209bbe3 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:50.453743 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1947d-4b4d-4cfb-b894-877cf209bbe3 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:50.454014 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1947d-4b4d-4cfb-b894-877cf209bbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:50.473253 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-6cf1947d-4b4d-4cfb-b894-877cf209bbe3 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:50.474422 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-6cf1947d-4b4d-4cfb-b894-877cf209bbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:50.479468 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6f3bb-52ad-4518-b6bf-06615ec34f3b None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:50.523787 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa9a99-6648-45eb-8fa2-d26f35e9b15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:50.524803 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa9a99-6648-45eb-8fa2-d26f35e9b15e None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:50.525297 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa9a99-6648-45eb-8fa2-d26f35e9b15e None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:50.525760 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa9a99-6648-45eb-8fa2-d26f35e9b15e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:50.556753 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 183/363] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:50.557973 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1947d-4b4d-4cfb-b894-877cf209bbe3 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:50.605408 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa9a99-6648-45eb-8fa2-d26f35e9b15e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:50.607093 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa9a99-6648-45eb-8fa2-d26f35e9b15e None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:50.674895 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1947d-4b4d-4cfb-b894-877cf209bbe3 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:50.720783 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e92509-47ab-42c7-b6dd-13f29d0906df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:50.721654 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e92509-47ab-42c7-b6dd-13f29d0906df None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:50.721931 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e92509-47ab-42c7-b6dd-13f29d0906df None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:50.722195 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e92509-47ab-42c7-b6dd-13f29d0906df None admin] PATH_INFO: `/v3/groups/717a058098c241a6b0bf522096228df1` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:50.723431 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e92509-47ab-42c7-b6dd-13f29d0906df None admin] RBAC: Authorizing `identity:get_group(group_id=717a058098c241a6b0bf522096228df1)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:50.724946 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e92509-47ab-42c7-b6dd-13f29d0906df None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:50.727106 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 184/364] 10.222.0.32 () {56 vars in 1180 bytes} [Tue Apr 12 02:50:50 2022] GET /identity/v3/groups/717a058098c241a6b0bf522096228df1 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:50.727406 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e92509-47ab-42c7-b6dd-13f29d0906df None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:50.735990 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 181/365] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:50:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:50:50.737544 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa9a99-6648-45eb-8fa2-d26f35e9b15e None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:50.852846 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e92509-47ab-42c7-b6dd-13f29d0906df None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:50.866998 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa9a99-6648-45eb-8fa2-d26f35e9b15e None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:50.894619 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc550c-05d6-4360-b636-71c36d75e44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:50.895597 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc550c-05d6-4360-b636-71c36d75e44c None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:50.896132 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc550c-05d6-4360-b636-71c36d75e44c None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:50.896418 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc550c-05d6-4360-b636-71c36d75e44c None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:50.897192 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc550c-05d6-4360-b636-71c36d75e44c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:50.897500 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc550c-05d6-4360-b636-71c36d75e44c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:50.898915 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc550c-05d6-4360-b636-71c36d75e44c None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:50.909013 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebb6ce-51f0-42ee-993e-ae87cd137c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:50.909817 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebb6ce-51f0-42ee-993e-ae87cd137c37 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:50.910089 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebb6ce-51f0-42ee-993e-ae87cd137c37 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:50.910542 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 185/366] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:50:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:50.910647 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebb6ce-51f0-42ee-993e-ae87cd137c37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:50.911285 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc550c-05d6-4360-b636-71c36d75e44c None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:50.924186 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceebb6ce-51f0-42ee-993e-ae87cd137c37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:50.931115 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-ceebb6ce-51f0-42ee-993e-ae87cd137c37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 02:50:50.932697 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 182/367] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 02:50:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:50.934011 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebb6ce-51f0-42ee-993e-ae87cd137c37 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:51.035629 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc550c-05d6-4360-b636-71c36d75e44c None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:51.054857 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebb6ce-51f0-42ee-993e-ae87cd137c37 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:51.071972 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8442d0-9bc5-4667-95bf-0cb133a91721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:51.072639 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8442d0-9bc5-4667-95bf-0cb133a91721 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:51.072921 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8442d0-9bc5-4667-95bf-0cb133a91721 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:51.073239 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8442d0-9bc5-4667-95bf-0cb133a91721 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:51.074467 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8442d0-9bc5-4667-95bf-0cb133a91721 None admin] RBAC: Adding query filter params (group.id=717a058098c241a6b0bf522096228df1, role.id=0a31c1ce37fa41deb4908731f772414b, scope.project.id=3085add0984c4b339583bce0299f7cc3) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:51.074789 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8442d0-9bc5-4667-95bf-0cb133a91721 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:51.077328 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8442d0-9bc5-4667-95bf-0cb133a91721 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:51.083184 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 186/368] 10.222.0.32 () {56 vars in 1376 bytes} [Tue Apr 12 02:50:50 2022] GET /identity/v3/role_assignments?group.id=717a058098c241a6b0bf522096228df1&scope.project.id=3085add0984c4b339583bce0299f7cc3&role.id=0a31c1ce37fa41deb4908731f772414b => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:51.084027 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8442d0-9bc5-4667-95bf-0cb133a91721 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:51.096324 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fb196-36f9-46d9-838d-07658b103d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:51.097196 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fb196-36f9-46d9-838d-07658b103d2d None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:51.097473 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fb196-36f9-46d9-838d-07658b103d2d None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:51.097739 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fb196-36f9-46d9-838d-07658b103d2d None admin] PATH_INFO: `/v3/projects/020fd75d07c34b109048207eb8e5fd24` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:51.099918 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88fb196-36f9-46d9-838d-07658b103d2d None admin] RBAC: Authorizing `identity:get_project(project_id=020fd75d07c34b109048207eb8e5fd24)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:51.101362 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88fb196-36f9-46d9-838d-07658b103d2d None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:51.103283 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 183/369] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:50 2022] GET /identity/v3/projects/020fd75d07c34b109048207eb8e5fd24 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:51.103941 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fb196-36f9-46d9-838d-07658b103d2d None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:51.205524 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8442d0-9bc5-4667-95bf-0cb133a91721 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:51.209640 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fb196-36f9-46d9-838d-07658b103d2d None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:51.249400 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0155c6-17d9-4b47-bd1b-ac9cbb122a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:51.250056 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0155c6-17d9-4b47-bd1b-ac9cbb122a4d None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:51.250329 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0155c6-17d9-4b47-bd1b-ac9cbb122a4d None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:51.250599 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0155c6-17d9-4b47-bd1b-ac9cbb122a4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:51.255900 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61eb411-b7cc-4fb1-a6b0-da236f75454f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:51.256579 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eb411-b7cc-4fb1-a6b0-da236f75454f None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:51.256855 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eb411-b7cc-4fb1-a6b0-da236f75454f None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:51.257121 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eb411-b7cc-4fb1-a6b0-da236f75454f None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:51.257948 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61eb411-b7cc-4fb1-a6b0-da236f75454f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:51.258249 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61eb411-b7cc-4fb1-a6b0-da236f75454f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:51.259677 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61eb411-b7cc-4fb1-a6b0-da236f75454f None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:51.268884 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 184/370] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:50:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:51.269760 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61eb411-b7cc-4fb1-a6b0-da236f75454f None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:51.325315 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0155c6-17d9-4b47-bd1b-ac9cbb122a4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:51.326464 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0155c6-17d9-4b47-bd1b-ac9cbb122a4d None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:51.379131 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61eb411-b7cc-4fb1-a6b0-da236f75454f None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:51.426776 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92811e37-8081-45a8-b628-ba8170f6aa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:51.427647 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92811e37-8081-45a8-b628-ba8170f6aa4f None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:51.427951 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92811e37-8081-45a8-b628-ba8170f6aa4f None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:51.428217 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92811e37-8081-45a8-b628-ba8170f6aa4f None admin] PATH_INFO: `/v3/groups/717a058098c241a6b0bf522096228df1` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:51.431354 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92811e37-8081-45a8-b628-ba8170f6aa4f None admin] RBAC: Authorizing `identity:get_group(group_id=717a058098c241a6b0bf522096228df1)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:51.432844 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92811e37-8081-45a8-b628-ba8170f6aa4f None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:51.434841 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 185/371] 10.222.0.32 () {56 vars in 1180 bytes} [Tue Apr 12 02:50:51 2022] GET /identity/v3/groups/717a058098c241a6b0bf522096228df1 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:51.435692 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92811e37-8081-45a8-b628-ba8170f6aa4f None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:51.456128 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 187/372] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:50:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:50:51.456999 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0155c6-17d9-4b47-bd1b-ac9cbb122a4d None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:51.553973 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92811e37-8081-45a8-b628-ba8170f6aa4f None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:51.578440 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0155c6-17d9-4b47-bd1b-ac9cbb122a4d None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:51.590566 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcea148-fda9-4e50-a4c9-88153336281e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:51.591226 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcea148-fda9-4e50-a4c9-88153336281e None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:51.591501 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcea148-fda9-4e50-a4c9-88153336281e None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:51.591801 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcea148-fda9-4e50-a4c9-88153336281e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:51.623256 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556fe25-3762-4fe4-828c-edf5cbf071b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:51.623941 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556fe25-3762-4fe4-828c-edf5cbf071b0 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:51.624273 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556fe25-3762-4fe4-828c-edf5cbf071b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:51.624560 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556fe25-3762-4fe4-828c-edf5cbf071b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:51.625447 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9556fe25-3762-4fe4-828c-edf5cbf071b0 None admin] RBAC: Adding query filter params (group.id=717a058098c241a6b0bf522096228df1, role.id=0a31c1ce37fa41deb4908731f772414b, scope.project.id=020fd75d07c34b109048207eb8e5fd24) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:51.625680 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9556fe25-3762-4fe4-828c-edf5cbf071b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:51.627218 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9556fe25-3762-4fe4-828c-edf5cbf071b0 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:51.634892 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 188/373] 10.222.0.32 () {56 vars in 1376 bytes} [Tue Apr 12 02:50:51 2022] GET /identity/v3/role_assignments?group.id=717a058098c241a6b0bf522096228df1&scope.project.id=020fd75d07c34b109048207eb8e5fd24&role.id=0a31c1ce37fa41deb4908731f772414b => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:51.636535 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556fe25-3762-4fe4-828c-edf5cbf071b0 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:51.674295 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcea148-fda9-4e50-a4c9-88153336281e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:51.676279 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcea148-fda9-4e50-a4c9-88153336281e None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:51.743126 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556fe25-3762-4fe4-828c-edf5cbf071b0 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:51.778392 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d1375-312e-4ba8-a9df-fc34f9daf2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:51.779264 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d1375-312e-4ba8-a9df-fc34f9daf2d6 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:51.779541 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d1375-312e-4ba8-a9df-fc34f9daf2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:51.779841 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d1375-312e-4ba8-a9df-fc34f9daf2d6 None admin] PATH_INFO: `/v3/projects/020fd75d07c34b109048207eb8e5fd24` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:51.781118 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d1375-312e-4ba8-a9df-fc34f9daf2d6 None admin] RBAC: Authorizing `identity:get_project(project_id=020fd75d07c34b109048207eb8e5fd24)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:51.782652 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 186/374] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:50:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:50:51.787330 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d1375-312e-4ba8-a9df-fc34f9daf2d6 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:51.787330 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 189/375] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:51 2022] GET /identity/v3/projects/020fd75d07c34b109048207eb8e5fd24 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:51.788552 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcea148-fda9-4e50-a4c9-88153336281e None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:51.792800 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d1375-312e-4ba8-a9df-fc34f9daf2d6 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:51.895096 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcea148-fda9-4e50-a4c9-88153336281e None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:51.930822 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adcd38-2624-43fc-b4e1-35c0b34d6afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:51.932156 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adcd38-2624-43fc-b4e1-35c0b34d6afe None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:51.932603 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adcd38-2624-43fc-b4e1-35c0b34d6afe None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:51.933130 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adcd38-2624-43fc-b4e1-35c0b34d6afe None admin] PATH_INFO: `/v3/projects/c0c2ded0aef5404894a48ce0d4dafe72` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:51.934545 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3adcd38-2624-43fc-b4e1-35c0b34d6afe None admin] RBAC: Authorizing `identity:get_project(project_id=c0c2ded0aef5404894a48ce0d4dafe72)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:51.936252 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3adcd38-2624-43fc-b4e1-35c0b34d6afe None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:51.937327 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d1375-312e-4ba8-a9df-fc34f9daf2d6 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:51.938650 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 187/376] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:51 2022] GET /identity/v3/projects/c0c2ded0aef5404894a48ce0d4dafe72 => generated 344 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:51.944186 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adcd38-2624-43fc-b4e1-35c0b34d6afe None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:51.973053 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc558f2a-af1d-444b-ab84-a0b585a65a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:51.973957 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc558f2a-af1d-444b-ab84-a0b585a65a33 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:51.974303 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc558f2a-af1d-444b-ab84-a0b585a65a33 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:51.974643 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc558f2a-af1d-444b-ab84-a0b585a65a33 None admin] PATH_INFO: `/v3/groups/717a058098c241a6b0bf522096228df1` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:51.976505 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc558f2a-af1d-444b-ab84-a0b585a65a33 None admin] RBAC: Authorizing `identity:get_group(group_id=717a058098c241a6b0bf522096228df1)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:51.977964 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc558f2a-af1d-444b-ab84-a0b585a65a33 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:51.979608 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 190/377] 10.222.0.32 () {56 vars in 1180 bytes} [Tue Apr 12 02:50:51 2022] GET /identity/v3/groups/717a058098c241a6b0bf522096228df1 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:51.986943 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc558f2a-af1d-444b-ab84-a0b585a65a33 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:52.057085 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adcd38-2624-43fc-b4e1-35c0b34d6afe None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:52.091667 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e2c1b-3753-4d5e-bf20-27b310ce0633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:52.093432 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e2c1b-3753-4d5e-bf20-27b310ce0633 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:52.093884 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e2c1b-3753-4d5e-bf20-27b310ce0633 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:52.094321 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e2c1b-3753-4d5e-bf20-27b310ce0633 None admin] PATH_INFO: `/v3/groups/a324a9683aa24edc849085f68651eead` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:52.100607 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e2c1b-3753-4d5e-bf20-27b310ce0633 None admin] RBAC: Authorizing `identity:get_group(group_id=a324a9683aa24edc849085f68651eead)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:52.102493 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e2c1b-3753-4d5e-bf20-27b310ce0633 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:52.104716 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 188/378] 10.222.0.32 () {56 vars in 1180 bytes} [Tue Apr 12 02:50:51 2022] GET /identity/v3/groups/a324a9683aa24edc849085f68651eead => generated 229 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:50:52.108181 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc558f2a-af1d-444b-ab84-a0b585a65a33 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:52.110887 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e2c1b-3753-4d5e-bf20-27b310ce0633 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:52.156401 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb907093-8cc6-4ce6-af2a-99609fde45aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:52.156980 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb907093-8cc6-4ce6-af2a-99609fde45aa None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:52.157258 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb907093-8cc6-4ce6-af2a-99609fde45aa None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:52.157579 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb907093-8cc6-4ce6-af2a-99609fde45aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:52.159548 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb907093-8cc6-4ce6-af2a-99609fde45aa None admin] RBAC: Adding query filter params (group.id=717a058098c241a6b0bf522096228df1, role.id=60b6ad9d4f6d40b4a37fb5045c7f4523, scope.project.id=020fd75d07c34b109048207eb8e5fd24) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:52.159548 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb907093-8cc6-4ce6-af2a-99609fde45aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:52.160701 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb907093-8cc6-4ce6-af2a-99609fde45aa None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:52.171749 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 191/379] 10.222.0.32 () {56 vars in 1376 bytes} [Tue Apr 12 02:50:51 2022] GET /identity/v3/role_assignments?group.id=717a058098c241a6b0bf522096228df1&scope.project.id=020fd75d07c34b109048207eb8e5fd24&role.id=60b6ad9d4f6d40b4a37fb5045c7f4523 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:50:52.228335 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e2c1b-3753-4d5e-bf20-27b310ce0633 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:52.274459 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1db2a-5526-49d8-a604-a9df7abe4222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:52.275158 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1db2a-5526-49d8-a604-a9df7abe4222 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:52.275436 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1db2a-5526-49d8-a604-a9df7abe4222 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:52.275705 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1db2a-5526-49d8-a604-a9df7abe4222 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:52.276573 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1db2a-5526-49d8-a604-a9df7abe4222 None admin] RBAC: Adding query filter params (group.id=a324a9683aa24edc849085f68651eead, role.id=c0f19d3800f44637822d5162ffe4b497, scope.project.id=c0c2ded0aef5404894a48ce0d4dafe72) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:52.276948 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1db2a-5526-49d8-a604-a9df7abe4222 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:52.278413 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1db2a-5526-49d8-a604-a9df7abe4222 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:52.285259 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 189/380] 10.222.0.32 () {56 vars in 1376 bytes} [Tue Apr 12 02:50:52 2022] GET /identity/v3/role_assignments?group.id=a324a9683aa24edc849085f68651eead&scope.project.id=c0c2ded0aef5404894a48ce0d4dafe72&role.id=c0f19d3800f44637822d5162ffe4b497 => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:50:53.068134 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f58c0-a814-4f35-bd60-ff693164ac9f None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:53.068658 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f58c0-a814-4f35-bd60-ff693164ac9f None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:53.068658 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f58c0-a814-4f35-bd60-ff693164ac9f None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:53.070350 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 192/381] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:53.085574 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edda0b-3f02-4215-9a02-25ea81413cf5 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:53.086148 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edda0b-3f02-4215-9a02-25ea81413cf5 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:53.086606 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edda0b-3f02-4215-9a02-25ea81413cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:53.107643 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-36edda0b-3f02-4215-9a02-25ea81413cf5 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:53.109220 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-36edda0b-3f02-4215-9a02-25ea81413cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:53.186869 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 190/382] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:53.228532 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f58c0-a814-4f35-bd60-ff693164ac9f None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:53.346466 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f58c0-a814-4f35-bd60-ff693164ac9f None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:53.396167 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787caa7a-dd3d-49cc-b3d4-54d473641b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:53.397330 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787caa7a-dd3d-49cc-b3d4-54d473641b18 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:53.397779 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787caa7a-dd3d-49cc-b3d4-54d473641b18 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:53.398210 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787caa7a-dd3d-49cc-b3d4-54d473641b18 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:53.415011 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787caa7a-dd3d-49cc-b3d4-54d473641b18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:53.426122 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-787caa7a-dd3d-49cc-b3d4-54d473641b18 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 02:50:53.427950 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 193/383] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 02:50:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:53.434530 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36edda0b-3f02-4215-9a02-25ea81413cf5 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:53.545092 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36edda0b-3f02-4215-9a02-25ea81413cf5 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:53.589098 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb7c04-6f69-4e43-b423-226689bc66de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:53.590524 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb7c04-6f69-4e43-b423-226689bc66de None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:53.590979 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb7c04-6f69-4e43-b423-226689bc66de None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:53.591427 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb7c04-6f69-4e43-b423-226689bc66de None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:53.592369 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb7c04-6f69-4e43-b423-226689bc66de None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:53.592837 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb7c04-6f69-4e43-b423-226689bc66de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:53.594430 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb7c04-6f69-4e43-b423-226689bc66de None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:53.613120 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 191/384] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:50:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:53.620133 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787caa7a-dd3d-49cc-b3d4-54d473641b18 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:53.731760 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2a002-6e81-470b-9fcd-dfe05a14ef61 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:53.732141 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2a002-6e81-470b-9fcd-dfe05a14ef61 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:53.732484 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2a002-6e81-470b-9fcd-dfe05a14ef61 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:53.734239 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 192/385] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:50:53.741471 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787caa7a-dd3d-49cc-b3d4-54d473641b18 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:53.758257 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caadb43a-72bc-4c74-8bda-2c93cd962d35 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:53.758513 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caadb43a-72bc-4c74-8bda-2c93cd962d35 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:53.758783 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caadb43a-72bc-4c74-8bda-2c93cd962d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:53.778547 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f95551-61d8-4fb3-83f4-5f56d2f3c785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:53.779645 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f95551-61d8-4fb3-83f4-5f56d2f3c785 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:53.780087 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f95551-61d8-4fb3-83f4-5f56d2f3c785 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:53.780488 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f95551-61d8-4fb3-83f4-5f56d2f3c785 None admin] PATH_INFO: `/v3/groups/717a058098c241a6b0bf522096228df1` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:53.781802 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f95551-61d8-4fb3-83f4-5f56d2f3c785 None admin] RBAC: Authorizing `identity:get_group(group_id=717a058098c241a6b0bf522096228df1)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:53.783379 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f95551-61d8-4fb3-83f4-5f56d2f3c785 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:53.785166 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 194/386] 10.222.0.32 () {56 vars in 1180 bytes} [Tue Apr 12 02:50:53 2022] GET /identity/v3/groups/717a058098c241a6b0bf522096228df1 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:53.790698 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f95551-61d8-4fb3-83f4-5f56d2f3c785 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:53.804756 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-caadb43a-72bc-4c74-8bda-2c93cd962d35 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:53.806807 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-caadb43a-72bc-4c74-8bda-2c93cd962d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:53.884104 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 193/387] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:53.909690 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caadb43a-72bc-4c74-8bda-2c93cd962d35 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:53.952667 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f95551-61d8-4fb3-83f4-5f56d2f3c785 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:53.985866 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f59db-33a7-45b5-8d6d-92f2f6d9d7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:53.986986 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f59db-33a7-45b5-8d6d-92f2f6d9d7ce None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:53.987449 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f59db-33a7-45b5-8d6d-92f2f6d9d7ce None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:53.987877 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f59db-33a7-45b5-8d6d-92f2f6d9d7ce None admin] PATH_INFO: `/v3/projects/3085add0984c4b339583bce0299f7cc3` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:53.989222 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f59db-33a7-45b5-8d6d-92f2f6d9d7ce None admin] RBAC: Authorizing `identity:get_project(project_id=3085add0984c4b339583bce0299f7cc3)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:53.990824 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f59db-33a7-45b5-8d6d-92f2f6d9d7ce None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:53.992980 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 195/388] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:53 2022] GET /identity/v3/projects/3085add0984c4b339583bce0299f7cc3 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:50:53.998725 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f59db-33a7-45b5-8d6d-92f2f6d9d7ce None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:54.064846 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caadb43a-72bc-4c74-8bda-2c93cd962d35 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:54.097174 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f59db-33a7-45b5-8d6d-92f2f6d9d7ce None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:54.113061 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03753120-4cc4-4a01-ba84-c82ca389ffa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:54.113883 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03753120-4cc4-4a01-ba84-c82ca389ffa5 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:54.114166 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03753120-4cc4-4a01-ba84-c82ca389ffa5 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:54.114428 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03753120-4cc4-4a01-ba84-c82ca389ffa5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:54.133510 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d20bf-ea13-4c79-a574-7645c9c4b792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:54.134688 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d20bf-ea13-4c79-a574-7645c9c4b792 None admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:54.135109 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d20bf-ea13-4c79-a574-7645c9c4b792 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:54.135512 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d20bf-ea13-4c79-a574-7645c9c4b792 None admin] PATH_INFO: `/v3/projects/3085add0984c4b339583bce0299f7cc3/groups/717a058098c241a6b0bf522096228df1/roles/60b6ad9d4f6d40b4a37fb5045c7f4523` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:54.136437 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03753120-4cc4-4a01-ba84-c82ca389ffa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:54.138297 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d20bf-ea13-4c79-a574-7645c9c4b792 None admin] RBAC: Authorizing `identity:create_grant(project_id=3085add0984c4b339583bce0299f7cc3, group_id=717a058098c241a6b0bf522096228df1, role_id=60b6ad9d4f6d40b4a37fb5045c7f4523)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:54.139941 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d20bf-ea13-4c79-a574-7645c9c4b792 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:54.143472 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-03753120-4cc4-4a01-ba84-c82ca389ffa5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 02:50:54.148770 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 194/389] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:50:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:50:54.155558 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03753120-4cc4-4a01-ba84-c82ca389ffa5 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:54.161390 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 196/390] 10.222.0.32 () {58 vars in 1442 bytes} [Tue Apr 12 02:50:53 2022] PUT /identity/v3/projects/3085add0984c4b339583bce0299f7cc3/groups/717a058098c241a6b0bf522096228df1/roles/60b6ad9d4f6d40b4a37fb5045c7f4523 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 02:50:54.286018 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03753120-4cc4-4a01-ba84-c82ca389ffa5 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:54.323227 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282f0e3-0526-4255-8665-990746a912af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:54.324039 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282f0e3-0526-4255-8665-990746a912af None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:54.324400 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282f0e3-0526-4255-8665-990746a912af None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:54.324691 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282f0e3-0526-4255-8665-990746a912af None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:54.325453 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282f0e3-0526-4255-8665-990746a912af None admin] RBAC: Adding query filter params (name=member) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:54.325752 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282f0e3-0526-4255-8665-990746a912af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:54.327152 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282f0e3-0526-4255-8665-990746a912af None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:54.340057 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 195/391] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 02:50:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:54.347065 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d20bf-ea13-4c79-a574-7645c9c4b792 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:54.465197 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d20bf-ea13-4c79-a574-7645c9c4b792 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:54.500611 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b3922-cdf1-48b8-8170-42294d75005f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:54.501861 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b3922-cdf1-48b8-8170-42294d75005f None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:54.502326 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b3922-cdf1-48b8-8170-42294d75005f None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:54.502777 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b3922-cdf1-48b8-8170-42294d75005f None admin] PATH_INFO: `/v3/groups/717a058098c241a6b0bf522096228df1` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:54.504287 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b3922-cdf1-48b8-8170-42294d75005f None admin] RBAC: Authorizing `identity:get_group(group_id=717a058098c241a6b0bf522096228df1)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:54.505969 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b3922-cdf1-48b8-8170-42294d75005f None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:54.508289 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 197/392] 10.222.0.32 () {56 vars in 1180 bytes} [Tue Apr 12 02:50:54 2022] GET /identity/v3/groups/717a058098c241a6b0bf522096228df1 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:54.514249 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282f0e3-0526-4255-8665-990746a912af None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:54.664763 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282f0e3-0526-4255-8665-990746a912af None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:54.713313 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb94ff-2d88-4c93-9fbf-4e8a20dd02c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:54.714180 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb94ff-2d88-4c93-9fbf-4e8a20dd02c0 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:54.714515 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb94ff-2d88-4c93-9fbf-4e8a20dd02c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:54.714780 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb94ff-2d88-4c93-9fbf-4e8a20dd02c0 None admin] PATH_INFO: `/v3/projects/3085add0984c4b339583bce0299f7cc3` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:54.716061 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb94ff-2d88-4c93-9fbf-4e8a20dd02c0 None admin] RBAC: Authorizing `identity:get_project(project_id=3085add0984c4b339583bce0299f7cc3)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:54.717433 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb94ff-2d88-4c93-9fbf-4e8a20dd02c0 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:54.719344 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 196/393] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:54 2022] GET /identity/v3/projects/3085add0984c4b339583bce0299f7cc3 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:54.725641 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b3922-cdf1-48b8-8170-42294d75005f None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:54.825014 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b3922-cdf1-48b8-8170-42294d75005f None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:54.871170 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaeb24e-2728-4c25-9c20-e5f1ad4e655c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:54.872762 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaeb24e-2728-4c25-9c20-e5f1ad4e655c None admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:54.873231 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaeb24e-2728-4c25-9c20-e5f1ad4e655c None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:54.873714 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaeb24e-2728-4c25-9c20-e5f1ad4e655c None admin] PATH_INFO: `/v3/projects/3085add0984c4b339583bce0299f7cc3/groups/717a058098c241a6b0bf522096228df1/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:54.877479 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaeb24e-2728-4c25-9c20-e5f1ad4e655c None admin] RBAC: Authorizing `identity:create_grant(project_id=3085add0984c4b339583bce0299f7cc3, group_id=717a058098c241a6b0bf522096228df1, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:54.879180 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaeb24e-2728-4c25-9c20-e5f1ad4e655c None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:54.897909 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 198/394] 10.222.0.32 () {58 vars in 1442 bytes} [Tue Apr 12 02:50:54 2022] PUT /identity/v3/projects/3085add0984c4b339583bce0299f7cc3/groups/717a058098c241a6b0bf522096228df1/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 02:50:54.945772 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653ecb0-5f3b-4282-a623-686d05089d65 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:54.946088 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653ecb0-5f3b-4282-a623-686d05089d65 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:54.946315 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653ecb0-5f3b-4282-a623-686d05089d65 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:54.948017 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 197/395] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:54.954390 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270c171-3501-4d2b-acca-b2ab5eba6a98 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:54.954936 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270c171-3501-4d2b-acca-b2ab5eba6a98 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:54.955397 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270c171-3501-4d2b-acca-b2ab5eba6a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:54.977757 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-9270c171-3501-4d2b-acca-b2ab5eba6a98 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:54.979395 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-9270c171-3501-4d2b-acca-b2ab5eba6a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:55.070493 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 199/396] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:55.107872 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653ecb0-5f3b-4282-a623-686d05089d65 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:55.232220 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653ecb0-5f3b-4282-a623-686d05089d65 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:55.267743 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee033cc4-0e30-47e3-a2ff-7e73d59552a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:55.268768 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee033cc4-0e30-47e3-a2ff-7e73d59552a6 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:55.269175 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee033cc4-0e30-47e3-a2ff-7e73d59552a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:55.269445 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee033cc4-0e30-47e3-a2ff-7e73d59552a6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:55.281728 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab098419-553a-4d2c-ae04-2a6a8cf7af67 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:55.282242 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab098419-553a-4d2c-ae04-2a6a8cf7af67 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:55.282242 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab098419-553a-4d2c-ae04-2a6a8cf7af67 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:55.283430 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee033cc4-0e30-47e3-a2ff-7e73d59552a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:55.283892 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 200/397] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:55.288817 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0dcff7-10a0-42d3-865c-e7897bf25c7c None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:55.289078 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0dcff7-10a0-42d3-865c-e7897bf25c7c None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:55.289342 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0dcff7-10a0-42d3-865c-e7897bf25c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:55.291165 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-ee033cc4-0e30-47e3-a2ff-7e73d59552a6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 02:50:55.292779 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 198/398] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:50:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:55.298833 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee033cc4-0e30-47e3-a2ff-7e73d59552a6 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:55.323458 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-ee0dcff7-10a0-42d3-865c-e7897bf25c7c None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:55.326575 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-ee0dcff7-10a0-42d3-865c-e7897bf25c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:55.452116 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 201/399] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 02:50:55.467306 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee033cc4-0e30-47e3-a2ff-7e73d59552a6 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:55.501097 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0dcff7-10a0-42d3-865c-e7897bf25c7c None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:55.510554 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8591be-1100-4ec2-8e37-7b120ebe5379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:55.511391 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8591be-1100-4ec2-8e37-7b120ebe5379 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:55.511812 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8591be-1100-4ec2-8e37-7b120ebe5379 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:55.512089 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8591be-1100-4ec2-8e37-7b120ebe5379 None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:55.512829 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8591be-1100-4ec2-8e37-7b120ebe5379 None admin] RBAC: Adding query filter params (name=member) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:55.513129 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8591be-1100-4ec2-8e37-7b120ebe5379 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:55.514494 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8591be-1100-4ec2-8e37-7b120ebe5379 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:55.527040 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 199/400] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 02:50:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:55.541698 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8591be-1100-4ec2-8e37-7b120ebe5379 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:55.640018 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0dcff7-10a0-42d3-865c-e7897bf25c7c None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:55.669674 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8591be-1100-4ec2-8e37-7b120ebe5379 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:55.672784 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4f6c7-436d-495e-9bdd-980df8a9de36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:55.673637 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4f6c7-436d-495e-9bdd-980df8a9de36 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:55.673909 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4f6c7-436d-495e-9bdd-980df8a9de36 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:55.674173 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4f6c7-436d-495e-9bdd-980df8a9de36 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:55.684454 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d4f6c7-436d-495e-9bdd-980df8a9de36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:55.692096 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-a0d4f6c7-436d-495e-9bdd-980df8a9de36 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 02:50:55.693632 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 202/401] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 02:50:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:50:55.694841 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4839f-f2c4-4bd8-b0a8-e42dfb30d397 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:55.695121 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4839f-f2c4-4bd8-b0a8-e42dfb30d397 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:55.695386 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4839f-f2c4-4bd8-b0a8-e42dfb30d397 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:55.702209 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 203/402] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:55.707075 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4839f-f2c4-4bd8-b0a8-e42dfb30d397 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:55.713011 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c77b49-c020-43ca-a668-4b20169b7f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:55.714273 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c77b49-c020-43ca-a668-4b20169b7f9a None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:55.715634 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c77b49-c020-43ca-a668-4b20169b7f9a None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:55.716152 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c77b49-c020-43ca-a668-4b20169b7f9a None admin] PATH_INFO: `/v3/groups/717a058098c241a6b0bf522096228df1` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:55.718144 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c77b49-c020-43ca-a668-4b20169b7f9a None admin] RBAC: Authorizing `identity:get_group(group_id=717a058098c241a6b0bf522096228df1)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:55.720508 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c77b49-c020-43ca-a668-4b20169b7f9a None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:55.723406 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 200/403] 10.222.0.32 () {56 vars in 1180 bytes} [Tue Apr 12 02:50:55 2022] GET /identity/v3/groups/717a058098c241a6b0bf522096228df1 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:55.724879 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37fcc2-0ead-4607-9b44-68be60763869 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:55.725369 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37fcc2-0ead-4607-9b44-68be60763869 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:55.725829 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37fcc2-0ead-4607-9b44-68be60763869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:55.745452 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-1d37fcc2-0ead-4607-9b44-68be60763869 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:55.747076 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-1d37fcc2-0ead-4607-9b44-68be60763869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:55.824062 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 201/404] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:55.824062 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37fcc2-0ead-4607-9b44-68be60763869 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:55.846377 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4839f-f2c4-4bd8-b0a8-e42dfb30d397 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:55.882136 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67def0-78c8-4ad7-9877-29ddaab9847b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:55.882843 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67def0-78c8-4ad7-9877-29ddaab9847b None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:55.883066 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67def0-78c8-4ad7-9877-29ddaab9847b None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:55.883444 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67def0-78c8-4ad7-9877-29ddaab9847b None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:55.884138 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67def0-78c8-4ad7-9877-29ddaab9847b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:55.884432 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67def0-78c8-4ad7-9877-29ddaab9847b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:55.885914 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67def0-78c8-4ad7-9877-29ddaab9847b None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:55.894973 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 204/405] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:50:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:55.901762 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67def0-78c8-4ad7-9877-29ddaab9847b None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:55.948814 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37fcc2-0ead-4607-9b44-68be60763869 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:55.990065 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52b5eb-5333-46a3-bfc2-42e96782c2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:55.991427 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52b5eb-5333-46a3-bfc2-42e96782c2b4 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:55.991891 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52b5eb-5333-46a3-bfc2-42e96782c2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:55.992293 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52b5eb-5333-46a3-bfc2-42e96782c2b4 None admin] PATH_INFO: `/v3/projects/020fd75d07c34b109048207eb8e5fd24` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:55.994069 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52b5eb-5333-46a3-bfc2-42e96782c2b4 None admin] RBAC: Authorizing `identity:get_project(project_id=020fd75d07c34b109048207eb8e5fd24)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:55.996305 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52b5eb-5333-46a3-bfc2-42e96782c2b4 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:56.002965 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 202/406] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:55 2022] GET /identity/v3/projects/020fd75d07c34b109048207eb8e5fd24 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:56.003433 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67def0-78c8-4ad7-9877-29ddaab9847b None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:56.003877 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52b5eb-5333-46a3-bfc2-42e96782c2b4 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:56.044190 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc53e9-b9d6-4c41-9594-7b8ac7d5b61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:56.045367 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc53e9-b9d6-4c41-9594-7b8ac7d5b61e None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:56.046237 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc53e9-b9d6-4c41-9594-7b8ac7d5b61e None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:56.046703 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc53e9-b9d6-4c41-9594-7b8ac7d5b61e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:56.059939 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc53e9-b9d6-4c41-9594-7b8ac7d5b61e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:56.069611 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-41dc53e9-b9d6-4c41-9594-7b8ac7d5b61e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 02:50:56.071228 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 205/407] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 02:50:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:56.072161 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc53e9-b9d6-4c41-9594-7b8ac7d5b61e None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:56.110959 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52b5eb-5333-46a3-bfc2-42e96782c2b4 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:56.144613 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b156f7-c208-4e40-8489-3f58cb11ef39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:56.145500 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b156f7-c208-4e40-8489-3f58cb11ef39 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:56.145730 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b156f7-c208-4e40-8489-3f58cb11ef39 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:56.146054 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b156f7-c208-4e40-8489-3f58cb11ef39 None admin] PATH_INFO: `/v3/groups/717a058098c241a6b0bf522096228df1` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:56.147277 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b156f7-c208-4e40-8489-3f58cb11ef39 None admin] RBAC: Authorizing `identity:get_group(group_id=717a058098c241a6b0bf522096228df1)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:56.148738 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b156f7-c208-4e40-8489-3f58cb11ef39 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:56.150361 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 203/408] 10.222.0.32 () {56 vars in 1180 bytes} [Tue Apr 12 02:50:56 2022] GET /identity/v3/groups/717a058098c241a6b0bf522096228df1 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:56.151112 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b156f7-c208-4e40-8489-3f58cb11ef39 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:56.184919 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc53e9-b9d6-4c41-9594-7b8ac7d5b61e None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:56.218652 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf06e3-54e3-4381-bc5d-216c85f4ec65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:56.219938 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf06e3-54e3-4381-bc5d-216c85f4ec65 None admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:56.220428 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf06e3-54e3-4381-bc5d-216c85f4ec65 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:56.220882 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf06e3-54e3-4381-bc5d-216c85f4ec65 None admin] PATH_INFO: `/v3/projects/020fd75d07c34b109048207eb8e5fd24/groups/717a058098c241a6b0bf522096228df1/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:56.223043 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf06e3-54e3-4381-bc5d-216c85f4ec65 None admin] RBAC: Authorizing `identity:create_grant(project_id=020fd75d07c34b109048207eb8e5fd24, group_id=717a058098c241a6b0bf522096228df1, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:56.224800 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf06e3-54e3-4381-bc5d-216c85f4ec65 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:56.244338 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 206/409] 10.222.0.32 () {58 vars in 1442 bytes} [Tue Apr 12 02:50:56 2022] PUT /identity/v3/projects/020fd75d07c34b109048207eb8e5fd24/groups/717a058098c241a6b0bf522096228df1/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 02:50:56.246163 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf06e3-54e3-4381-bc5d-216c85f4ec65 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:56.260074 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b156f7-c208-4e40-8489-3f58cb11ef39 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:56.329336 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d9082-b80e-46dc-accc-3c1f8a4be702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:56.330022 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d9082-b80e-46dc-accc-3c1f8a4be702 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:56.330287 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d9082-b80e-46dc-accc-3c1f8a4be702 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:56.330548 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d9082-b80e-46dc-accc-3c1f8a4be702 None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:56.331306 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d9082-b80e-46dc-accc-3c1f8a4be702 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:56.331603 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d9082-b80e-46dc-accc-3c1f8a4be702 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:56.333018 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d9082-b80e-46dc-accc-3c1f8a4be702 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:56.356034 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 204/410] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:50:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:56.359930 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d9082-b80e-46dc-accc-3c1f8a4be702 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:56.469345 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf06e3-54e3-4381-bc5d-216c85f4ec65 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:56.531346 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d459f56-8d70-454a-893d-1e280113906e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:56.532246 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d459f56-8d70-454a-893d-1e280113906e None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:56.532501 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d459f56-8d70-454a-893d-1e280113906e None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:56.532768 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d459f56-8d70-454a-893d-1e280113906e None admin] PATH_INFO: `/v3/projects/020fd75d07c34b109048207eb8e5fd24` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:56.538711 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d459f56-8d70-454a-893d-1e280113906e None admin] RBAC: Authorizing `identity:get_project(project_id=020fd75d07c34b109048207eb8e5fd24)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:56.538711 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d459f56-8d70-454a-893d-1e280113906e None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:56.542710 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 207/411] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:56 2022] GET /identity/v3/projects/020fd75d07c34b109048207eb8e5fd24 => generated 302 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:56.549908 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d459f56-8d70-454a-893d-1e280113906e None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:56.561977 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d9082-b80e-46dc-accc-3c1f8a4be702 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:56.637806 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bf2da-97d2-44c6-ab3f-6e3c96d8e856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:56.638672 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bf2da-97d2-44c6-ab3f-6e3c96d8e856 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:56.638944 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bf2da-97d2-44c6-ab3f-6e3c96d8e856 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:56.639212 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bf2da-97d2-44c6-ab3f-6e3c96d8e856 None admin] PATH_INFO: `/v3/groups/a324a9683aa24edc849085f68651eead` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:56.640432 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780bf2da-97d2-44c6-ab3f-6e3c96d8e856 None admin] RBAC: Authorizing `identity:get_group(group_id=a324a9683aa24edc849085f68651eead)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:56.641873 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780bf2da-97d2-44c6-ab3f-6e3c96d8e856 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:56.643813 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 205/412] 10.222.0.32 () {56 vars in 1180 bytes} [Tue Apr 12 02:50:56 2022] GET /identity/v3/groups/a324a9683aa24edc849085f68651eead => generated 229 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:50:56.655754 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bf2da-97d2-44c6-ab3f-6e3c96d8e856 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:56.753794 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d459f56-8d70-454a-893d-1e280113906e None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:56.818175 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bf2da-97d2-44c6-ab3f-6e3c96d8e856 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:56.829651 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57678f89-2b6a-4697-bc0e-9c4c4a68d8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:56.830554 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57678f89-2b6a-4697-bc0e-9c4c4a68d8cd None admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:56.830827 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57678f89-2b6a-4697-bc0e-9c4c4a68d8cd None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:56.831088 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57678f89-2b6a-4697-bc0e-9c4c4a68d8cd None admin] PATH_INFO: `/v3/projects/020fd75d07c34b109048207eb8e5fd24/groups/717a058098c241a6b0bf522096228df1/roles/60b6ad9d4f6d40b4a37fb5045c7f4523` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:56.833293 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57678f89-2b6a-4697-bc0e-9c4c4a68d8cd None admin] RBAC: Authorizing `identity:create_grant(project_id=020fd75d07c34b109048207eb8e5fd24, group_id=717a058098c241a6b0bf522096228df1, role_id=60b6ad9d4f6d40b4a37fb5045c7f4523)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:56.834752 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57678f89-2b6a-4697-bc0e-9c4c4a68d8cd None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:56.861078 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 208/413] 10.222.0.32 () {58 vars in 1442 bytes} [Tue Apr 12 02:50:56 2022] PUT /identity/v3/projects/020fd75d07c34b109048207eb8e5fd24/groups/717a058098c241a6b0bf522096228df1/roles/60b6ad9d4f6d40b4a37fb5045c7f4523 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 02:50:56.866008 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f481e8-391f-4dc2-bd4c-432696b649a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:56.868259 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f481e8-391f-4dc2-bd4c-432696b649a6 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:56.869188 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f481e8-391f-4dc2-bd4c-432696b649a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:56.869996 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f481e8-391f-4dc2-bd4c-432696b649a6 None admin] PATH_INFO: `/v3/projects/c0c2ded0aef5404894a48ce0d4dafe72` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:56.872190 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f481e8-391f-4dc2-bd4c-432696b649a6 None admin] RBAC: Authorizing `identity:get_project(project_id=c0c2ded0aef5404894a48ce0d4dafe72)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:56.873915 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f481e8-391f-4dc2-bd4c-432696b649a6 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:56.876732 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 206/414] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:56 2022] GET /identity/v3/projects/c0c2ded0aef5404894a48ce0d4dafe72 => generated 344 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:56.883998 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57678f89-2b6a-4697-bc0e-9c4c4a68d8cd None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:57.060280 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57678f89-2b6a-4697-bc0e-9c4c4a68d8cd None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:57.076274 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec0870-d71f-4375-b8e1-100c578b2bcf None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:57.076902 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec0870-d71f-4375-b8e1-100c578b2bcf None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:57.077361 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec0870-d71f-4375-b8e1-100c578b2bcf None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:57.079246 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 207/415] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:50:57.085385 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954bd77-aa42-4ec7-9691-79d95c119a01 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:57.086535 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954bd77-aa42-4ec7-9691-79d95c119a01 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:57.087001 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954bd77-aa42-4ec7-9691-79d95c119a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:57.119112 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-2954bd77-aa42-4ec7-9691-79d95c119a01 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:57.121672 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-2954bd77-aa42-4ec7-9691-79d95c119a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:57.125814 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b1fff-b9b0-4614-80ff-ce521bbd150d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:57.126707 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b1fff-b9b0-4614-80ff-ce521bbd150d None admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:57.126980 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b1fff-b9b0-4614-80ff-ce521bbd150d None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:57.127244 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b1fff-b9b0-4614-80ff-ce521bbd150d None admin] PATH_INFO: `/v3/projects/c0c2ded0aef5404894a48ce0d4dafe72/groups/a324a9683aa24edc849085f68651eead/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:57.129635 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b1fff-b9b0-4614-80ff-ce521bbd150d None admin] RBAC: Authorizing `identity:create_grant(project_id=c0c2ded0aef5404894a48ce0d4dafe72, group_id=a324a9683aa24edc849085f68651eead, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:57.131604 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b1fff-b9b0-4614-80ff-ce521bbd150d None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:57.162259 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 209/416] 10.222.0.32 () {58 vars in 1442 bytes} [Tue Apr 12 02:50:56 2022] PUT /identity/v3/projects/c0c2ded0aef5404894a48ce0d4dafe72/groups/a324a9683aa24edc849085f68651eead/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 02:50:57.217009 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 208/417] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:57.243315 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b1fff-b9b0-4614-80ff-ce521bbd150d None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:57.365723 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b1fff-b9b0-4614-80ff-ce521bbd150d None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:57.402086 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b97121-2984-480c-acb1-f9c111d932ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:57.403315 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b97121-2984-480c-acb1-f9c111d932ea None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:57.403786 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b97121-2984-480c-acb1-f9c111d932ea None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:57.404181 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b97121-2984-480c-acb1-f9c111d932ea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:57.415261 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b97121-2984-480c-acb1-f9c111d932ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:57.422965 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-79b97121-2984-480c-acb1-f9c111d932ea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 02:50:57.424727 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 210/418] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 02:50:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:57.430229 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954bd77-aa42-4ec7-9691-79d95c119a01 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:57.539279 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954bd77-aa42-4ec7-9691-79d95c119a01 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:57.583132 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e377f8-f933-4b0b-be99-f79f8ada4f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:57.583916 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e377f8-f933-4b0b-be99-f79f8ada4f8d None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:57.584093 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e377f8-f933-4b0b-be99-f79f8ada4f8d None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:57.584361 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e377f8-f933-4b0b-be99-f79f8ada4f8d None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:57.585111 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e377f8-f933-4b0b-be99-f79f8ada4f8d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:57.585412 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e377f8-f933-4b0b-be99-f79f8ada4f8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:57.586781 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e377f8-f933-4b0b-be99-f79f8ada4f8d None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:57.596104 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 209/419] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:50:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:57.613107 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b97121-2984-480c-acb1-f9c111d932ea None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:57.719401 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b97121-2984-480c-acb1-f9c111d932ea None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:57.754469 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580e889-a7fd-4541-b363-01234828fe05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:57.755490 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580e889-a7fd-4541-b363-01234828fe05 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:57.755981 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580e889-a7fd-4541-b363-01234828fe05 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:57.756437 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580e889-a7fd-4541-b363-01234828fe05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:57.825466 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6580e889-a7fd-4541-b363-01234828fe05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:57.827293 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6580e889-a7fd-4541-b363-01234828fe05 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:57.832871 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c907310-2b66-4799-913b-9089bf3c9e2a None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:57.833152 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c907310-2b66-4799-913b-9089bf3c9e2a None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:57.833424 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c907310-2b66-4799-913b-9089bf3c9e2a None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:57.834808 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 210/420] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:50:57.849227 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b2742-3928-4ce5-8d18-9f1fd5ff58ea None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:57.849575 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b2742-3928-4ce5-8d18-9f1fd5ff58ea None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:57.849761 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b2742-3928-4ce5-8d18-9f1fd5ff58ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:57.884779 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-040b2742-3928-4ce5-8d18-9f1fd5ff58ea None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:57.885958 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-040b2742-3928-4ce5-8d18-9f1fd5ff58ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:57.930126 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 211/421] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:50:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:50:57.937214 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580e889-a7fd-4541-b363-01234828fe05 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:58.038483 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580e889-a7fd-4541-b363-01234828fe05 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:58.044068 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 211/422] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:50:58.071196 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b2742-3928-4ce5-8d18-9f1fd5ff58ea None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:58.082272 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c42c1a-79e5-4bb5-969a-789f623c093d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:58.083539 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c42c1a-79e5-4bb5-969a-789f623c093d None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:58.084017 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c42c1a-79e5-4bb5-969a-789f623c093d None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:58.084537 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c42c1a-79e5-4bb5-969a-789f623c093d None admin] PATH_INFO: `/v3/projects/3085add0984c4b339583bce0299f7cc3` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:58.085995 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c42c1a-79e5-4bb5-969a-789f623c093d None admin] RBAC: Authorizing `identity:get_project(project_id=3085add0984c4b339583bce0299f7cc3)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:58.087635 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c42c1a-79e5-4bb5-969a-789f623c093d None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:58.092630 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 212/423] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:57 2022] GET /identity/v3/projects/3085add0984c4b339583bce0299f7cc3 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:58.097645 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c42c1a-79e5-4bb5-969a-789f623c093d None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:58.235750 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b2742-3928-4ce5-8d18-9f1fd5ff58ea None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:58.271085 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c42c1a-79e5-4bb5-969a-789f623c093d None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:58.305612 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2600c0e-e244-451f-afbe-07c50c8a55f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:58.306852 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2600c0e-e244-451f-afbe-07c50c8a55f1 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:58.307360 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2600c0e-e244-451f-afbe-07c50c8a55f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:58.307919 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2600c0e-e244-451f-afbe-07c50c8a55f1 None admin] PATH_INFO: `/v3/groups/717a058098c241a6b0bf522096228df1` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:58.309823 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2600c0e-e244-451f-afbe-07c50c8a55f1 None admin] RBAC: Authorizing `identity:get_group(group_id=717a058098c241a6b0bf522096228df1)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:58.311627 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2600c0e-e244-451f-afbe-07c50c8a55f1 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:58.313886 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 213/424] 10.222.0.32 () {56 vars in 1180 bytes} [Tue Apr 12 02:50:58 2022] GET /identity/v3/groups/717a058098c241a6b0bf522096228df1 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:50:58.314305 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71c9b2-9c9d-451e-b6d9-2c96f829e80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:58.314813 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71c9b2-9c9d-451e-b6d9-2c96f829e80b None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:58.315083 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71c9b2-9c9d-451e-b6d9-2c96f829e80b None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:58.315346 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71c9b2-9c9d-451e-b6d9-2c96f829e80b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:58.324489 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2600c0e-e244-451f-afbe-07c50c8a55f1 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:58.348742 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71c9b2-9c9d-451e-b6d9-2c96f829e80b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:58.356092 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-3c71c9b2-9c9d-451e-b6d9-2c96f829e80b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 02:50:58.357369 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 212/425] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:50:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:50:58.367195 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71c9b2-9c9d-451e-b6d9-2c96f829e80b None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:58.428279 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2600c0e-e244-451f-afbe-07c50c8a55f1 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:58.482161 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79791f85-c03a-4575-bd8e-20db90a48489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:58.483230 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79791f85-c03a-4575-bd8e-20db90a48489 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:58.483715 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79791f85-c03a-4575-bd8e-20db90a48489 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:58.484188 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79791f85-c03a-4575-bd8e-20db90a48489 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:58.485203 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79791f85-c03a-4575-bd8e-20db90a48489 None admin] RBAC: Adding query filter params (group.id=717a058098c241a6b0bf522096228df1, role.id=60b6ad9d4f6d40b4a37fb5045c7f4523, scope.project.id=3085add0984c4b339583bce0299f7cc3) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:58.485863 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79791f85-c03a-4575-bd8e-20db90a48489 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:58.488803 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79791f85-c03a-4575-bd8e-20db90a48489 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:58.502842 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 214/426] 10.222.0.32 () {56 vars in 1376 bytes} [Tue Apr 12 02:50:58 2022] GET /identity/v3/role_assignments?group.id=717a058098c241a6b0bf522096228df1&scope.project.id=3085add0984c4b339583bce0299f7cc3&role.id=60b6ad9d4f6d40b4a37fb5045c7f4523 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:58.561091 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71c9b2-9c9d-451e-b6d9-2c96f829e80b None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:58.610358 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2c8bb-7d5f-40e6-84f2-b7017734b974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:58.611065 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2c8bb-7d5f-40e6-84f2-b7017734b974 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:58.611291 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2c8bb-7d5f-40e6-84f2-b7017734b974 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:58.611551 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2c8bb-7d5f-40e6-84f2-b7017734b974 None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:58.612320 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2c8bb-7d5f-40e6-84f2-b7017734b974 None admin] RBAC: Adding query filter params (name=member) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:58.612612 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2c8bb-7d5f-40e6-84f2-b7017734b974 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:58.613972 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2c8bb-7d5f-40e6-84f2-b7017734b974 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:58.625830 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 213/427] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 02:50:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:58.631628 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79791f85-c03a-4575-bd8e-20db90a48489 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:58.752646 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79791f85-c03a-4575-bd8e-20db90a48489 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:58.804077 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276210c5-4f5a-4a13-9704-ba8e09ca815f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:58.804742 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276210c5-4f5a-4a13-9704-ba8e09ca815f None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:58.805068 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276210c5-4f5a-4a13-9704-ba8e09ca815f None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:58.805337 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276210c5-4f5a-4a13-9704-ba8e09ca815f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:58.898633 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276210c5-4f5a-4a13-9704-ba8e09ca815f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:58.900059 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276210c5-4f5a-4a13-9704-ba8e09ca815f None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:59.010044 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 215/428] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:50:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:50:59.015681 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2c8bb-7d5f-40e6-84f2-b7017734b974 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:59.125981 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2c8bb-7d5f-40e6-84f2-b7017734b974 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:59.163904 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef44501-d57c-4070-b726-f428f0bbb3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:59.164699 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef44501-d57c-4070-b726-f428f0bbb3f7 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:59.164971 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef44501-d57c-4070-b726-f428f0bbb3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:59.165233 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef44501-d57c-4070-b726-f428f0bbb3f7 None admin] PATH_INFO: `/v3/projects/3085add0984c4b339583bce0299f7cc3` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:59.166414 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef44501-d57c-4070-b726-f428f0bbb3f7 None admin] RBAC: Authorizing `identity:get_project(project_id=3085add0984c4b339583bce0299f7cc3)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:59.168229 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef44501-d57c-4070-b726-f428f0bbb3f7 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:59.170235 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 214/429] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:50:59 2022] GET /identity/v3/projects/3085add0984c4b339583bce0299f7cc3 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:50:59.176013 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276210c5-4f5a-4a13-9704-ba8e09ca815f None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:59.184773 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f7ac3-7e51-418f-9886-23cbf01f1619 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:59.185343 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f7ac3-7e51-418f-9886-23cbf01f1619 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:59.185814 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f7ac3-7e51-418f-9886-23cbf01f1619 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:59.187578 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 215/430] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:50:59.192898 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c104d0a-093d-4bc8-9e4f-d99163edfa25 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:59.193437 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c104d0a-093d-4bc8-9e4f-d99163edfa25 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:59.193929 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c104d0a-093d-4bc8-9e4f-d99163edfa25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:59.215338 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-8c104d0a-093d-4bc8-9e4f-d99163edfa25 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:59.217333 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-8c104d0a-093d-4bc8-9e4f-d99163edfa25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:59.285304 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276210c5-4f5a-4a13-9704-ba8e09ca815f None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:59.296638 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 216/431] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 02:50:59.316435 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c104d0a-093d-4bc8-9e4f-d99163edfa25 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:59.320219 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa01be-9f85-4adf-a1d9-90ff5a6f5180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:59.321318 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa01be-9f85-4adf-a1d9-90ff5a6f5180 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:59.321903 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa01be-9f85-4adf-a1d9-90ff5a6f5180 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:59.322415 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa01be-9f85-4adf-a1d9-90ff5a6f5180 None admin] PATH_INFO: `/v3/groups/717a058098c241a6b0bf522096228df1` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:59.323901 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa01be-9f85-4adf-a1d9-90ff5a6f5180 None admin] RBAC: Authorizing `identity:get_group(group_id=717a058098c241a6b0bf522096228df1)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:59.325547 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa01be-9f85-4adf-a1d9-90ff5a6f5180 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:59.331954 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 216/432] 10.222.0.32 () {56 vars in 1180 bytes} [Tue Apr 12 02:50:59 2022] GET /identity/v3/groups/717a058098c241a6b0bf522096228df1 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:59.333896 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa01be-9f85-4adf-a1d9-90ff5a6f5180 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:59.411756 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c104d0a-093d-4bc8-9e4f-d99163edfa25 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:59.431489 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa01be-9f85-4adf-a1d9-90ff5a6f5180 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:59.446815 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08164475-1ffd-4e84-a402-fcfd95be118e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:59.447627 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08164475-1ffd-4e84-a402-fcfd95be118e None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:59.447926 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08164475-1ffd-4e84-a402-fcfd95be118e None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:59.448186 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08164475-1ffd-4e84-a402-fcfd95be118e None admin] PATH_INFO: `/v3/roles/member` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:59.461592 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08164475-1ffd-4e84-a402-fcfd95be118e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:50:59.468660 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-08164475-1ffd-4e84-a402-fcfd95be118e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 02:50:59.470194 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 217/433] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:50:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:50:59.475612 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08164475-1ffd-4e84-a402-fcfd95be118e None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:59.483210 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa139ed-a95f-43cd-a21d-7ab55ca8be92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:59.483976 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa139ed-a95f-43cd-a21d-7ab55ca8be92 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:59.484257 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa139ed-a95f-43cd-a21d-7ab55ca8be92 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:59.484522 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa139ed-a95f-43cd-a21d-7ab55ca8be92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:59.485443 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa139ed-a95f-43cd-a21d-7ab55ca8be92 None admin] RBAC: Adding query filter params (group.id=717a058098c241a6b0bf522096228df1, role.id=0a31c1ce37fa41deb4908731f772414b, scope.project.id=3085add0984c4b339583bce0299f7cc3) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:59.485727 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa139ed-a95f-43cd-a21d-7ab55ca8be92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:59.487190 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa139ed-a95f-43cd-a21d-7ab55ca8be92 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:59.500278 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 217/434] 10.222.0.32 () {56 vars in 1376 bytes} [Tue Apr 12 02:50:59 2022] GET /identity/v3/role_assignments?group.id=717a058098c241a6b0bf522096228df1&scope.project.id=3085add0984c4b339583bce0299f7cc3&role.id=0a31c1ce37fa41deb4908731f772414b => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:50:59.605054 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08164475-1ffd-4e84-a402-fcfd95be118e None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:59.640109 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434bbcd-b3a5-401c-86b4-7160e2288770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:59.640824 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434bbcd-b3a5-401c-86b4-7160e2288770 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:59.641057 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434bbcd-b3a5-401c-86b4-7160e2288770 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:59.641323 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434bbcd-b3a5-401c-86b4-7160e2288770 None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:59.642075 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2434bbcd-b3a5-401c-86b4-7160e2288770 None admin] RBAC: Adding query filter params (name=member) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:50:59.642371 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2434bbcd-b3a5-401c-86b4-7160e2288770 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:59.643780 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2434bbcd-b3a5-401c-86b4-7160e2288770 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:59.653423 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 218/435] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 02:50:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:50:59.659153 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa139ed-a95f-43cd-a21d-7ab55ca8be92 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:50:59.774251 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa139ed-a95f-43cd-a21d-7ab55ca8be92 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:50:59.807438 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e90b6-98d0-4e96-a2f5-06e4fa6226f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:50:59.808211 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e90b6-98d0-4e96-a2f5-06e4fa6226f5 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:59.808481 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e90b6-98d0-4e96-a2f5-06e4fa6226f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:59.808750 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e90b6-98d0-4e96-a2f5-06e4fa6226f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:59.812743 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81164279-5f33-4e24-9538-4f9f0523c96d None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:59.813018 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81164279-5f33-4e24-9538-4f9f0523c96d None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:59.813284 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81164279-5f33-4e24-9538-4f9f0523c96d None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:59.814703 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 219/436] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:50:59.820946 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d7c7c-efdd-45de-a7ea-83bee63d6ed9 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:50:59.821214 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d7c7c-efdd-45de-a7ea-83bee63d6ed9 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:50:59.821480 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d7c7c-efdd-45de-a7ea-83bee63d6ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:50:59.848582 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-aa6d7c7c-efdd-45de-a7ea-83bee63d6ed9 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:50:59.849749 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-aa6d7c7c-efdd-45de-a7ea-83bee63d6ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:50:59.894408 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e90b6-98d0-4e96-a2f5-06e4fa6226f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:50:59.898348 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e90b6-98d0-4e96-a2f5-06e4fa6226f5 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:50:59.935407 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 220/437] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:50:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 02:50:59.959840 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d7c7c-efdd-45de-a7ea-83bee63d6ed9 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:00.015220 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 218/438] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:50:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:51:00.020487 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e90b6-98d0-4e96-a2f5-06e4fa6226f5 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:00.063048 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d7c7c-efdd-45de-a7ea-83bee63d6ed9 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:00.107154 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ef2d4-4808-4a78-af1f-6ce9f262eab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:00.108240 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ef2d4-4808-4a78-af1f-6ce9f262eab8 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:00.108949 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ef2d4-4808-4a78-af1f-6ce9f262eab8 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:00.109222 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ef2d4-4808-4a78-af1f-6ce9f262eab8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:00.119677 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ef2d4-4808-4a78-af1f-6ce9f262eab8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:51:00.125906 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e90b6-98d0-4e96-a2f5-06e4fa6226f5 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:00.127328 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-638ef2d4-4808-4a78-af1f-6ce9f262eab8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 02:51:00.128598 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 221/439] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 02:50:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:51:00.129817 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5bb33-7deb-4d29-9023-3c3cfe5c73a0 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:00.130087 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5bb33-7deb-4d29-9023-3c3cfe5c73a0 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:00.130351 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5bb33-7deb-4d29-9023-3c3cfe5c73a0 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:00.131840 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 222/440] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:00.136550 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5bb33-7deb-4d29-9023-3c3cfe5c73a0 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:00.169577 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a9c4d-316f-4667-b9f8-54c7d6e377c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:00.170445 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a9c4d-316f-4667-b9f8-54c7d6e377c9 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:00.170721 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a9c4d-316f-4667-b9f8-54c7d6e377c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:00.170987 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a9c4d-316f-4667-b9f8-54c7d6e377c9 None admin] PATH_INFO: `/v3/projects/020fd75d07c34b109048207eb8e5fd24` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:00.172280 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a9c4d-316f-4667-b9f8-54c7d6e377c9 None admin] RBAC: Authorizing `identity:get_project(project_id=020fd75d07c34b109048207eb8e5fd24)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:00.173742 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a9c4d-316f-4667-b9f8-54c7d6e377c9 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:00.175759 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 219/441] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:51:00 2022] GET /identity/v3/projects/020fd75d07c34b109048207eb8e5fd24 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:00.176692 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f61b6-e6a1-4d9b-911a-d54b402c4d64 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:00.176977 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f61b6-e6a1-4d9b-911a-d54b402c4d64 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:00.177242 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f61b6-e6a1-4d9b-911a-d54b402c4d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:00.193369 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-2f5f61b6-e6a1-4d9b-911a-d54b402c4d64 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:00.194530 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-2f5f61b6-e6a1-4d9b-911a-d54b402c4d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:00.241224 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5bb33-7deb-4d29-9023-3c3cfe5c73a0 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:00.259517 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 220/442] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:51:00.260158 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f61b6-e6a1-4d9b-911a-d54b402c4d64 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:00.277540 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f4f42-3fe0-4d1e-bee6-5d8dac881d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:00.278200 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f4f42-3fe0-4d1e-bee6-5d8dac881d34 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:00.278472 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f4f42-3fe0-4d1e-bee6-5d8dac881d34 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:00.278733 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f4f42-3fe0-4d1e-bee6-5d8dac881d34 None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:00.279464 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f4f42-3fe0-4d1e-bee6-5d8dac881d34 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:00.279779 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f4f42-3fe0-4d1e-bee6-5d8dac881d34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:00.281142 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f4f42-3fe0-4d1e-bee6-5d8dac881d34 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:00.289301 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 223/443] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:51:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:00.290085 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f4f42-3fe0-4d1e-bee6-5d8dac881d34 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:00.358329 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f61b6-e6a1-4d9b-911a-d54b402c4d64 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:00.382943 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f4f42-3fe0-4d1e-bee6-5d8dac881d34 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:00.391940 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a7694-9787-4bb4-bb50-6cafce732355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:00.392843 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a7694-9787-4bb4-bb50-6cafce732355 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:00.393116 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a7694-9787-4bb4-bb50-6cafce732355 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:00.393481 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a7694-9787-4bb4-bb50-6cafce732355 None admin] PATH_INFO: `/v3/groups/717a058098c241a6b0bf522096228df1` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:00.395088 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a7694-9787-4bb4-bb50-6cafce732355 None admin] RBAC: Authorizing `identity:get_group(group_id=717a058098c241a6b0bf522096228df1)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:00.396570 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a7694-9787-4bb4-bb50-6cafce732355 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:00.399076 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 221/444] 10.222.0.32 () {56 vars in 1180 bytes} [Tue Apr 12 02:51:00 2022] GET /identity/v3/groups/717a058098c241a6b0bf522096228df1 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:00.399953 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a7694-9787-4bb4-bb50-6cafce732355 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:00.416908 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547acd7-6959-4844-a715-1c51a1789faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:00.418851 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547acd7-6959-4844-a715-1c51a1789faa None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:00.419120 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547acd7-6959-4844-a715-1c51a1789faa None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:00.419459 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547acd7-6959-4844-a715-1c51a1789faa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:00.429252 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547acd7-6959-4844-a715-1c51a1789faa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:51:00.435989 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-1547acd7-6959-4844-a715-1c51a1789faa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 02:51:00.437140 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 224/445] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 02:51:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:00.437889 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547acd7-6959-4844-a715-1c51a1789faa None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:00.497858 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a7694-9787-4bb4-bb50-6cafce732355 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:00.530532 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64acd7cb-c169-4c97-a272-e692dfad551f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:00.530737 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547acd7-6959-4844-a715-1c51a1789faa None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:00.531182 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64acd7cb-c169-4c97-a272-e692dfad551f None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:00.531458 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64acd7cb-c169-4c97-a272-e692dfad551f None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:00.531748 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64acd7cb-c169-4c97-a272-e692dfad551f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:00.562339 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8da00-b2df-4095-b698-e6aa78be72d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:00.562981 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8da00-b2df-4095-b698-e6aa78be72d7 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:00.563253 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8da00-b2df-4095-b698-e6aa78be72d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:00.563518 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8da00-b2df-4095-b698-e6aa78be72d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:00.564377 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8da00-b2df-4095-b698-e6aa78be72d7 None admin] RBAC: Adding query filter params (group.id=717a058098c241a6b0bf522096228df1, role.id=0a31c1ce37fa41deb4908731f772414b, scope.project.id=020fd75d07c34b109048207eb8e5fd24) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:00.564683 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8da00-b2df-4095-b698-e6aa78be72d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:00.566108 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8da00-b2df-4095-b698-e6aa78be72d7 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:00.571674 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 225/446] 10.222.0.32 () {56 vars in 1376 bytes} [Tue Apr 12 02:51:00 2022] GET /identity/v3/role_assignments?group.id=717a058098c241a6b0bf522096228df1&scope.project.id=020fd75d07c34b109048207eb8e5fd24&role.id=0a31c1ce37fa41deb4908731f772414b => generated 611 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:00.574396 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8da00-b2df-4095-b698-e6aa78be72d7 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:00.599687 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64acd7cb-c169-4c97-a272-e692dfad551f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:00.602014 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64acd7cb-c169-4c97-a272-e692dfad551f None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:00.681146 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8da00-b2df-4095-b698-e6aa78be72d7 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:00.703382 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 222/447] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:51:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:51:00.709289 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64acd7cb-c169-4c97-a272-e692dfad551f None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:00.722377 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2453f8-720d-4cea-9291-97bef9d50f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:00.723050 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2453f8-720d-4cea-9291-97bef9d50f6a None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:00.723359 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2453f8-720d-4cea-9291-97bef9d50f6a None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:00.723598 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2453f8-720d-4cea-9291-97bef9d50f6a None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:00.724381 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2453f8-720d-4cea-9291-97bef9d50f6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:00.724676 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2453f8-720d-4cea-9291-97bef9d50f6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:00.726048 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2453f8-720d-4cea-9291-97bef9d50f6a None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:00.739364 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 226/448] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:51:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:00.740599 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2453f8-720d-4cea-9291-97bef9d50f6a None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:00.813897 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64acd7cb-c169-4c97-a272-e692dfad551f None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:00.845821 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2453f8-720d-4cea-9291-97bef9d50f6a None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:00.858689 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72a4ef-1a06-4d14-b383-b67d8980bfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:00.859571 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72a4ef-1a06-4d14-b383-b67d8980bfda None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:00.859867 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72a4ef-1a06-4d14-b383-b67d8980bfda None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:00.860130 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72a4ef-1a06-4d14-b383-b67d8980bfda None admin] PATH_INFO: `/v3/projects/020fd75d07c34b109048207eb8e5fd24` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:00.861570 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72a4ef-1a06-4d14-b383-b67d8980bfda None admin] RBAC: Authorizing `identity:get_project(project_id=020fd75d07c34b109048207eb8e5fd24)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:00.864133 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72a4ef-1a06-4d14-b383-b67d8980bfda None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:00.865886 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 223/449] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:51:00 2022] GET /identity/v3/projects/020fd75d07c34b109048207eb8e5fd24 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:51:00.871909 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72a4ef-1a06-4d14-b383-b67d8980bfda None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:00.885593 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51361aec-a5bd-4b9c-bf9a-ae37b39f712c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:00.886186 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51361aec-a5bd-4b9c-bf9a-ae37b39f712c None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:00.886473 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51361aec-a5bd-4b9c-bf9a-ae37b39f712c None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:00.886744 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51361aec-a5bd-4b9c-bf9a-ae37b39f712c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:00.966284 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51361aec-a5bd-4b9c-bf9a-ae37b39f712c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:00.967749 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51361aec-a5bd-4b9c-bf9a-ae37b39f712c None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:00.994893 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72a4ef-1a06-4d14-b383-b67d8980bfda None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:01.026754 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e4186-4ff4-4867-8a76-c0396e36dff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:01.027698 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e4186-4ff4-4867-8a76-c0396e36dff5 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:01.028013 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e4186-4ff4-4867-8a76-c0396e36dff5 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:01.028275 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e4186-4ff4-4867-8a76-c0396e36dff5 None admin] PATH_INFO: `/v3/groups/717a058098c241a6b0bf522096228df1` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:01.029531 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e4186-4ff4-4867-8a76-c0396e36dff5 None admin] RBAC: Authorizing `identity:get_group(group_id=717a058098c241a6b0bf522096228df1)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:01.030984 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e4186-4ff4-4867-8a76-c0396e36dff5 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:01.032618 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 224/450] 10.222.0.32 () {56 vars in 1180 bytes} [Tue Apr 12 02:51:00 2022] GET /identity/v3/groups/717a058098c241a6b0bf522096228df1 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:01.038378 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e4186-4ff4-4867-8a76-c0396e36dff5 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:01.061577 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 227/451] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:51:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:51:01.067118 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51361aec-a5bd-4b9c-bf9a-ae37b39f712c None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:01.135124 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e4186-4ff4-4867-8a76-c0396e36dff5 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:01.160279 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51361aec-a5bd-4b9c-bf9a-ae37b39f712c None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:01.166352 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a654840-68ed-4749-b83f-3dea13666507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:01.166996 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a654840-68ed-4749-b83f-3dea13666507 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:01.167407 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a654840-68ed-4749-b83f-3dea13666507 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:01.167775 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a654840-68ed-4749-b83f-3dea13666507 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:01.168599 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a654840-68ed-4749-b83f-3dea13666507 None admin] RBAC: Adding query filter params (group.id=717a058098c241a6b0bf522096228df1, role.id=60b6ad9d4f6d40b4a37fb5045c7f4523, scope.project.id=020fd75d07c34b109048207eb8e5fd24) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:01.168896 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a654840-68ed-4749-b83f-3dea13666507 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:01.170332 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a654840-68ed-4749-b83f-3dea13666507 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:01.175898 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 225/452] 10.222.0.32 () {56 vars in 1376 bytes} [Tue Apr 12 02:51:01 2022] GET /identity/v3/role_assignments?group.id=717a058098c241a6b0bf522096228df1&scope.project.id=020fd75d07c34b109048207eb8e5fd24&role.id=60b6ad9d4f6d40b4a37fb5045c7f4523 => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:01.194852 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb27fc6-24a2-4406-a25a-20a2503630c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:01.195757 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb27fc6-24a2-4406-a25a-20a2503630c1 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:01.196029 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb27fc6-24a2-4406-a25a-20a2503630c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:01.196297 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb27fc6-24a2-4406-a25a-20a2503630c1 None admin] PATH_INFO: `/v3/projects/c0c2ded0aef5404894a48ce0d4dafe72` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:01.197592 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb27fc6-24a2-4406-a25a-20a2503630c1 None admin] RBAC: Authorizing `identity:get_project(project_id=c0c2ded0aef5404894a48ce0d4dafe72)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:01.199183 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb27fc6-24a2-4406-a25a-20a2503630c1 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:01.201154 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 228/453] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:51:01 2022] GET /identity/v3/projects/c0c2ded0aef5404894a48ce0d4dafe72 => generated 344 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:51:01.207470 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a654840-68ed-4749-b83f-3dea13666507 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:01.324554 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a654840-68ed-4749-b83f-3dea13666507 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:01.360356 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77252e44-06cd-4504-b173-edf80b30a75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:01.361196 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77252e44-06cd-4504-b173-edf80b30a75a None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:01.361471 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77252e44-06cd-4504-b173-edf80b30a75a None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:01.361740 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77252e44-06cd-4504-b173-edf80b30a75a None admin] PATH_INFO: `/v3/groups/a324a9683aa24edc849085f68651eead` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:01.362955 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77252e44-06cd-4504-b173-edf80b30a75a None admin] RBAC: Authorizing `identity:get_group(group_id=a324a9683aa24edc849085f68651eead)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:01.364509 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77252e44-06cd-4504-b173-edf80b30a75a None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:01.366312 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 226/454] 10.222.0.32 () {56 vars in 1180 bytes} [Tue Apr 12 02:51:01 2022] GET /identity/v3/groups/a324a9683aa24edc849085f68651eead => generated 229 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:01.372404 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb27fc6-24a2-4406-a25a-20a2503630c1 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:01.468069 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb27fc6-24a2-4406-a25a-20a2503630c1 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:01.500801 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97adbf27-0a6e-4403-8532-7a36df85ae6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:01.501453 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adbf27-0a6e-4403-8532-7a36df85ae6a None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:01.501681 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adbf27-0a6e-4403-8532-7a36df85ae6a None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:01.501973 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adbf27-0a6e-4403-8532-7a36df85ae6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:01.502808 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97adbf27-0a6e-4403-8532-7a36df85ae6a None admin] RBAC: Adding query filter params (group.id=a324a9683aa24edc849085f68651eead, role.id=c0f19d3800f44637822d5162ffe4b497, scope.project.id=c0c2ded0aef5404894a48ce0d4dafe72) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:01.503115 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97adbf27-0a6e-4403-8532-7a36df85ae6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:01.504587 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97adbf27-0a6e-4403-8532-7a36df85ae6a None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:01.510802 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 229/455] 10.222.0.32 () {56 vars in 1376 bytes} [Tue Apr 12 02:51:01 2022] GET /identity/v3/role_assignments?group.id=a324a9683aa24edc849085f68651eead&scope.project.id=c0c2ded0aef5404894a48ce0d4dafe72&role.id=c0f19d3800f44637822d5162ffe4b497 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:04.197224 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3557bc-4a21-4d6e-aa3c-9b5e7c3f42de None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:04.198088 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3557bc-4a21-4d6e-aa3c-9b5e7c3f42de None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:04.198707 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3557bc-4a21-4d6e-aa3c-9b5e7c3f42de None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:04.200497 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 227/456] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:04.206413 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9841d-287e-4851-91fc-ce4c1c767283 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:04.207207 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9841d-287e-4851-91fc-ce4c1c767283 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:04.207611 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9841d-287e-4851-91fc-ce4c1c767283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:04.224795 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-32c9841d-287e-4851-91fc-ce4c1c767283 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:04.226183 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-32c9841d-287e-4851-91fc-ce4c1c767283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:04.310448 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 230/457] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 02:51:04.348428 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3557bc-4a21-4d6e-aa3c-9b5e7c3f42de None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:04.447596 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87cfb5-af9a-44ab-9438-e6db543c5855 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:04.448433 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87cfb5-af9a-44ab-9438-e6db543c5855 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:04.448960 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87cfb5-af9a-44ab-9438-e6db543c5855 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:04.451302 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 231/458] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:04.455998 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49cf312-c44c-4fa7-850b-c8ef6bbdf113 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:04.456515 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49cf312-c44c-4fa7-850b-c8ef6bbdf113 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:04.457010 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49cf312-c44c-4fa7-850b-c8ef6bbdf113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:04.484031 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-b49cf312-c44c-4fa7-850b-c8ef6bbdf113 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:04.486482 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-b49cf312-c44c-4fa7-850b-c8ef6bbdf113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:04.505395 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3557bc-4a21-4d6e-aa3c-9b5e7c3f42de None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:04.554218 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2b17a-488d-4af3-b312-c5c063e62df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:04.555015 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2b17a-488d-4af3-b312-c5c063e62df1 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:04.555287 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2b17a-488d-4af3-b312-c5c063e62df1 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:04.555552 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2b17a-488d-4af3-b312-c5c063e62df1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:04.568622 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2b17a-488d-4af3-b312-c5c063e62df1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:04.570405 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2b17a-488d-4af3-b312-c5c063e62df1 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:04.571519 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 232/459] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:51:04.573224 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e93e19-9339-498f-9938-6b0cde53d2d7 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:04.573781 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e93e19-9339-498f-9938-6b0cde53d2d7 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:04.574239 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e93e19-9339-498f-9938-6b0cde53d2d7 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:04.576011 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 233/460] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:04.582046 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be787f0-376d-4d06-84c0-958e83bdb019 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:04.584064 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be787f0-376d-4d06-84c0-958e83bdb019 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:04.584526 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be787f0-376d-4d06-84c0-958e83bdb019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:04.603668 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-a1b2b17a-488d-4af3-b312-c5c063e62df1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:04.606473 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 228/461] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:04.610505 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2b17a-488d-4af3-b312-c5c063e62df1 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:04.623168 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-7be787f0-376d-4d06-84c0-958e83bdb019 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:04.624656 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-7be787f0-376d-4d06-84c0-958e83bdb019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:04.694725 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 234/462] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:51:04.696076 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be787f0-376d-4d06-84c0-958e83bdb019 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:04.751130 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2b17a-488d-4af3-b312-c5c063e62df1 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:04.783582 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa8a9d-2188-4ebe-bf73-56d8d9c47109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:04.784772 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa8a9d-2188-4ebe-bf73-56d8d9c47109 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:04.785507 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa8a9d-2188-4ebe-bf73-56d8d9c47109 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:04.785969 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa8a9d-2188-4ebe-bf73-56d8d9c47109 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:04.796737 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa8a9d-2188-4ebe-bf73-56d8d9c47109 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:04.798514 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa8a9d-2188-4ebe-bf73-56d8d9c47109 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:04.815290 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-10aa8a9d-2188-4ebe-bf73-56d8d9c47109 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:04.817293 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 229/463] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:04.818268 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa8a9d-2188-4ebe-bf73-56d8d9c47109 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:04.827503 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be787f0-376d-4d06-84c0-958e83bdb019 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:04.861494 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139481c4-4754-44b3-9f0a-42178be9e1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:04.862496 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139481c4-4754-44b3-9f0a-42178be9e1ed None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:04.862967 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139481c4-4754-44b3-9f0a-42178be9e1ed None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:04.863447 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139481c4-4754-44b3-9f0a-42178be9e1ed None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:04.864407 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139481c4-4754-44b3-9f0a-42178be9e1ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:04.864911 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139481c4-4754-44b3-9f0a-42178be9e1ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:04.866467 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139481c4-4754-44b3-9f0a-42178be9e1ed None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:04.882156 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 235/464] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:04.883303 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139481c4-4754-44b3-9f0a-42178be9e1ed None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:04.929234 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa8a9d-2188-4ebe-bf73-56d8d9c47109 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:04.964252 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b31fb-5625-4033-8916-f3621b97280a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:04.965525 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b31fb-5625-4033-8916-f3621b97280a None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:04.966065 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b31fb-5625-4033-8916-f3621b97280a None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:04.966535 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b31fb-5625-4033-8916-f3621b97280a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:04.984054 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b31fb-5625-4033-8916-f3621b97280a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:04.985752 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b31fb-5625-4033-8916-f3621b97280a None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:05.001553 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139481c4-4754-44b3-9f0a-42178be9e1ed None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:05.006466 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-6b3b31fb-5625-4033-8916-f3621b97280a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:05.011955 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 230/465] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:05.014891 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b31fb-5625-4033-8916-f3621b97280a None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:05.040122 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa85ef-4afe-4d56-bd43-4857ca62b98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:05.041014 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa85ef-4afe-4d56-bd43-4857ca62b98f None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:05.041431 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa85ef-4afe-4d56-bd43-4857ca62b98f None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:05.041847 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa85ef-4afe-4d56-bd43-4857ca62b98f None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:05.043012 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa85ef-4afe-4d56-bd43-4857ca62b98f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:05.043547 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa85ef-4afe-4d56-bd43-4857ca62b98f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:05.045180 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa85ef-4afe-4d56-bd43-4857ca62b98f None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:05.058222 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 236/466] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:05.059345 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa85ef-4afe-4d56-bd43-4857ca62b98f None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:05.123578 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b31fb-5625-4033-8916-f3621b97280a None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:05.156855 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa85ef-4afe-4d56-bd43-4857ca62b98f None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:05.162291 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1ec63-32e0-45c5-8985-40c97ddfe03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:05.162965 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1ec63-32e0-45c5-8985-40c97ddfe03f None admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:05.163240 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1ec63-32e0-45c5-8985-40c97ddfe03f None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:05.163507 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1ec63-32e0-45c5-8985-40c97ddfe03f None admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:05.164238 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1ec63-32e0-45c5-8985-40c97ddfe03f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:05.166129 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1ec63-32e0-45c5-8985-40c97ddfe03f None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:05.189447 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 231/467] 10.222.0.32 () {60 vars in 1132 bytes} [Tue Apr 12 02:51:05 2022] POST /identity/v3/users => generated 246 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 02:51:05.190239 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1ec63-32e0-45c5-8985-40c97ddfe03f None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:05.193141 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac2122-bb25-4e85-8929-6c1b0ecf163a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:05.194923 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac2122-bb25-4e85-8929-6c1b0ecf163a None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:05.195385 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac2122-bb25-4e85-8929-6c1b0ecf163a None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:05.195807 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac2122-bb25-4e85-8929-6c1b0ecf163a None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:05.196722 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac2122-bb25-4e85-8929-6c1b0ecf163a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:05.197177 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac2122-bb25-4e85-8929-6c1b0ecf163a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:05.198905 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac2122-bb25-4e85-8929-6c1b0ecf163a None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:05.223547 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 237/468] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:05.225173 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad52a3f-d020-46bd-88dc-7ecb9a917cc4 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:05.225455 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad52a3f-d020-46bd-88dc-7ecb9a917cc4 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:05.225727 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad52a3f-d020-46bd-88dc-7ecb9a917cc4 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:05.231993 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 238/469] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:05.233096 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad52a3f-d020-46bd-88dc-7ecb9a917cc4 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:05.300890 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1ec63-32e0-45c5-8985-40c97ddfe03f None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:05.337287 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1899c7-2989-487e-a787-c4ac15b1ea63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:05.338258 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1899c7-2989-487e-a787-c4ac15b1ea63 None admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:05.338668 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1899c7-2989-487e-a787-c4ac15b1ea63 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:05.339151 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1899c7-2989-487e-a787-c4ac15b1ea63 None admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:05.340078 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1899c7-2989-487e-a787-c4ac15b1ea63 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:05.341792 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1899c7-2989-487e-a787-c4ac15b1ea63 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:05.367481 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad52a3f-d020-46bd-88dc-7ecb9a917cc4 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:05.367700 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 232/470] 10.222.0.32 () {60 vars in 1132 bytes} [Tue Apr 12 02:51:05 2022] POST /identity/v3/users => generated 248 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 02:51:05.369548 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62d4a3-5b84-41a1-b29b-8a12776ec9aa None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:05.369988 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62d4a3-5b84-41a1-b29b-8a12776ec9aa None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:05.371563 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62d4a3-5b84-41a1-b29b-8a12776ec9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:05.394421 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-6f62d4a3-5b84-41a1-b29b-8a12776ec9aa None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:05.395899 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-6f62d4a3-5b84-41a1-b29b-8a12776ec9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:05.411239 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183053e-ce36-47da-a3e9-49dd68a703bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:05.412129 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183053e-ce36-47da-a3e9-49dd68a703bb None admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:05.412858 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183053e-ce36-47da-a3e9-49dd68a703bb None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:05.412858 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183053e-ce36-47da-a3e9-49dd68a703bb None admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:05.413705 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f183053e-ce36-47da-a3e9-49dd68a703bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:05.415421 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f183053e-ce36-47da-a3e9-49dd68a703bb None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:05.443353 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 239/471] 10.222.0.32 () {60 vars in 1132 bytes} [Tue Apr 12 02:51:05 2022] POST /identity/v3/users => generated 248 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 02:51:05.474463 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 233/472] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:51:05.503091 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183053e-ce36-47da-a3e9-49dd68a703bb None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:05.625098 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183053e-ce36-47da-a3e9-49dd68a703bb None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:05.663456 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59a415-4e3d-449b-a4a4-198d9f2735ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:05.664288 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59a415-4e3d-449b-a4a4-198d9f2735ce None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:05.664563 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59a415-4e3d-449b-a4a4-198d9f2735ce None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:05.664826 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59a415-4e3d-449b-a4a4-198d9f2735ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:05.676740 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59a415-4e3d-449b-a4a4-198d9f2735ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:05.678214 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59a415-4e3d-449b-a4a4-198d9f2735ce None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:05.694981 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-3c59a415-4e3d-449b-a4a4-198d9f2735ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:05.696552 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 240/473] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:05.702405 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62d4a3-5b84-41a1-b29b-8a12776ec9aa None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:05.803194 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62d4a3-5b84-41a1-b29b-8a12776ec9aa None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:05.837788 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337106f-e3bf-4fc8-bed6-a18a05e8669b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:05.838812 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337106f-e3bf-4fc8-bed6-a18a05e8669b None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:05.839394 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337106f-e3bf-4fc8-bed6-a18a05e8669b None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:05.839911 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337106f-e3bf-4fc8-bed6-a18a05e8669b None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:05.840824 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337106f-e3bf-4fc8-bed6-a18a05e8669b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:05.841316 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337106f-e3bf-4fc8-bed6-a18a05e8669b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:05.842907 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337106f-e3bf-4fc8-bed6-a18a05e8669b None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:05.855509 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 234/474] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:05.860698 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59a415-4e3d-449b-a4a4-198d9f2735ce None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:05.938230 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55803e-c7fc-49d1-a447-8eba83115bb0 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:05.938850 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55803e-c7fc-49d1-a447-8eba83115bb0 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:05.939342 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55803e-c7fc-49d1-a447-8eba83115bb0 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:05.944601 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 235/475] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:05.945964 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2317c49-89ca-4945-8bf6-92f9dd8240a8 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:05.946443 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2317c49-89ca-4945-8bf6-92f9dd8240a8 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:05.946930 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2317c49-89ca-4945-8bf6-92f9dd8240a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:05.976973 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-d2317c49-89ca-4945-8bf6-92f9dd8240a8 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:05.978459 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-d2317c49-89ca-4945-8bf6-92f9dd8240a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:05.987761 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59a415-4e3d-449b-a4a4-198d9f2735ce None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:06.024384 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee6770-2600-4613-8955-34d2bc13776c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:06.025066 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee6770-2600-4613-8955-34d2bc13776c None admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:06.025341 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee6770-2600-4613-8955-34d2bc13776c None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:06.025610 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee6770-2600-4613-8955-34d2bc13776c None admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:06.026316 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee6770-2600-4613-8955-34d2bc13776c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:06.027846 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee6770-2600-4613-8955-34d2bc13776c None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:06.063646 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 241/476] 10.222.0.32 () {60 vars in 1132 bytes} [Tue Apr 12 02:51:05 2022] POST /identity/v3/users => generated 249 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 02:51:06.090441 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 236/477] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:51:06.141902 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee6770-2600-4613-8955-34d2bc13776c None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:06.253766 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee6770-2600-4613-8955-34d2bc13776c None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:06.288296 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f5265-05d0-4c38-8c9d-63de5f7d1d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:06.288986 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f5265-05d0-4c38-8c9d-63de5f7d1d59 None admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:06.289261 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f5265-05d0-4c38-8c9d-63de5f7d1d59 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:06.289530 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f5265-05d0-4c38-8c9d-63de5f7d1d59 None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:06.290303 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f5265-05d0-4c38-8c9d-63de5f7d1d59 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:06.291704 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f5265-05d0-4c38-8c9d-63de5f7d1d59 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:06.301032 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.sql.core [None req-669f5265-05d0-4c38-8c9d-63de5f7d1d59 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Apr 12 02:51:06.301032 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Apr 12 02:51:06.301032 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [parameters: {'id': '91f9afc80fd049f09c641811b21c7063', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Apr 12 02:51:06.301032 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79724) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 12 02:51:06.316783 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-669f5265-05d0-4c38-8c9d-63de5f7d1d59 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Apr 12 02:51:06.318570 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 242/478] 10.222.0.32 () {60 vars in 1131 bytes} [Tue Apr 12 02:51:06 2022] POST /identity/v3/roles => generated 144 bytes in 177 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:06.324177 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2317c49-89ca-4945-8bf6-92f9dd8240a8 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:06.438648 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2317c49-89ca-4945-8bf6-92f9dd8240a8 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:06.472649 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a4e1f5-382d-41c6-b495-266ae95adad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:06.473421 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4e1f5-382d-41c6-b495-266ae95adad0 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:06.473690 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4e1f5-382d-41c6-b495-266ae95adad0 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:06.473951 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4e1f5-382d-41c6-b495-266ae95adad0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:06.483954 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a4e1f5-382d-41c6-b495-266ae95adad0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:51:06.491359 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-46a4e1f5-382d-41c6-b495-266ae95adad0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 02:51:06.492942 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 237/479] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 02:51:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:06.498812 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f5265-05d0-4c38-8c9d-63de5f7d1d59 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:06.608589 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f5265-05d0-4c38-8c9d-63de5f7d1d59 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:06.644210 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626965d-4239-44b7-aa04-272d7762eec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:06.644884 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626965d-4239-44b7-aa04-272d7762eec7 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:06.645159 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626965d-4239-44b7-aa04-272d7762eec7 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:06.645425 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626965d-4239-44b7-aa04-272d7762eec7 None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:06.646175 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626965d-4239-44b7-aa04-272d7762eec7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:06.646470 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626965d-4239-44b7-aa04-272d7762eec7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:06.647893 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626965d-4239-44b7-aa04-272d7762eec7 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:06.656776 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 243/480] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:51:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:08.206139 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d36c7-0315-467a-9b0c-74823ac30111 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:08.207034 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d36c7-0315-467a-9b0c-74823ac30111 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:08.207440 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d36c7-0315-467a-9b0c-74823ac30111 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:08.209176 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 238/481] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:08.214094 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c290e5-d632-43d0-8d72-c7b8b606b037 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:08.215051 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c290e5-d632-43d0-8d72-c7b8b606b037 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:08.215490 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c290e5-d632-43d0-8d72-c7b8b606b037 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:08.217254 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 244/482] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:08.219697 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ea346-6c50-4462-9cfc-ed3b3725f4a4 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:08.220149 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ea346-6c50-4462-9cfc-ed3b3725f4a4 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:08.220570 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ea346-6c50-4462-9cfc-ed3b3725f4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:08.223256 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d88e3b-76cf-4a2b-bc2f-f4e5b5f35fde None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:08.223672 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d88e3b-76cf-4a2b-bc2f-f4e5b5f35fde None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:08.224104 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d88e3b-76cf-4a2b-bc2f-f4e5b5f35fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:08.252096 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-a16ea346-6c50-4462-9cfc-ed3b3725f4a4 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:08.256548 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-a16ea346-6c50-4462-9cfc-ed3b3725f4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:08.257648 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-a3d88e3b-76cf-4a2b-bc2f-f4e5b5f35fde None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:08.258921 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-a3d88e3b-76cf-4a2b-bc2f-f4e5b5f35fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:08.345235 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 239/483] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 02:51:08.352016 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8dccaa-c1c7-49a7-90f8-57cae9cd7f61 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:08.352016 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8dccaa-c1c7-49a7-90f8-57cae9cd7f61 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:08.352016 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8dccaa-c1c7-49a7-90f8-57cae9cd7f61 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:08.352016 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 240/484] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:08.358796 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64dd8d-30d7-4c9a-b2f0-d5f6e8f799a4 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:08.359377 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64dd8d-30d7-4c9a-b2f0-d5f6e8f799a4 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:08.360840 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64dd8d-30d7-4c9a-b2f0-d5f6e8f799a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:08.371525 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 245/485] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:51:08.376686 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d88e3b-76cf-4a2b-bc2f-f4e5b5f35fde None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:08.382053 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-4b64dd8d-30d7-4c9a-b2f0-d5f6e8f799a4 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:08.383350 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-4b64dd8d-30d7-4c9a-b2f0-d5f6e8f799a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:08.447985 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 241/486] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:51:08.455741 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64dd8d-30d7-4c9a-b2f0-d5f6e8f799a4 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:08.478441 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d88e3b-76cf-4a2b-bc2f-f4e5b5f35fde None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:08.515568 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12448d6-a891-475f-a4ed-e1382ec0c001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:08.519234 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12448d6-a891-475f-a4ed-e1382ec0c001 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:08.519526 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12448d6-a891-475f-a4ed-e1382ec0c001 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:08.519820 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12448d6-a891-475f-a4ed-e1382ec0c001 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:08.532684 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12448d6-a891-475f-a4ed-e1382ec0c001 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:51:08.541288 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-e12448d6-a891-475f-a4ed-e1382ec0c001 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 02:51:08.543356 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 246/487] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 02:51:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:08.548234 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12448d6-a891-475f-a4ed-e1382ec0c001 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:08.570652 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64dd8d-30d7-4c9a-b2f0-d5f6e8f799a4 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:08.609957 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1f339-57ec-4e1f-9063-0c5ac49b3d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:08.611092 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1f339-57ec-4e1f-9063-0c5ac49b3d50 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:08.611549 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1f339-57ec-4e1f-9063-0c5ac49b3d50 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:08.612044 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1f339-57ec-4e1f-9063-0c5ac49b3d50 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:08.622583 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c1f339-57ec-4e1f-9063-0c5ac49b3d50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:51:08.629727 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-83c1f339-57ec-4e1f-9063-0c5ac49b3d50 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 02:51:08.631134 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 242/488] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 02:51:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:08.632122 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1f339-57ec-4e1f-9063-0c5ac49b3d50 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:08.670446 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12448d6-a891-475f-a4ed-e1382ec0c001 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:08.712763 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224da2b9-1a35-4e06-b282-fd24bae1b612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:08.713808 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224da2b9-1a35-4e06-b282-fd24bae1b612 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:08.714597 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224da2b9-1a35-4e06-b282-fd24bae1b612 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:08.715002 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224da2b9-1a35-4e06-b282-fd24bae1b612 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:08.728213 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224da2b9-1a35-4e06-b282-fd24bae1b612 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:51:08.737689 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-224da2b9-1a35-4e06-b282-fd24bae1b612 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 02:51:08.737821 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1f339-57ec-4e1f-9063-0c5ac49b3d50 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:08.739640 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 247/489] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 02:51:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:08.741401 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224da2b9-1a35-4e06-b282-fd24bae1b612 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:08.777557 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c1551-6dea-4416-abe5-d85b1e20f63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:08.778911 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c1551-6dea-4416-abe5-d85b1e20f63a None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:08.779578 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c1551-6dea-4416-abe5-d85b1e20f63a None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:08.780040 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c1551-6dea-4416-abe5-d85b1e20f63a None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:08.780914 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c1551-6dea-4416-abe5-d85b1e20f63a None admin] RBAC: Adding query filter params (name=service) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:08.781369 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c1551-6dea-4416-abe5-d85b1e20f63a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:08.783861 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c1551-6dea-4416-abe5-d85b1e20f63a None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:08.793618 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 243/490] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 02:51:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:08.795223 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c1551-6dea-4416-abe5-d85b1e20f63a None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:08.855112 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224da2b9-1a35-4e06-b282-fd24bae1b612 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:08.893476 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff4527-1190-48bc-9fdc-15d3d0d911f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:08.894142 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff4527-1190-48bc-9fdc-15d3d0d911f6 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:08.894917 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff4527-1190-48bc-9fdc-15d3d0d911f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:08.895325 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff4527-1190-48bc-9fdc-15d3d0d911f6 None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:08.897643 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ff4527-1190-48bc-9fdc-15d3d0d911f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:08.897949 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ff4527-1190-48bc-9fdc-15d3d0d911f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:08.899375 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ff4527-1190-48bc-9fdc-15d3d0d911f6 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:08.913148 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 248/491] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 02:51:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:08.914233 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff4527-1190-48bc-9fdc-15d3d0d911f6 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:08.920988 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c1551-6dea-4416-abe5-d85b1e20f63a None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:08.963618 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04163b06-8ce2-4795-ae8a-9fb306cace5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:08.965222 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04163b06-8ce2-4795-ae8a-9fb306cace5a None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:08.965667 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04163b06-8ce2-4795-ae8a-9fb306cace5a None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:08.966332 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04163b06-8ce2-4795-ae8a-9fb306cace5a None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:08.967206 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04163b06-8ce2-4795-ae8a-9fb306cace5a None admin] RBAC: Adding query filter params (name=service) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:08.967825 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04163b06-8ce2-4795-ae8a-9fb306cace5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:08.969644 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04163b06-8ce2-4795-ae8a-9fb306cace5a None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:08.981174 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 244/492] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 02:51:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:08.982276 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04163b06-8ce2-4795-ae8a-9fb306cace5a None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:09.021189 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff4527-1190-48bc-9fdc-15d3d0d911f6 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:09.056606 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce87136-7d76-43df-a9a5-63eac50eb060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:09.057626 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce87136-7d76-43df-a9a5-63eac50eb060 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:09.058327 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce87136-7d76-43df-a9a5-63eac50eb060 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:09.058926 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce87136-7d76-43df-a9a5-63eac50eb060 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:09.076973 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce87136-7d76-43df-a9a5-63eac50eb060 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:09.078890 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce87136-7d76-43df-a9a5-63eac50eb060 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:09.099362 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-dce87136-7d76-43df-a9a5-63eac50eb060 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:09.106338 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 249/493] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:09.106338 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce87136-7d76-43df-a9a5-63eac50eb060 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:09.116663 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04163b06-8ce2-4795-ae8a-9fb306cace5a None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:09.156935 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b395ae6-ff55-470f-9243-71e11e157691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:09.157736 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b395ae6-ff55-470f-9243-71e11e157691 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:09.158014 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b395ae6-ff55-470f-9243-71e11e157691 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:09.158282 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b395ae6-ff55-470f-9243-71e11e157691 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:09.169368 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b395ae6-ff55-470f-9243-71e11e157691 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:09.170878 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b395ae6-ff55-470f-9243-71e11e157691 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:09.189163 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-0b395ae6-ff55-470f-9243-71e11e157691 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:09.190376 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 245/494] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:09.196208 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b395ae6-ff55-470f-9243-71e11e157691 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:09.232392 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce87136-7d76-43df-a9a5-63eac50eb060 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:09.278446 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8d3b7-e299-4f64-b4d9-8a2cb0d5d4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:09.279710 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8d3b7-e299-4f64-b4d9-8a2cb0d5d4f2 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:09.280163 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8d3b7-e299-4f64-b4d9-8a2cb0d5d4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:09.280569 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8d3b7-e299-4f64-b4d9-8a2cb0d5d4f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:09.295164 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf8d3b7-e299-4f64-b4d9-8a2cb0d5d4f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:09.297435 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf8d3b7-e299-4f64-b4d9-8a2cb0d5d4f2 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:09.299895 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b395ae6-ff55-470f-9243-71e11e157691 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:09.315317 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-faf8d3b7-e299-4f64-b4d9-8a2cb0d5d4f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:09.316581 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 250/495] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:09.317362 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8d3b7-e299-4f64-b4d9-8a2cb0d5d4f2 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:09.338443 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff9b8b-9f16-4d23-8cb2-4e8b14ac62c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:09.340210 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff9b8b-9f16-4d23-8cb2-4e8b14ac62c2 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:09.340691 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff9b8b-9f16-4d23-8cb2-4e8b14ac62c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:09.341431 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff9b8b-9f16-4d23-8cb2-4e8b14ac62c2 None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:09.342501 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff9b8b-9f16-4d23-8cb2-4e8b14ac62c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:09.343347 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff9b8b-9f16-4d23-8cb2-4e8b14ac62c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:09.345375 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff9b8b-9f16-4d23-8cb2-4e8b14ac62c2 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:09.366290 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 246/496] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:09.366290 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4c4dc-2f10-4b84-b362-9c6635bd3726 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:09.366290 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4c4dc-2f10-4b84-b362-9c6635bd3726 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:09.366290 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4c4dc-2f10-4b84-b362-9c6635bd3726 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:09.366290 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 247/497] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:09.366290 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4c4dc-2f10-4b84-b362-9c6635bd3726 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:09.439430 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8d3b7-e299-4f64-b4d9-8a2cb0d5d4f2 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:09.472061 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b1cee-5f52-40e8-a867-877d555f0a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:09.472300 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4c4dc-2f10-4b84-b362-9c6635bd3726 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:09.472724 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b1cee-5f52-40e8-a867-877d555f0a04 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:09.473001 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b1cee-5f52-40e8-a867-877d555f0a04 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:09.473272 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b1cee-5f52-40e8-a867-877d555f0a04 None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:09.473990 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b1cee-5f52-40e8-a867-877d555f0a04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:09.474298 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b1cee-5f52-40e8-a867-877d555f0a04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:09.475667 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b1cee-5f52-40e8-a867-877d555f0a04 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:09.486964 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 251/498] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:09.487861 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b1cee-5f52-40e8-a867-877d555f0a04 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:09.505213 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857314a5-c53b-41c5-b99b-cb04d98567f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:09.505864 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857314a5-c53b-41c5-b99b-cb04d98567f7 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:09.506137 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857314a5-c53b-41c5-b99b-cb04d98567f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:09.506404 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857314a5-c53b-41c5-b99b-cb04d98567f7 None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:09.507117 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857314a5-c53b-41c5-b99b-cb04d98567f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:09.507419 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857314a5-c53b-41c5-b99b-cb04d98567f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:09.508835 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857314a5-c53b-41c5-b99b-cb04d98567f7 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:09.519554 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 248/499] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:09.520885 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01531ff7-d286-41bd-acc3-c3058b7dd10a None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:09.521172 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01531ff7-d286-41bd-acc3-c3058b7dd10a None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:09.521442 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01531ff7-d286-41bd-acc3-c3058b7dd10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:09.538103 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-01531ff7-d286-41bd-acc3-c3058b7dd10a None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:09.539210 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-01531ff7-d286-41bd-acc3-c3058b7dd10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:09.586628 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b1cee-5f52-40e8-a867-877d555f0a04 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:09.608985 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 249/500] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:51:09.610387 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc44582-c470-4c13-a929-98546a956e20 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:09.610671 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc44582-c470-4c13-a929-98546a956e20 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:09.610935 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc44582-c470-4c13-a929-98546a956e20 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:09.612757 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 250/501] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:09.612886 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc44582-c470-4c13-a929-98546a956e20 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:09.621272 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28269c36-1821-4e96-80d4-25fd961113f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:09.622081 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28269c36-1821-4e96-80d4-25fd961113f8 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:09.622358 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28269c36-1821-4e96-80d4-25fd961113f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:09.622643 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28269c36-1821-4e96-80d4-25fd961113f8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:09.630422 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28269c36-1821-4e96-80d4-25fd961113f8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:09.631991 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28269c36-1821-4e96-80d4-25fd961113f8 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:09.646500 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-28269c36-1821-4e96-80d4-25fd961113f8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 12 02:51:09.647680 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 252/502] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:51:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:09.648441 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28269c36-1821-4e96-80d4-25fd961113f8 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:09.715006 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc44582-c470-4c13-a929-98546a956e20 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:09.740869 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28269c36-1821-4e96-80d4-25fd961113f8 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:09.748254 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6d4dc-9d57-4266-a70f-a92ed9955c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:09.749042 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6d4dc-9d57-4266-a70f-a92ed9955c22 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:09.749317 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6d4dc-9d57-4266-a70f-a92ed9955c22 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:09.749584 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6d4dc-9d57-4266-a70f-a92ed9955c22 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:09.756528 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6d4dc-9d57-4266-a70f-a92ed9955c22 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:09.757975 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6d4dc-9d57-4266-a70f-a92ed9955c22 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:09.771229 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-2ef6d4dc-9d57-4266-a70f-a92ed9955c22 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 12 02:51:09.772171 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea10e8-4b4b-4bc8-a414-6561152a5a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:09.772421 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 251/503] 10.222.0.32 () {56 vars in 1093 bytes} [Tue Apr 12 02:51:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:09.772952 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea10e8-4b4b-4bc8-a414-6561152a5a6d None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:09.773217 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea10e8-4b4b-4bc8-a414-6561152a5a6d None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:09.773474 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea10e8-4b4b-4bc8-a414-6561152a5a6d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:09.773621 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e886f-9206-4567-972c-93991d84946c None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:09.773915 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e886f-9206-4567-972c-93991d84946c None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:09.774193 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e886f-9206-4567-972c-93991d84946c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:09.781342 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea10e8-4b4b-4bc8-a414-6561152a5a6d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:09.782832 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea10e8-4b4b-4bc8-a414-6561152a5a6d None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:09.790600 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-576e886f-9206-4567-972c-93991d84946c None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:09.791709 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-576e886f-9206-4567-972c-93991d84946c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:09.796122 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-38ea10e8-4b4b-4bc8-a414-6561152a5a6d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 12 02:51:09.797430 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 253/504] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:51:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:09.798038 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea10e8-4b4b-4bc8-a414-6561152a5a6d None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:09.856017 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 252/505] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:51:09.856851 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e886f-9206-4567-972c-93991d84946c None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:09.889161 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea10e8-4b4b-4bc8-a414-6561152a5a6d None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:09.921992 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4686a-b921-454e-bae7-0b5c957b1059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:09.922797 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4686a-b921-454e-bae7-0b5c957b1059 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:09.923078 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4686a-b921-454e-bae7-0b5c957b1059 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:09.923348 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4686a-b921-454e-bae7-0b5c957b1059 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:09.933746 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a4686a-b921-454e-bae7-0b5c957b1059 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:51:09.940650 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-30a4686a-b921-454e-bae7-0b5c957b1059 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 02:51:09.942063 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 254/506] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 02:51:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:09.942623 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4686a-b921-454e-bae7-0b5c957b1059 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:09.955321 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e886f-9206-4567-972c-93991d84946c None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:09.988036 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb69ca2-5780-40d5-a62c-29b726d7723a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:09.988691 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb69ca2-5780-40d5-a62c-29b726d7723a None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:09.988961 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb69ca2-5780-40d5-a62c-29b726d7723a None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:09.989231 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb69ca2-5780-40d5-a62c-29b726d7723a None admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:09.990039 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb69ca2-5780-40d5-a62c-29b726d7723a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:09.990333 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb69ca2-5780-40d5-a62c-29b726d7723a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:09.991793 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb69ca2-5780-40d5-a62c-29b726d7723a None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:10.026802 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 253/507] 10.222.0.32 () {56 vars in 1137 bytes} [Tue Apr 12 02:51:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:10.027614 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb69ca2-5780-40d5-a62c-29b726d7723a None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:10.044196 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4686a-b921-454e-bae7-0b5c957b1059 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:10.077171 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c400592-05ae-40d0-abaa-8e68f75dbb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:10.078150 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c400592-05ae-40d0-abaa-8e68f75dbb4e None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:10.078429 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c400592-05ae-40d0-abaa-8e68f75dbb4e None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:10.078702 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c400592-05ae-40d0-abaa-8e68f75dbb4e None admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:10.079525 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c400592-05ae-40d0-abaa-8e68f75dbb4e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:10.079874 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c400592-05ae-40d0-abaa-8e68f75dbb4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:10.081302 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c400592-05ae-40d0-abaa-8e68f75dbb4e None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:10.117813 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 255/508] 10.222.0.32 () {56 vars in 1133 bytes} [Tue Apr 12 02:51:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:10.118641 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c400592-05ae-40d0-abaa-8e68f75dbb4e None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:10.124786 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb69ca2-5780-40d5-a62c-29b726d7723a None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:10.160325 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715790a1-881d-4b03-b656-b657d538a2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:10.160986 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715790a1-881d-4b03-b656-b657d538a2c4 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:10.161253 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715790a1-881d-4b03-b656-b657d538a2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:10.161518 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715790a1-881d-4b03-b656-b657d538a2c4 None admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:10.162336 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715790a1-881d-4b03-b656-b657d538a2c4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:10.162640 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715790a1-881d-4b03-b656-b657d538a2c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:10.164112 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715790a1-881d-4b03-b656-b657d538a2c4 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:10.180741 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 254/509] 10.222.0.32 () {56 vars in 1137 bytes} [Tue Apr 12 02:51:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:10.181359 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715790a1-881d-4b03-b656-b657d538a2c4 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:10.221070 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c400592-05ae-40d0-abaa-8e68f75dbb4e None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:10.252969 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a079ba4-9a2c-406e-9b5d-df59e3a76b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:10.253751 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a079ba4-9a2c-406e-9b5d-df59e3a76b80 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:10.254026 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a079ba4-9a2c-406e-9b5d-df59e3a76b80 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:10.254293 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a079ba4-9a2c-406e-9b5d-df59e3a76b80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:10.264787 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a079ba4-9a2c-406e-9b5d-df59e3a76b80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:10.266261 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a079ba4-9a2c-406e-9b5d-df59e3a76b80 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:10.283175 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715790a1-881d-4b03-b656-b657d538a2c4 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:10.285182 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-6a079ba4-9a2c-406e-9b5d-df59e3a76b80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:10.286380 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 256/510] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:10.287155 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a079ba4-9a2c-406e-9b5d-df59e3a76b80 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:10.316743 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e46fd6-1271-4feb-8b36-2414b4bee00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:10.317317 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e46fd6-1271-4feb-8b36-2414b4bee00e None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:10.317588 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e46fd6-1271-4feb-8b36-2414b4bee00e None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:10.317855 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e46fd6-1271-4feb-8b36-2414b4bee00e None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:10.318583 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e46fd6-1271-4feb-8b36-2414b4bee00e None admin] RBAC: Adding query filter params (name=service) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:10.318881 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e46fd6-1271-4feb-8b36-2414b4bee00e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:10.320293 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e46fd6-1271-4feb-8b36-2414b4bee00e None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:10.328289 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 255/511] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 02:51:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:10.329041 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e46fd6-1271-4feb-8b36-2414b4bee00e None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:10.384014 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a079ba4-9a2c-406e-9b5d-df59e3a76b80 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:10.416909 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa31f6a-248c-4a2a-b377-f9b962d75d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:10.417922 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa31f6a-248c-4a2a-b377-f9b962d75d5b None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:10.418200 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa31f6a-248c-4a2a-b377-f9b962d75d5b None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:10.418464 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa31f6a-248c-4a2a-b377-f9b962d75d5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:10.422139 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e46fd6-1271-4feb-8b36-2414b4bee00e None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:10.454960 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8744bc-449e-407e-acb0-6d330e4cb756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:10.455597 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8744bc-449e-407e-acb0-6d330e4cb756 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:10.455911 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8744bc-449e-407e-acb0-6d330e4cb756 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:10.456176 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8744bc-449e-407e-acb0-6d330e4cb756 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:10.484212 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa31f6a-248c-4a2a-b377-f9b962d75d5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:10.485697 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa31f6a-248c-4a2a-b377-f9b962d75d5b None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:10.521031 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8744bc-449e-407e-acb0-6d330e4cb756 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:10.522535 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8744bc-449e-407e-acb0-6d330e4cb756 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:10.577425 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 257/512] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:51:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:51:10.578516 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa31f6a-248c-4a2a-b377-f9b962d75d5b None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:10.623824 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 256/513] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:51:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:51:10.623824 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8744bc-449e-407e-acb0-6d330e4cb756 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:10.681250 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa31f6a-248c-4a2a-b377-f9b962d75d5b None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:10.716013 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11ac4b-6af1-434f-bb4a-affebd4e4630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:10.716658 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11ac4b-6af1-434f-bb4a-affebd4e4630 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:10.716927 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11ac4b-6af1-434f-bb4a-affebd4e4630 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:10.717016 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8744bc-449e-407e-acb0-6d330e4cb756 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:10.717191 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11ac4b-6af1-434f-bb4a-affebd4e4630 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:10.750594 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372a27c-daff-492e-a511-50dcba744e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:10.751248 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372a27c-daff-492e-a511-50dcba744e38 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:10.751522 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372a27c-daff-492e-a511-50dcba744e38 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:10.751811 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372a27c-daff-492e-a511-50dcba744e38 None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:10.752505 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372a27c-daff-492e-a511-50dcba744e38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:10.752801 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372a27c-daff-492e-a511-50dcba744e38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:10.754194 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372a27c-daff-492e-a511-50dcba744e38 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:10.765414 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 257/514] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:10.766193 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372a27c-daff-492e-a511-50dcba744e38 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:10.782595 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11ac4b-6af1-434f-bb4a-affebd4e4630 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:10.784083 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11ac4b-6af1-434f-bb4a-affebd4e4630 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:10.862447 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372a27c-daff-492e-a511-50dcba744e38 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:10.875753 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 258/515] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:51:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:51:10.876551 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11ac4b-6af1-434f-bb4a-affebd4e4630 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:10.894973 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5f17e-3def-46c3-952f-6c0b37e8bda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:10.895784 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5f17e-3def-46c3-952f-6c0b37e8bda1 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:10.896056 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5f17e-3def-46c3-952f-6c0b37e8bda1 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:10.896325 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5f17e-3def-46c3-952f-6c0b37e8bda1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:10.906911 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5f17e-3def-46c3-952f-6c0b37e8bda1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:10.908401 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5f17e-3def-46c3-952f-6c0b37e8bda1 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:10.924678 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-61f5f17e-3def-46c3-952f-6c0b37e8bda1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:10.926000 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 258/516] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:10.926608 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5f17e-3def-46c3-952f-6c0b37e8bda1 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:10.968778 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11ac4b-6af1-434f-bb4a-affebd4e4630 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:11.002066 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dce5e1-e0f9-4ebd-9f63-101291734a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:11.002853 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dce5e1-e0f9-4ebd-9f63-101291734a3d None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:11.003130 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dce5e1-e0f9-4ebd-9f63-101291734a3d None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:11.003384 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dce5e1-e0f9-4ebd-9f63-101291734a3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:11.012987 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dce5e1-e0f9-4ebd-9f63-101291734a3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:11.014442 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dce5e1-e0f9-4ebd-9f63-101291734a3d None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:11.022591 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5f17e-3def-46c3-952f-6c0b37e8bda1 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:11.030718 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-72dce5e1-e0f9-4ebd-9f63-101291734a3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:11.032126 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 259/517] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:11.032686 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dce5e1-e0f9-4ebd-9f63-101291734a3d None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:11.061145 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72418831-4593-42cc-a70a-203113e4357f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:11.061923 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72418831-4593-42cc-a70a-203113e4357f None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:11.062197 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72418831-4593-42cc-a70a-203113e4357f None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:11.062467 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72418831-4593-42cc-a70a-203113e4357f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:11.072771 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72418831-4593-42cc-a70a-203113e4357f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:11.074686 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72418831-4593-42cc-a70a-203113e4357f None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:11.091068 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-72418831-4593-42cc-a70a-203113e4357f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:11.092299 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 259/518] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:11.093056 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72418831-4593-42cc-a70a-203113e4357f None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:11.128862 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dce5e1-e0f9-4ebd-9f63-101291734a3d None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:11.163788 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8574c15-e894-49f2-b441-5d68bd2bda5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:11.164455 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8574c15-e894-49f2-b441-5d68bd2bda5e None admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:11.164730 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8574c15-e894-49f2-b441-5d68bd2bda5e None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:11.164994 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8574c15-e894-49f2-b441-5d68bd2bda5e None admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:11.165693 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8574c15-e894-49f2-b441-5d68bd2bda5e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:11.167178 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8574c15-e894-49f2-b441-5d68bd2bda5e None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:11.187708 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 260/519] 10.222.0.32 () {60 vars in 1132 bytes} [Tue Apr 12 02:51:11 2022] POST /identity/v3/users => generated 247 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 02:51:11.188536 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8574c15-e894-49f2-b441-5d68bd2bda5e None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:11.189378 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72418831-4593-42cc-a70a-203113e4357f None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:11.228216 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446be2b3-cf70-4185-9e4e-c6643a7d949e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:11.229071 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446be2b3-cf70-4185-9e4e-c6643a7d949e None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:11.229335 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446be2b3-cf70-4185-9e4e-c6643a7d949e None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:11.229594 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446be2b3-cf70-4185-9e4e-c6643a7d949e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:11.241325 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446be2b3-cf70-4185-9e4e-c6643a7d949e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:11.242835 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446be2b3-cf70-4185-9e4e-c6643a7d949e None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:11.261079 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-446be2b3-cf70-4185-9e4e-c6643a7d949e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:11.262338 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 260/520] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:11.267385 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446be2b3-cf70-4185-9e4e-c6643a7d949e None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:11.300882 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8574c15-e894-49f2-b441-5d68bd2bda5e None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:11.336996 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94baaa73-621b-47e4-8fd9-e9271c1360bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:11.337588 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94baaa73-621b-47e4-8fd9-e9271c1360bb None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:11.337862 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94baaa73-621b-47e4-8fd9-e9271c1360bb None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:11.338160 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94baaa73-621b-47e4-8fd9-e9271c1360bb None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:11.338863 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94baaa73-621b-47e4-8fd9-e9271c1360bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:11.339351 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94baaa73-621b-47e4-8fd9-e9271c1360bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:11.341277 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94baaa73-621b-47e4-8fd9-e9271c1360bb None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:11.353544 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 261/521] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:11.354506 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94baaa73-621b-47e4-8fd9-e9271c1360bb None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:11.375709 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446be2b3-cf70-4185-9e4e-c6643a7d949e None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:11.412625 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50fceb-dc9b-4b9c-abee-c104dddfa3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:11.413211 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50fceb-dc9b-4b9c-abee-c104dddfa3c6 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:11.413487 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50fceb-dc9b-4b9c-abee-c104dddfa3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:11.413756 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50fceb-dc9b-4b9c-abee-c104dddfa3c6 None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:11.414469 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50fceb-dc9b-4b9c-abee-c104dddfa3c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:11.414775 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50fceb-dc9b-4b9c-abee-c104dddfa3c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:11.416220 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50fceb-dc9b-4b9c-abee-c104dddfa3c6 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:11.429210 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 261/522] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:11.429878 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50fceb-dc9b-4b9c-abee-c104dddfa3c6 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:11.455700 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94baaa73-621b-47e4-8fd9-e9271c1360bb None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:11.488130 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce897fa0-939c-49c3-aa21-5b7a792aa330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:11.488790 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce897fa0-939c-49c3-aa21-5b7a792aa330 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:11.489051 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce897fa0-939c-49c3-aa21-5b7a792aa330 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:11.489331 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce897fa0-939c-49c3-aa21-5b7a792aa330 None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:11.490041 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce897fa0-939c-49c3-aa21-5b7a792aa330 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:11.490343 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce897fa0-939c-49c3-aa21-5b7a792aa330 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:11.491705 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce897fa0-939c-49c3-aa21-5b7a792aa330 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:11.506979 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 262/523] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:11.506979 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce897fa0-939c-49c3-aa21-5b7a792aa330 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:11.535816 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50fceb-dc9b-4b9c-abee-c104dddfa3c6 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:11.568822 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8787e6-e508-4375-afef-f17636f8f2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:11.569486 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8787e6-e508-4375-afef-f17636f8f2fe None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:11.569752 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8787e6-e508-4375-afef-f17636f8f2fe None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:11.570017 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8787e6-e508-4375-afef-f17636f8f2fe None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:11.570718 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8787e6-e508-4375-afef-f17636f8f2fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:11.571015 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8787e6-e508-4375-afef-f17636f8f2fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:11.572436 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8787e6-e508-4375-afef-f17636f8f2fe None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:11.584480 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 262/524] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:11.589058 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8787e6-e508-4375-afef-f17636f8f2fe None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:11.600929 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce897fa0-939c-49c3-aa21-5b7a792aa330 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:11.638239 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5be59-7907-42ee-85bb-36ce9c3dd02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:11.639492 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5be59-7907-42ee-85bb-36ce9c3dd02c None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:11.639953 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5be59-7907-42ee-85bb-36ce9c3dd02c None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:11.640344 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5be59-7907-42ee-85bb-36ce9c3dd02c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:11.648374 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a5be59-7907-42ee-85bb-36ce9c3dd02c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:11.649841 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a5be59-7907-42ee-85bb-36ce9c3dd02c None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:11.663344 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-c2a5be59-7907-42ee-85bb-36ce9c3dd02c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 12 02:51:11.664515 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 263/525] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 02:51:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:11.665280 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5be59-7907-42ee-85bb-36ce9c3dd02c None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:11.693569 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8787e6-e508-4375-afef-f17636f8f2fe None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:11.727481 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0952aa-380b-444c-9929-0dd50035e329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:11.728302 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0952aa-380b-444c-9929-0dd50035e329 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:11.728578 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0952aa-380b-444c-9929-0dd50035e329 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:11.728846 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0952aa-380b-444c-9929-0dd50035e329 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:11.735940 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0952aa-380b-444c-9929-0dd50035e329 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:11.737401 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0952aa-380b-444c-9929-0dd50035e329 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:11.750782 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-9e0952aa-380b-444c-9929-0dd50035e329 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:51:11.757212 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 263/526] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:51:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:11.757212 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0952aa-380b-444c-9929-0dd50035e329 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:11.762526 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5be59-7907-42ee-85bb-36ce9c3dd02c None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:11.795006 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e70f5-444b-4b29-9dbd-646850d677a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:11.796059 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e70f5-444b-4b29-9dbd-646850d677a9 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:11.796335 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e70f5-444b-4b29-9dbd-646850d677a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:11.796601 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e70f5-444b-4b29-9dbd-646850d677a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:11.803210 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e70f5-444b-4b29-9dbd-646850d677a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:11.804686 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e70f5-444b-4b29-9dbd-646850d677a9 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:11.817846 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-fd7e70f5-444b-4b29-9dbd-646850d677a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:51:11.823756 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 264/527] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:51:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:11.823756 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e70f5-444b-4b29-9dbd-646850d677a9 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:11.856100 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0952aa-380b-444c-9929-0dd50035e329 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:11.888611 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d2720-3f6e-4117-9ae8-a375510bb79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:11.889403 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d2720-3f6e-4117-9ae8-a375510bb79f None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:11.889679 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d2720-3f6e-4117-9ae8-a375510bb79f None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:11.889946 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d2720-3f6e-4117-9ae8-a375510bb79f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:11.896449 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d2720-3f6e-4117-9ae8-a375510bb79f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:11.897887 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d2720-3f6e-4117-9ae8-a375510bb79f None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:11.910796 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-d73d2720-3f6e-4117-9ae8-a375510bb79f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:51:11.916701 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 264/528] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:51:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:11.916701 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d2720-3f6e-4117-9ae8-a375510bb79f None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:11.916880 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e70f5-444b-4b29-9dbd-646850d677a9 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:11.947926 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da0b55-3099-46d3-b07b-8f114191aa83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:11.948622 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da0b55-3099-46d3-b07b-8f114191aa83 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:11.948898 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da0b55-3099-46d3-b07b-8f114191aa83 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:11.949164 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da0b55-3099-46d3-b07b-8f114191aa83 None admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:11.950016 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da0b55-3099-46d3-b07b-8f114191aa83 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:11.950298 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da0b55-3099-46d3-b07b-8f114191aa83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:11.951749 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da0b55-3099-46d3-b07b-8f114191aa83 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:11.973539 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 265/529] 10.222.0.32 () {56 vars in 1139 bytes} [Tue Apr 12 02:51:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:11.973539 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da0b55-3099-46d3-b07b-8f114191aa83 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:12.019626 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d2720-3f6e-4117-9ae8-a375510bb79f None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:12.052505 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7eea06-cffe-47ae-b465-4863615e347e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:12.053161 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7eea06-cffe-47ae-b465-4863615e347e None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:12.053438 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7eea06-cffe-47ae-b465-4863615e347e None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:12.053711 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7eea06-cffe-47ae-b465-4863615e347e None admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:12.054483 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7eea06-cffe-47ae-b465-4863615e347e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:12.054784 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7eea06-cffe-47ae-b465-4863615e347e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:12.056270 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7eea06-cffe-47ae-b465-4863615e347e None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:12.063763 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da0b55-3099-46d3-b07b-8f114191aa83 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:12.078591 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 265/530] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 02:51:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:12.078591 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7eea06-cffe-47ae-b465-4863615e347e None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:12.096852 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8f394-a329-4c7c-b9bc-3f98265ea89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:12.097518 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8f394-a329-4c7c-b9bc-3f98265ea89a None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:12.097797 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8f394-a329-4c7c-b9bc-3f98265ea89a None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:12.098070 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8f394-a329-4c7c-b9bc-3f98265ea89a None admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:12.098992 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8f394-a329-4c7c-b9bc-3f98265ea89a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:12.099190 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8f394-a329-4c7c-b9bc-3f98265ea89a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:12.100610 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8f394-a329-4c7c-b9bc-3f98265ea89a None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:12.117801 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 266/531] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 02:51:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:12.118908 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8f394-a329-4c7c-b9bc-3f98265ea89a None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:12.178466 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7eea06-cffe-47ae-b465-4863615e347e None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:12.211445 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970d048-2bdf-42c8-8c8b-0694be696934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:12.212124 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970d048-2bdf-42c8-8c8b-0694be696934 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:12.212398 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970d048-2bdf-42c8-8c8b-0694be696934 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:12.212661 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970d048-2bdf-42c8-8c8b-0694be696934 None admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:12.213433 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8f394-a329-4c7c-b9bc-3f98265ea89a None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:12.213530 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970d048-2bdf-42c8-8c8b-0694be696934 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:12.213730 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970d048-2bdf-42c8-8c8b-0694be696934 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:12.215432 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970d048-2bdf-42c8-8c8b-0694be696934 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:12.232079 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 266/532] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 02:51:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:12.232079 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970d048-2bdf-42c8-8c8b-0694be696934 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:12.248145 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c3e78-ee17-4b01-9772-17dd4100b5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:12.248806 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c3e78-ee17-4b01-9772-17dd4100b5c4 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:12.249074 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c3e78-ee17-4b01-9772-17dd4100b5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:12.249340 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c3e78-ee17-4b01-9772-17dd4100b5c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:12.316049 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c3e78-ee17-4b01-9772-17dd4100b5c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:12.317527 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c3e78-ee17-4b01-9772-17dd4100b5c4 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:12.328468 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970d048-2bdf-42c8-8c8b-0694be696934 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:12.361150 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7417dab4-c258-4ced-a8d7-9dbb59a790a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:12.361827 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417dab4-c258-4ced-a8d7-9dbb59a790a1 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:12.362095 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417dab4-c258-4ced-a8d7-9dbb59a790a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:12.362334 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417dab4-c258-4ced-a8d7-9dbb59a790a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:12.363159 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7417dab4-c258-4ced-a8d7-9dbb59a790a1 None admin] RBAC: Adding query filter params (role.id=a8b79923b07243e385187b6641381ee1, scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed, user.id=828a6cffa8af470388d4b063c3c49849) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:12.363435 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7417dab4-c258-4ced-a8d7-9dbb59a790a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:12.364929 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7417dab4-c258-4ced-a8d7-9dbb59a790a1 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:12.380054 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 267/533] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:51:12 2022] GET /identity/v3/role_assignments?user.id=828a6cffa8af470388d4b063c3c49849&scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed&role.id=a8b79923b07243e385187b6641381ee1 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:12.380054 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7417dab4-c258-4ced-a8d7-9dbb59a790a1 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:12.418587 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 267/534] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:51:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:51:12.419478 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c3e78-ee17-4b01-9772-17dd4100b5c4 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:12.485977 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7417dab4-c258-4ced-a8d7-9dbb59a790a1 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:12.518499 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c3e78-ee17-4b01-9772-17dd4100b5c4 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:12.524807 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75add86-cb1d-495c-b1d9-72b799343533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:12.525929 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75add86-cb1d-495c-b1d9-72b799343533 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:12.526545 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75add86-cb1d-495c-b1d9-72b799343533 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:12.527013 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75add86-cb1d-495c-b1d9-72b799343533 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:12.528093 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75add86-cb1d-495c-b1d9-72b799343533 None admin] RBAC: Adding query filter params (role.id=a8b79923b07243e385187b6641381ee1, scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed, user.id=43ee5cb310fd4538910e40ea7082708c) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:12.528605 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75add86-cb1d-495c-b1d9-72b799343533 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:12.530305 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75add86-cb1d-495c-b1d9-72b799343533 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:12.540137 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 268/535] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:51:12 2022] GET /identity/v3/role_assignments?user.id=43ee5cb310fd4538910e40ea7082708c&scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed&role.id=a8b79923b07243e385187b6641381ee1 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:12.541434 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75add86-cb1d-495c-b1d9-72b799343533 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:12.569851 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27953e7-102e-43e3-af36-54f2c034f1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:12.570521 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27953e7-102e-43e3-af36-54f2c034f1a9 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:12.570791 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27953e7-102e-43e3-af36-54f2c034f1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:12.571061 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27953e7-102e-43e3-af36-54f2c034f1a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:12.571922 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27953e7-102e-43e3-af36-54f2c034f1a9 None admin] RBAC: Adding query filter params (role.id=a8b79923b07243e385187b6641381ee1, scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed, user.id=44248c51c2cb497b85a68dce0496a225) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:12.572226 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27953e7-102e-43e3-af36-54f2c034f1a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:12.574136 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27953e7-102e-43e3-af36-54f2c034f1a9 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:12.589026 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 268/536] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:51:12 2022] GET /identity/v3/role_assignments?user.id=44248c51c2cb497b85a68dce0496a225&scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed&role.id=a8b79923b07243e385187b6641381ee1 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:12.665965 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75add86-cb1d-495c-b1d9-72b799343533 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:12.714114 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18598bc-992f-444b-9c2f-8cd4bb42c3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:12.715335 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18598bc-992f-444b-9c2f-8cd4bb42c3ad None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:12.715900 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18598bc-992f-444b-9c2f-8cd4bb42c3ad None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:12.716364 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18598bc-992f-444b-9c2f-8cd4bb42c3ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:12.729194 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18598bc-992f-444b-9c2f-8cd4bb42c3ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:12.731119 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18598bc-992f-444b-9c2f-8cd4bb42c3ad None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:12.749744 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-f18598bc-992f-444b-9c2f-8cd4bb42c3ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:12.751706 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 269/537] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:12.757293 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27953e7-102e-43e3-af36-54f2c034f1a9 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:12.878202 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27953e7-102e-43e3-af36-54f2c034f1a9 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:12.915054 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5124bb-7d64-4db3-a4ed-fb49c278a66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:12.915714 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5124bb-7d64-4db3-a4ed-fb49c278a66f None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:12.916004 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5124bb-7d64-4db3-a4ed-fb49c278a66f None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:12.916269 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5124bb-7d64-4db3-a4ed-fb49c278a66f None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:12.917203 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5124bb-7d64-4db3-a4ed-fb49c278a66f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:12.917326 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5124bb-7d64-4db3-a4ed-fb49c278a66f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:12.918682 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5124bb-7d64-4db3-a4ed-fb49c278a66f None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:12.930794 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 269/538] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:12.936162 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18598bc-992f-444b-9c2f-8cd4bb42c3ad None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:13.106497 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18598bc-992f-444b-9c2f-8cd4bb42c3ad None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:13.150524 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6b1c1-a1e7-49a8-8bef-be0a6a1fec20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:13.151417 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6b1c1-a1e7-49a8-8bef-be0a6a1fec20 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:13.151704 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6b1c1-a1e7-49a8-8bef-be0a6a1fec20 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:13.151996 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6b1c1-a1e7-49a8-8bef-be0a6a1fec20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:13.162025 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6b1c1-a1e7-49a8-8bef-be0a6a1fec20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:13.163499 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6b1c1-a1e7-49a8-8bef-be0a6a1fec20 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:13.178757 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-73e6b1c1-a1e7-49a8-8bef-be0a6a1fec20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:51:13.180286 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 270/539] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:51:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:13.185849 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5124bb-7d64-4db3-a4ed-fb49c278a66f None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:13.410003 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5124bb-7d64-4db3-a4ed-fb49c278a66f None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:13.469376 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c724dc-7a74-459d-a307-e5b729d659c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:13.470048 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c724dc-7a74-459d-a307-e5b729d659c6 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:13.470323 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c724dc-7a74-459d-a307-e5b729d659c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:13.470588 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c724dc-7a74-459d-a307-e5b729d659c6 None admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:13.471380 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c724dc-7a74-459d-a307-e5b729d659c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:13.471682 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c724dc-7a74-459d-a307-e5b729d659c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:13.473136 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c724dc-7a74-459d-a307-e5b729d659c6 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:13.490574 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 270/540] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 02:51:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:13.496318 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6b1c1-a1e7-49a8-8bef-be0a6a1fec20 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:13.635138 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6b1c1-a1e7-49a8-8bef-be0a6a1fec20 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:13.665642 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdc001-c2b8-46f4-bd8f-57170df13034 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:13.665828 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdc001-c2b8-46f4-bd8f-57170df13034 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:13.666091 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdc001-c2b8-46f4-bd8f-57170df13034 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:13.667739 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 271/541] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:51:13.672849 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd4e8b-21d8-4ced-9d71-52c1d3cfd09a None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:13.673368 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd4e8b-21d8-4ced-9d71-52c1d3cfd09a None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:13.673859 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd4e8b-21d8-4ced-9d71-52c1d3cfd09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:13.688789 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692758b-4685-41e3-9fc9-834bc7c7f5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:13.689920 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692758b-4685-41e3-9fc9-834bc7c7f5ac None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:13.693261 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692758b-4685-41e3-9fc9-834bc7c7f5ac None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:13.693730 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692758b-4685-41e3-9fc9-834bc7c7f5ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:13.694763 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692758b-4685-41e3-9fc9-834bc7c7f5ac None admin] RBAC: Adding query filter params (role.id=a8b79923b07243e385187b6641381ee1, scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed, user.id=8f516943aec14608b5c9d343418a2677) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:13.695854 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-60fd4e8b-21d8-4ced-9d71-52c1d3cfd09a None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:13.696379 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692758b-4685-41e3-9fc9-834bc7c7f5ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:13.698028 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692758b-4685-41e3-9fc9-834bc7c7f5ac None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:13.699494 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-60fd4e8b-21d8-4ced-9d71-52c1d3cfd09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:13.712804 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 271/542] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:51:13 2022] GET /identity/v3/role_assignments?user.id=8f516943aec14608b5c9d343418a2677&scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed&role.id=a8b79923b07243e385187b6641381ee1 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:13.797849 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 272/543] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:51:13.822506 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692758b-4685-41e3-9fc9-834bc7c7f5ac None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:13.930744 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692758b-4685-41e3-9fc9-834bc7c7f5ac None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:13.965483 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad4d05-da33-4862-957b-892516d7764b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:13.966701 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad4d05-da33-4862-957b-892516d7764b None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:13.967174 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad4d05-da33-4862-957b-892516d7764b None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:13.967647 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad4d05-da33-4862-957b-892516d7764b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:13.979163 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad4d05-da33-4862-957b-892516d7764b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:51:13.986816 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-22ad4d05-da33-4862-957b-892516d7764b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 02:51:13.988604 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 272/544] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 02:51:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:13.994556 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd4e8b-21d8-4ced-9d71-52c1d3cfd09a None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:14.125026 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd4e8b-21d8-4ced-9d71-52c1d3cfd09a None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:14.170033 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88436ab4-1b6d-41a8-bd1f-63081093bbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:14.171088 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88436ab4-1b6d-41a8-bd1f-63081093bbe2 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:14.171563 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88436ab4-1b6d-41a8-bd1f-63081093bbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:14.172047 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88436ab4-1b6d-41a8-bd1f-63081093bbe2 None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:14.172986 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88436ab4-1b6d-41a8-bd1f-63081093bbe2 None admin] RBAC: Adding query filter params (name=service) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:14.173478 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88436ab4-1b6d-41a8-bd1f-63081093bbe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:14.175047 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88436ab4-1b6d-41a8-bd1f-63081093bbe2 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:14.187053 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 273/545] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 02:51:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:14.192802 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad4d05-da33-4862-957b-892516d7764b None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:14.322080 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad4d05-da33-4862-957b-892516d7764b None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:14.370614 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9e25c-4a86-49c7-812b-c250a2f47353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:14.371843 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9e25c-4a86-49c7-812b-c250a2f47353 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:14.372319 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9e25c-4a86-49c7-812b-c250a2f47353 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:14.372781 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9e25c-4a86-49c7-812b-c250a2f47353 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:14.391415 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9e25c-4a86-49c7-812b-c250a2f47353 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:14.397571 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9e25c-4a86-49c7-812b-c250a2f47353 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:14.418912 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-9ab9e25c-4a86-49c7-812b-c250a2f47353 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:14.420525 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 273/546] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:14.426255 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88436ab4-1b6d-41a8-bd1f-63081093bbe2 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:14.553703 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88436ab4-1b6d-41a8-bd1f-63081093bbe2 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:14.591321 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053969e-76bd-452c-b1af-48befdcd419d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:14.592012 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053969e-76bd-452c-b1af-48befdcd419d None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:14.592286 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053969e-76bd-452c-b1af-48befdcd419d None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:14.592549 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053969e-76bd-452c-b1af-48befdcd419d None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:14.593270 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1053969e-76bd-452c-b1af-48befdcd419d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:14.593565 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1053969e-76bd-452c-b1af-48befdcd419d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:14.594926 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1053969e-76bd-452c-b1af-48befdcd419d None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:14.607114 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 274/547] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:14.612801 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9e25c-4a86-49c7-812b-c250a2f47353 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:14.770262 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9e25c-4a86-49c7-812b-c250a2f47353 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:14.821409 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ca0bc-c1f7-42e4-a27a-c9770c9fb096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:14.822145 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ca0bc-c1f7-42e4-a27a-c9770c9fb096 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:14.822413 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ca0bc-c1f7-42e4-a27a-c9770c9fb096 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:14.822674 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ca0bc-c1f7-42e4-a27a-c9770c9fb096 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:14.836907 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ca0bc-c1f7-42e4-a27a-c9770c9fb096 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:14.838380 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ca0bc-c1f7-42e4-a27a-c9770c9fb096 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:14.855325 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-d68ca0bc-c1f7-42e4-a27a-c9770c9fb096 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 12 02:51:14.856897 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 274/548] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 02:51:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:14.862277 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053969e-76bd-452c-b1af-48befdcd419d None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:14.965015 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053969e-76bd-452c-b1af-48befdcd419d None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:15.007111 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6890ee-c825-4c25-b872-c99c6c3748d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:15.007810 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6890ee-c825-4c25-b872-c99c6c3748d6 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:15.008084 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6890ee-c825-4c25-b872-c99c6c3748d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:15.008349 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6890ee-c825-4c25-b872-c99c6c3748d6 None admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:15.009185 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6890ee-c825-4c25-b872-c99c6c3748d6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:15.009483 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6890ee-c825-4c25-b872-c99c6c3748d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:15.010934 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6890ee-c825-4c25-b872-c99c6c3748d6 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:15.037790 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 275/549] 10.222.0.32 () {56 vars in 1135 bytes} [Tue Apr 12 02:51:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:15.045157 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ca0bc-c1f7-42e4-a27a-c9770c9fb096 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:15.183699 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ca0bc-c1f7-42e4-a27a-c9770c9fb096 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:15.225235 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2611bf-1a13-4ab7-8d8a-c6e8377ff0af None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:15.225449 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cabca6-1cdd-4ca4-9333-870c41ee7048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:15.225932 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cabca6-1cdd-4ca4-9333-870c41ee7048 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:15.226206 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cabca6-1cdd-4ca4-9333-870c41ee7048 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:15.226410 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2611bf-1a13-4ab7-8d8a-c6e8377ff0af None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:15.226520 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cabca6-1cdd-4ca4-9333-870c41ee7048 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:15.226963 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2611bf-1a13-4ab7-8d8a-c6e8377ff0af None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:15.228846 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 276/550] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:15.234330 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac74d61-6fc4-4c2e-a2bb-e19bfea26ecb None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:15.234887 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac74d61-6fc4-4c2e-a2bb-e19bfea26ecb None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:15.235368 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac74d61-6fc4-4c2e-a2bb-e19bfea26ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:15.264315 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-2ac74d61-6fc4-4c2e-a2bb-e19bfea26ecb None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:15.266064 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-2ac74d61-6fc4-4c2e-a2bb-e19bfea26ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:15.316259 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cabca6-1cdd-4ca4-9333-870c41ee7048 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:15.318238 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cabca6-1cdd-4ca4-9333-870c41ee7048 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:15.404080 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 277/551] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 02:51:15.442673 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e69300-20e8-401a-8b80-6f5c2b42b8f4 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:15.443810 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e69300-20e8-401a-8b80-6f5c2b42b8f4 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:15.444297 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e69300-20e8-401a-8b80-6f5c2b42b8f4 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:15.448572 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 278/552] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:51:15.449895 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e69300-20e8-401a-8b80-6f5c2b42b8f4 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:15.459501 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 275/553] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:51:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:51:15.461216 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10f773-b690-4a4a-9804-388b532eb9b5 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:15.461508 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10f773-b690-4a4a-9804-388b532eb9b5 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:15.461785 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10f773-b690-4a4a-9804-388b532eb9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:15.478107 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-7a10f773-b690-4a4a-9804-388b532eb9b5 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:15.479296 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-7a10f773-b690-4a4a-9804-388b532eb9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:15.546822 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 276/554] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:51:15.547842 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10f773-b690-4a4a-9804-388b532eb9b5 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:15.558240 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e69300-20e8-401a-8b80-6f5c2b42b8f4 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:15.593726 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e8a08-7741-4c03-93ea-8f06accb7e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:15.594539 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e8a08-7741-4c03-93ea-8f06accb7e9d None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:15.594792 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e8a08-7741-4c03-93ea-8f06accb7e9d None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:15.595058 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e8a08-7741-4c03-93ea-8f06accb7e9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:15.608986 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e8a08-7741-4c03-93ea-8f06accb7e9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:51:15.615886 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-490e8a08-7741-4c03-93ea-8f06accb7e9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 02:51:15.617303 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 279/555] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 02:51:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:15.623094 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd94d8-04e1-45dd-a538-6787fe7b84a7 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:15.623370 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd94d8-04e1-45dd-a538-6787fe7b84a7 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:15.623636 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd94d8-04e1-45dd-a538-6787fe7b84a7 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:15.625111 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 280/556] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:15.625629 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd94d8-04e1-45dd-a538-6787fe7b84a7 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:15.652283 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10f773-b690-4a4a-9804-388b532eb9b5 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:15.685595 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a009c07-ae8d-4a17-a4a7-aa3933b39479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:15.686381 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a009c07-ae8d-4a17-a4a7-aa3933b39479 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:15.686651 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a009c07-ae8d-4a17-a4a7-aa3933b39479 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:15.686919 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a009c07-ae8d-4a17-a4a7-aa3933b39479 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:15.696885 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a009c07-ae8d-4a17-a4a7-aa3933b39479 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:15.698331 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a009c07-ae8d-4a17-a4a7-aa3933b39479 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:15.715542 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-3a009c07-ae8d-4a17-a4a7-aa3933b39479 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:15.716761 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 277/557] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:15.721061 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a009c07-ae8d-4a17-a4a7-aa3933b39479 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:15.722797 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd94d8-04e1-45dd-a538-6787fe7b84a7 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:15.754478 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a26c7-c881-487a-86b2-394f818d87e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:15.755273 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a26c7-c881-487a-86b2-394f818d87e5 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:15.755573 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a26c7-c881-487a-86b2-394f818d87e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:15.755847 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a26c7-c881-487a-86b2-394f818d87e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:15.765774 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a26c7-c881-487a-86b2-394f818d87e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:51:15.772645 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-f70a26c7-c881-487a-86b2-394f818d87e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 02:51:15.778472 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 281/558] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 02:51:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:15.778472 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75848d-c5bc-4b82-ba29-44f671d38a12 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:15.778472 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75848d-c5bc-4b82-ba29-44f671d38a12 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:15.778472 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75848d-c5bc-4b82-ba29-44f671d38a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:15.793635 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-dd75848d-c5bc-4b82-ba29-44f671d38a12 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:15.794762 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-dd75848d-c5bc-4b82-ba29-44f671d38a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:15.816834 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a009c07-ae8d-4a17-a4a7-aa3933b39479 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:15.850788 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615c078-d30b-4170-a4dd-942760629655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:15.851451 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615c078-d30b-4170-a4dd-942760629655 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:15.851750 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615c078-d30b-4170-a4dd-942760629655 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:15.852019 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615c078-d30b-4170-a4dd-942760629655 None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:15.852758 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615c078-d30b-4170-a4dd-942760629655 None admin] RBAC: Adding query filter params (name=service) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:15.853107 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615c078-d30b-4170-a4dd-942760629655 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:15.854509 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615c078-d30b-4170-a4dd-942760629655 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:15.859964 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 282/559] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:51:15.873863 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75848d-c5bc-4b82-ba29-44f671d38a12 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:15.873978 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 278/560] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 02:51:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:15.873978 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615c078-d30b-4170-a4dd-942760629655 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:15.953386 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75848d-c5bc-4b82-ba29-44f671d38a12 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:15.967866 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615c078-d30b-4170-a4dd-942760629655 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:15.985257 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5ff5c-2713-4428-882a-cd62269d5362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:15.985915 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5ff5c-2713-4428-882a-cd62269d5362 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:15.986194 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5ff5c-2713-4428-882a-cd62269d5362 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:15.986430 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5ff5c-2713-4428-882a-cd62269d5362 None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:15.987176 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5ff5c-2713-4428-882a-cd62269d5362 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:15.987466 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5ff5c-2713-4428-882a-cd62269d5362 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:15.988832 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5ff5c-2713-4428-882a-cd62269d5362 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:15.999939 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd9eec-62ac-4b8a-b089-d273eebef160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:16.000091 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 283/561] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:16.000772 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5ff5c-2713-4428-882a-cd62269d5362 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:16.001227 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd9eec-62ac-4b8a-b089-d273eebef160 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:16.001562 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd9eec-62ac-4b8a-b089-d273eebef160 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:16.001898 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd9eec-62ac-4b8a-b089-d273eebef160 None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:16.002702 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd9eec-62ac-4b8a-b089-d273eebef160 None admin] RBAC: Adding query filter params (name=service) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:16.003072 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd9eec-62ac-4b8a-b089-d273eebef160 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:16.004573 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd9eec-62ac-4b8a-b089-d273eebef160 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:16.012974 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 279/562] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 02:51:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:16.013794 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd9eec-62ac-4b8a-b089-d273eebef160 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:16.105862 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5ff5c-2713-4428-882a-cd62269d5362 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:16.113868 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd9eec-62ac-4b8a-b089-d273eebef160 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:16.138655 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a779d9-8219-4167-ae35-09be90e4ae64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:16.139340 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a779d9-8219-4167-ae35-09be90e4ae64 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:16.139603 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a779d9-8219-4167-ae35-09be90e4ae64 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:16.139891 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a779d9-8219-4167-ae35-09be90e4ae64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:16.146861 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebda0f-7e90-4428-a5a8-6810ee636d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:16.147775 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebda0f-7e90-4428-a5a8-6810ee636d3a None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:16.148056 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebda0f-7e90-4428-a5a8-6810ee636d3a None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:16.148325 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebda0f-7e90-4428-a5a8-6810ee636d3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:16.150112 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a779d9-8219-4167-ae35-09be90e4ae64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:16.151665 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a779d9-8219-4167-ae35-09be90e4ae64 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:16.158330 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cebda0f-7e90-4428-a5a8-6810ee636d3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:51:16.165277 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-6cebda0f-7e90-4428-a5a8-6810ee636d3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 02:51:16.171476 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 280/563] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 02:51:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:16.171476 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebda0f-7e90-4428-a5a8-6810ee636d3a None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:16.171702 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-01a779d9-8219-4167-ae35-09be90e4ae64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:16.171702 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 284/564] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:16.171702 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a779d9-8219-4167-ae35-09be90e4ae64 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:16.268534 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a779d9-8219-4167-ae35-09be90e4ae64 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:16.268728 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebda0f-7e90-4428-a5a8-6810ee636d3a None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:16.301907 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540b20b-4a0c-446f-8fb9-2927d94488f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:16.302149 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a71ed-97d7-483c-a2e8-55c0b58c484c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:16.302739 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540b20b-4a0c-446f-8fb9-2927d94488f4 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:16.302846 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a71ed-97d7-483c-a2e8-55c0b58c484c None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:16.303031 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540b20b-4a0c-446f-8fb9-2927d94488f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:16.303123 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a71ed-97d7-483c-a2e8-55c0b58c484c None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:16.303277 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540b20b-4a0c-446f-8fb9-2927d94488f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:16.303378 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a71ed-97d7-483c-a2e8-55c0b58c484c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:16.310056 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540b20b-4a0c-446f-8fb9-2927d94488f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:16.311548 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540b20b-4a0c-446f-8fb9-2927d94488f4 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:16.314373 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a71ed-97d7-483c-a2e8-55c0b58c484c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:16.315838 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a71ed-97d7-483c-a2e8-55c0b58c484c None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:16.324844 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-7540b20b-4a0c-446f-8fb9-2927d94488f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:51:16.332497 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 281/565] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:51:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:16.332497 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540b20b-4a0c-446f-8fb9-2927d94488f4 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:16.335466 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-b36a71ed-97d7-483c-a2e8-55c0b58c484c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:16.336926 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 285/566] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:16.339795 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a71ed-97d7-483c-a2e8-55c0b58c484c None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:16.431170 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540b20b-4a0c-446f-8fb9-2927d94488f4 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:16.456930 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a71ed-97d7-483c-a2e8-55c0b58c484c None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:16.465611 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6f7a3-197b-46be-b2cc-73f51aeca14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:16.466264 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6f7a3-197b-46be-b2cc-73f51aeca14b None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:16.466507 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6f7a3-197b-46be-b2cc-73f51aeca14b None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:16.466789 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6f7a3-197b-46be-b2cc-73f51aeca14b None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:16.467504 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6f7a3-197b-46be-b2cc-73f51aeca14b None admin] RBAC: Adding query filter params (name=service) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:16.467820 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6f7a3-197b-46be-b2cc-73f51aeca14b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:16.469188 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6f7a3-197b-46be-b2cc-73f51aeca14b None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:16.477194 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 282/567] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 02:51:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:16.477977 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6f7a3-197b-46be-b2cc-73f51aeca14b None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:16.493175 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a3766-c18d-45af-9a4d-2b6f9fbcd7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:16.493857 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a3766-c18d-45af-9a4d-2b6f9fbcd7b9 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:16.494156 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a3766-c18d-45af-9a4d-2b6f9fbcd7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:16.494424 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a3766-c18d-45af-9a4d-2b6f9fbcd7b9 None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:16.495312 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a3766-c18d-45af-9a4d-2b6f9fbcd7b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:16.495614 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a3766-c18d-45af-9a4d-2b6f9fbcd7b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:16.497130 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a3766-c18d-45af-9a4d-2b6f9fbcd7b9 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:16.513920 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 286/568] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:16.514804 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a3766-c18d-45af-9a4d-2b6f9fbcd7b9 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:16.571649 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6f7a3-197b-46be-b2cc-73f51aeca14b None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:16.604788 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78081c13-1d01-4cff-9210-8811ad8aab4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:16.605443 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78081c13-1d01-4cff-9210-8811ad8aab4a None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:16.605716 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78081c13-1d01-4cff-9210-8811ad8aab4a None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:16.605975 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78081c13-1d01-4cff-9210-8811ad8aab4a None admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:16.606905 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78081c13-1d01-4cff-9210-8811ad8aab4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:16.607072 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78081c13-1d01-4cff-9210-8811ad8aab4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:16.608475 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78081c13-1d01-4cff-9210-8811ad8aab4a None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:16.625242 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 283/569] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 02:51:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:16.625242 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78081c13-1d01-4cff-9210-8811ad8aab4a None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:16.625504 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a3766-c18d-45af-9a4d-2b6f9fbcd7b9 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:16.654632 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3be62e-f934-41a9-9de5-c83e634e65a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:16.655291 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3be62e-f934-41a9-9de5-c83e634e65a1 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:16.655560 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3be62e-f934-41a9-9de5-c83e634e65a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:16.655847 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3be62e-f934-41a9-9de5-c83e634e65a1 None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:16.656555 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3be62e-f934-41a9-9de5-c83e634e65a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:16.656850 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3be62e-f934-41a9-9de5-c83e634e65a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:16.658195 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3be62e-f934-41a9-9de5-c83e634e65a1 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:16.668756 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 287/570] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:16.669537 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3be62e-f934-41a9-9de5-c83e634e65a1 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:16.722120 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78081c13-1d01-4cff-9210-8811ad8aab4a None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:16.766158 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc5716-e894-4679-b6d5-3a8d99f41d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:16.766940 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc5716-e894-4679-b6d5-3a8d99f41d12 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:16.767208 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc5716-e894-4679-b6d5-3a8d99f41d12 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:16.767466 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc5716-e894-4679-b6d5-3a8d99f41d12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:16.769655 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3be62e-f934-41a9-9de5-c83e634e65a1 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:16.777704 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc5716-e894-4679-b6d5-3a8d99f41d12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:16.779163 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc5716-e894-4679-b6d5-3a8d99f41d12 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:16.795816 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-11dc5716-e894-4679-b6d5-3a8d99f41d12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:16.796984 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 284/571] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:16.797733 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc5716-e894-4679-b6d5-3a8d99f41d12 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:16.801915 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f26ba2-6a25-4720-a53f-38a2bc3c3791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:16.802698 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f26ba2-6a25-4720-a53f-38a2bc3c3791 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:16.802967 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f26ba2-6a25-4720-a53f-38a2bc3c3791 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:16.803212 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f26ba2-6a25-4720-a53f-38a2bc3c3791 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:16.810763 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f26ba2-6a25-4720-a53f-38a2bc3c3791 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:16.812236 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f26ba2-6a25-4720-a53f-38a2bc3c3791 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:16.825833 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-68f26ba2-6a25-4720-a53f-38a2bc3c3791 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 12 02:51:16.826958 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 288/572] 10.222.0.32 () {56 vars in 1093 bytes} [Tue Apr 12 02:51:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:16.828470 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411713d-f897-49ee-9f3f-301c1843db4c None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:16.828752 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411713d-f897-49ee-9f3f-301c1843db4c None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:16.828969 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411713d-f897-49ee-9f3f-301c1843db4c None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:16.830373 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 289/573] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:16.830880 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411713d-f897-49ee-9f3f-301c1843db4c None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:16.898336 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc5716-e894-4679-b6d5-3a8d99f41d12 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:16.928763 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15369bf0-a811-44a3-91ad-235a0058f7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:16.928952 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411713d-f897-49ee-9f3f-301c1843db4c None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:16.929398 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15369bf0-a811-44a3-91ad-235a0058f7ef None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:16.929668 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15369bf0-a811-44a3-91ad-235a0058f7ef None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:16.929927 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15369bf0-a811-44a3-91ad-235a0058f7ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:16.930731 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15369bf0-a811-44a3-91ad-235a0058f7ef None admin] RBAC: Adding query filter params (role.id=a8b79923b07243e385187b6641381ee1, scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed, user.id=8e8d78f92f12405fb746ddeb2579bd2e) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:16.931029 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15369bf0-a811-44a3-91ad-235a0058f7ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:16.932525 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15369bf0-a811-44a3-91ad-235a0058f7ef None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:16.938082 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 285/574] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:51:16 2022] GET /identity/v3/role_assignments?user.id=8e8d78f92f12405fb746ddeb2579bd2e&scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed&role.id=a8b79923b07243e385187b6641381ee1 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:16.938847 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15369bf0-a811-44a3-91ad-235a0058f7ef None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:16.964096 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6c9d2-a9e5-425e-bd50-02e40e8b9745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:16.964640 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6c9d2-a9e5-425e-bd50-02e40e8b9745 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:16.965120 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6c9d2-a9e5-425e-bd50-02e40e8b9745 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:16.965390 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6c9d2-a9e5-425e-bd50-02e40e8b9745 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:16.973535 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c6c9d2-a9e5-425e-bd50-02e40e8b9745 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:16.975015 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c6c9d2-a9e5-425e-bd50-02e40e8b9745 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:16.990970 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-04c6c9d2-a9e5-425e-bd50-02e40e8b9745 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 12 02:51:16.997872 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 290/575] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:51:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:16.997872 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6c9d2-a9e5-425e-bd50-02e40e8b9745 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:17.052852 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15369bf0-a811-44a3-91ad-235a0058f7ef None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:17.090156 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c61692-9f76-426f-adac-12c372443ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:17.090734 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c61692-9f76-426f-adac-12c372443ebe None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:17.091015 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c61692-9f76-426f-adac-12c372443ebe None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:17.091287 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c61692-9f76-426f-adac-12c372443ebe None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:17.092046 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c61692-9f76-426f-adac-12c372443ebe None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:17.092351 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c61692-9f76-426f-adac-12c372443ebe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:17.093753 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c61692-9f76-426f-adac-12c372443ebe None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:17.103345 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6c9d2-a9e5-425e-bd50-02e40e8b9745 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:17.110770 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 286/576] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:17.112286 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70cda1-5652-41a5-8651-d6eced3bb2b1 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:17.112571 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70cda1-5652-41a5-8651-d6eced3bb2b1 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:17.112845 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70cda1-5652-41a5-8651-d6eced3bb2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:17.130073 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-4f70cda1-5652-41a5-8651-d6eced3bb2b1 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:17.131263 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-4f70cda1-5652-41a5-8651-d6eced3bb2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:17.146881 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393aebd9-4d02-49f1-b447-55a7986b2e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:17.147831 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393aebd9-4d02-49f1-b447-55a7986b2e6a None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:17.148108 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393aebd9-4d02-49f1-b447-55a7986b2e6a None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:17.148373 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393aebd9-4d02-49f1-b447-55a7986b2e6a None admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:17.149212 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393aebd9-4d02-49f1-b447-55a7986b2e6a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:17.149514 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393aebd9-4d02-49f1-b447-55a7986b2e6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:17.150950 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393aebd9-4d02-49f1-b447-55a7986b2e6a None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:17.172329 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 291/577] 10.222.0.32 () {56 vars in 1133 bytes} [Tue Apr 12 02:51:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:17.172329 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393aebd9-4d02-49f1-b447-55a7986b2e6a None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:17.203761 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 287/578] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:51:17.203761 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70cda1-5652-41a5-8651-d6eced3bb2b1 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:17.279306 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393aebd9-4d02-49f1-b447-55a7986b2e6a None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:17.297125 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70cda1-5652-41a5-8651-d6eced3bb2b1 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:17.313772 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fa48f-6725-4012-96cb-a7d2415ca2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:17.314446 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fa48f-6725-4012-96cb-a7d2415ca2c8 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:17.314714 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fa48f-6725-4012-96cb-a7d2415ca2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:17.314970 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fa48f-6725-4012-96cb-a7d2415ca2c8 None admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:17.315813 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2fa48f-6725-4012-96cb-a7d2415ca2c8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:17.316156 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2fa48f-6725-4012-96cb-a7d2415ca2c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:17.317575 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2fa48f-6725-4012-96cb-a7d2415ca2c8 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:17.330285 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a086f-7722-4bd8-b319-d1a9d0140f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:17.331084 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a086f-7722-4bd8-b319-d1a9d0140f20 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:17.331354 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a086f-7722-4bd8-b319-d1a9d0140f20 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:17.331617 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a086f-7722-4bd8-b319-d1a9d0140f20 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:17.339210 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a086f-7722-4bd8-b319-d1a9d0140f20 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:17.340571 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 292/579] 10.222.0.32 () {56 vars in 1137 bytes} [Tue Apr 12 02:51:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:17.340837 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a086f-7722-4bd8-b319-d1a9d0140f20 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:17.341162 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fa48f-6725-4012-96cb-a7d2415ca2c8 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:17.354874 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-f91a086f-7722-4bd8-b319-d1a9d0140f20 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 12 02:51:17.356107 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 288/580] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:51:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:17.356856 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a086f-7722-4bd8-b319-d1a9d0140f20 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:17.440391 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fa48f-6725-4012-96cb-a7d2415ca2c8 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:17.451508 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a086f-7722-4bd8-b319-d1a9d0140f20 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:17.472544 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba32a89-aaee-4be2-abf9-e98f6c5254dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:17.473334 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba32a89-aaee-4be2-abf9-e98f6c5254dc None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:17.473606 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba32a89-aaee-4be2-abf9-e98f6c5254dc None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:17.473875 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba32a89-aaee-4be2-abf9-e98f6c5254dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:17.483483 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e92a75-bba0-4a44-bdee-1061152e51dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:17.483698 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba32a89-aaee-4be2-abf9-e98f6c5254dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:17.484662 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e92a75-bba0-4a44-bdee-1061152e51dd None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:17.485106 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e92a75-bba0-4a44-bdee-1061152e51dd None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:17.485207 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba32a89-aaee-4be2-abf9-e98f6c5254dc None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:17.485621 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e92a75-bba0-4a44-bdee-1061152e51dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:17.496902 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e92a75-bba0-4a44-bdee-1061152e51dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:51:17.501786 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-3ba32a89-aaee-4be2-abf9-e98f6c5254dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:17.507885 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 293/581] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:17.507885 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba32a89-aaee-4be2-abf9-e98f6c5254dc None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:17.508090 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-27e92a75-bba0-4a44-bdee-1061152e51dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 02:51:17.509998 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 289/582] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 02:51:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:17.510612 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e92a75-bba0-4a44-bdee-1061152e51dd None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:17.609174 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba32a89-aaee-4be2-abf9-e98f6c5254dc None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:17.610790 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e92a75-bba0-4a44-bdee-1061152e51dd None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:17.642195 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca251226-6a39-4ce9-9cfd-a13a969cd3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:17.642981 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca251226-6a39-4ce9-9cfd-a13a969cd3a1 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:17.643254 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca251226-6a39-4ce9-9cfd-a13a969cd3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:17.643519 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca251226-6a39-4ce9-9cfd-a13a969cd3a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:17.648406 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01225cd-ae13-497f-aea4-20ded7371b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:17.649066 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01225cd-ae13-497f-aea4-20ded7371b77 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:17.649337 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01225cd-ae13-497f-aea4-20ded7371b77 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:17.649595 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01225cd-ae13-497f-aea4-20ded7371b77 None admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:17.650405 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01225cd-ae13-497f-aea4-20ded7371b77 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:17.650700 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01225cd-ae13-497f-aea4-20ded7371b77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:17.652380 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01225cd-ae13-497f-aea4-20ded7371b77 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:17.654617 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca251226-6a39-4ce9-9cfd-a13a969cd3a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:17.656071 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca251226-6a39-4ce9-9cfd-a13a969cd3a1 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:17.673839 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 290/583] 10.222.0.32 () {56 vars in 1137 bytes} [Tue Apr 12 02:51:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:17.673839 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01225cd-ae13-497f-aea4-20ded7371b77 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:17.674078 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-ca251226-6a39-4ce9-9cfd-a13a969cd3a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:17.674078 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 294/584] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:17.674687 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca251226-6a39-4ce9-9cfd-a13a969cd3a1 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:17.770670 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01225cd-ae13-497f-aea4-20ded7371b77 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:17.773334 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca251226-6a39-4ce9-9cfd-a13a969cd3a1 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:17.804506 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94612e0d-8d48-4d6f-bfb3-1ebfa9b0d434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:17.805166 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94612e0d-8d48-4d6f-bfb3-1ebfa9b0d434 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:17.805443 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94612e0d-8d48-4d6f-bfb3-1ebfa9b0d434 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:17.805709 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94612e0d-8d48-4d6f-bfb3-1ebfa9b0d434 None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:17.806413 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94612e0d-8d48-4d6f-bfb3-1ebfa9b0d434 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:17.806714 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94612e0d-8d48-4d6f-bfb3-1ebfa9b0d434 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:17.806808 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36d8d5-0610-4451-9564-b3b0d53bcb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:17.807408 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36d8d5-0610-4451-9564-b3b0d53bcb82 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:17.807920 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36d8d5-0610-4451-9564-b3b0d53bcb82 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:17.808194 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36d8d5-0610-4451-9564-b3b0d53bcb82 None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:17.808295 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94612e0d-8d48-4d6f-bfb3-1ebfa9b0d434 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:17.808936 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36d8d5-0610-4451-9564-b3b0d53bcb82 None admin] RBAC: Adding query filter params (name=service) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:17.809233 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36d8d5-0610-4451-9564-b3b0d53bcb82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:17.810569 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36d8d5-0610-4451-9564-b3b0d53bcb82 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:17.824397 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 295/585] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 02:51:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:17.824569 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 291/586] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:17.824569 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94612e0d-8d48-4d6f-bfb3-1ebfa9b0d434 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:17.824730 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36d8d5-0610-4451-9564-b3b0d53bcb82 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:17.922935 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36d8d5-0610-4451-9564-b3b0d53bcb82 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:17.925716 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94612e0d-8d48-4d6f-bfb3-1ebfa9b0d434 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:17.956806 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc2659-f784-4920-9efb-ac60d6c590d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:17.957622 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc2659-f784-4920-9efb-ac60d6c590d9 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:17.957888 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc2659-f784-4920-9efb-ac60d6c590d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:17.958148 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc2659-f784-4920-9efb-ac60d6c590d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:17.960845 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447017fc-1739-490f-b92e-618473947c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:17.961308 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447017fc-1739-490f-b92e-618473947c5b None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:17.961585 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447017fc-1739-490f-b92e-618473947c5b None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:17.961852 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447017fc-1739-490f-b92e-618473947c5b None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:17.962569 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447017fc-1739-490f-b92e-618473947c5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:17.962922 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447017fc-1739-490f-b92e-618473947c5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:17.964557 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447017fc-1739-490f-b92e-618473947c5b None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:17.969028 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc2659-f784-4920-9efb-ac60d6c590d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:17.970458 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc2659-f784-4920-9efb-ac60d6c590d9 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:17.980065 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 292/587] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:17.981467 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447017fc-1739-490f-b92e-618473947c5b None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:17.988013 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-d1fc2659-f784-4920-9efb-ac60d6c590d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:17.989231 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 296/588] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:17.989994 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc2659-f784-4920-9efb-ac60d6c590d9 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:18.082458 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447017fc-1739-490f-b92e-618473947c5b None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:18.097847 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc2659-f784-4920-9efb-ac60d6c590d9 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:18.117608 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb6910-9593-4ace-ae48-e077aac63a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:18.118406 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb6910-9593-4ace-ae48-e077aac63a7c None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:18.118676 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb6910-9593-4ace-ae48-e077aac63a7c None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:18.118937 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb6910-9593-4ace-ae48-e077aac63a7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:18.125908 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb6910-9593-4ace-ae48-e077aac63a7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:18.127360 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb6910-9593-4ace-ae48-e077aac63a7c None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:18.131397 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112b55e-1f91-48ea-8665-596c2b456a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:18.132217 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112b55e-1f91-48ea-8665-596c2b456a25 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:18.132492 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112b55e-1f91-48ea-8665-596c2b456a25 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:18.132759 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112b55e-1f91-48ea-8665-596c2b456a25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:18.141246 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-43cb6910-9593-4ace-ae48-e077aac63a7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:51:18.147744 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 293/589] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:51:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:18.147862 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112b55e-1f91-48ea-8665-596c2b456a25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:18.147938 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb6910-9593-4ace-ae48-e077aac63a7c None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:18.148006 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112b55e-1f91-48ea-8665-596c2b456a25 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:18.164191 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-0112b55e-1f91-48ea-8665-596c2b456a25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:18.169979 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 297/590] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:18.169979 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112b55e-1f91-48ea-8665-596c2b456a25 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:18.256475 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb6910-9593-4ace-ae48-e077aac63a7c None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:18.262298 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112b55e-1f91-48ea-8665-596c2b456a25 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:18.290012 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a73245-666d-4b2b-a420-4c697eff02cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:18.291092 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a73245-666d-4b2b-a420-4c697eff02cd None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:18.291581 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a73245-666d-4b2b-a420-4c697eff02cd None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:18.292137 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a73245-666d-4b2b-a420-4c697eff02cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:18.296231 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f270f-94c8-4425-85ef-03205b5eb12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:18.296954 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f270f-94c8-4425-85ef-03205b5eb12f None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:18.297227 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f270f-94c8-4425-85ef-03205b5eb12f None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:18.297489 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f270f-94c8-4425-85ef-03205b5eb12f None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:18.298193 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f270f-94c8-4425-85ef-03205b5eb12f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:18.298485 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f270f-94c8-4425-85ef-03205b5eb12f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:18.299946 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f270f-94c8-4425-85ef-03205b5eb12f None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:18.301922 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a73245-666d-4b2b-a420-4c697eff02cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:18.303392 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a73245-666d-4b2b-a420-4c697eff02cd None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:18.311994 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 298/591] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:18.312867 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f270f-94c8-4425-85ef-03205b5eb12f None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:18.318216 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-38a73245-666d-4b2b-a420-4c697eff02cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:51:18.320025 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 294/592] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:51:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:18.320231 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a73245-666d-4b2b-a420-4c697eff02cd None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:18.417008 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a73245-666d-4b2b-a420-4c697eff02cd None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:18.417236 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f270f-94c8-4425-85ef-03205b5eb12f None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:18.451104 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c91bff-9b63-4edd-a4f5-be5482803546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:18.451810 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5991164-eca6-41dc-b2b2-7b2499381fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:18.451934 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c91bff-9b63-4edd-a4f5-be5482803546 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:18.452181 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c91bff-9b63-4edd-a4f5-be5482803546 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:18.452447 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c91bff-9b63-4edd-a4f5-be5482803546 None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:18.452550 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5991164-eca6-41dc-b2b2-7b2499381fe4 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:18.453055 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5991164-eca6-41dc-b2b2-7b2499381fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:18.453322 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5991164-eca6-41dc-b2b2-7b2499381fe4 None admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:18.453479 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c91bff-9b63-4edd-a4f5-be5482803546 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:18.453762 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c91bff-9b63-4edd-a4f5-be5482803546 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:18.454120 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5991164-eca6-41dc-b2b2-7b2499381fe4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:18.454401 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5991164-eca6-41dc-b2b2-7b2499381fe4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:18.455152 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c91bff-9b63-4edd-a4f5-be5482803546 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:18.455841 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5991164-eca6-41dc-b2b2-7b2499381fe4 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:18.466994 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 295/593] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:18.471582 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c91bff-9b63-4edd-a4f5-be5482803546 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:18.471914 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 299/594] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 02:51:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:18.472786 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5991164-eca6-41dc-b2b2-7b2499381fe4 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:18.569826 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c91bff-9b63-4edd-a4f5-be5482803546 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:18.573586 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5991164-eca6-41dc-b2b2-7b2499381fe4 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:18.606131 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bdbde-1a0b-48b0-b9cb-02e82eac2143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:18.606424 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ce0ea-61bf-4d85-a09e-36fa64e6d051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:18.606923 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bdbde-1a0b-48b0-b9cb-02e82eac2143 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:18.607088 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ce0ea-61bf-4d85-a09e-36fa64e6d051 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:18.607200 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bdbde-1a0b-48b0-b9cb-02e82eac2143 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:18.607367 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ce0ea-61bf-4d85-a09e-36fa64e6d051 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:18.607466 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bdbde-1a0b-48b0-b9cb-02e82eac2143 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:18.607609 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ce0ea-61bf-4d85-a09e-36fa64e6d051 None admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:18.608432 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ce0ea-61bf-4d85-a09e-36fa64e6d051 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:18.608731 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ce0ea-61bf-4d85-a09e-36fa64e6d051 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:18.610150 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ce0ea-61bf-4d85-a09e-36fa64e6d051 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:18.614102 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bdbde-1a0b-48b0-b9cb-02e82eac2143 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:18.615527 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bdbde-1a0b-48b0-b9cb-02e82eac2143 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:18.622026 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 300/595] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 02:51:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:18.622850 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ce0ea-61bf-4d85-a09e-36fa64e6d051 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:18.634385 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-378bdbde-1a0b-48b0-b9cb-02e82eac2143 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:51:18.635925 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 296/596] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:51:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:18.636749 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bdbde-1a0b-48b0-b9cb-02e82eac2143 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:18.723602 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ce0ea-61bf-4d85-a09e-36fa64e6d051 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:18.733416 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bdbde-1a0b-48b0-b9cb-02e82eac2143 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:18.756026 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b546bd5-5736-4698-a116-06eee7459fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:18.757155 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b546bd5-5736-4698-a116-06eee7459fd6 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:18.757606 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b546bd5-5736-4698-a116-06eee7459fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:18.758061 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b546bd5-5736-4698-a116-06eee7459fd6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:18.765417 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b546bd5-5736-4698-a116-06eee7459fd6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:18.765550 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606159c7-2fcf-42bb-aa3d-c49a8110bc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:18.766313 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606159c7-2fcf-42bb-aa3d-c49a8110bc91 None admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:18.766591 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606159c7-2fcf-42bb-aa3d-c49a8110bc91 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:18.766856 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606159c7-2fcf-42bb-aa3d-c49a8110bc91 None admin] PATH_INFO: `/v3/projects/82cb5f6cfa0e46b28a37565fc2b560ed/users/43ee5cb310fd4538910e40ea7082708c/roles/a8b79923b07243e385187b6641381ee1` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:18.766968 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b546bd5-5736-4698-a116-06eee7459fd6 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:18.781180 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-9b546bd5-5736-4698-a116-06eee7459fd6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 12 02:51:18.781360 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606159c7-2fcf-42bb-aa3d-c49a8110bc91 None admin] RBAC: Authorizing `identity:create_grant(project_id=82cb5f6cfa0e46b28a37565fc2b560ed, user_id=43ee5cb310fd4538910e40ea7082708c, role_id=a8b79923b07243e385187b6641381ee1)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:18.786863 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606159c7-2fcf-42bb-aa3d-c49a8110bc91 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:18.787084 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 301/597] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 02:51:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:18.787084 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b546bd5-5736-4698-a116-06eee7459fd6 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:18.796755 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 297/598] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 02:51:18 2022] PUT /identity/v3/projects/82cb5f6cfa0e46b28a37565fc2b560ed/users/43ee5cb310fd4538910e40ea7082708c/roles/a8b79923b07243e385187b6641381ee1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 02:51:18.797878 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606159c7-2fcf-42bb-aa3d-c49a8110bc91 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:18.909792 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606159c7-2fcf-42bb-aa3d-c49a8110bc91 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:18.929997 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b546bd5-5736-4698-a116-06eee7459fd6 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:18.956564 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d9c00-a66f-4325-87ff-b00524cbba52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:18.957264 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d9c00-a66f-4325-87ff-b00524cbba52 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:18.957679 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d9c00-a66f-4325-87ff-b00524cbba52 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:18.957952 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d9c00-a66f-4325-87ff-b00524cbba52 None admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:18.959132 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d9c00-a66f-4325-87ff-b00524cbba52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:18.959452 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d9c00-a66f-4325-87ff-b00524cbba52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:18.961441 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d9c00-a66f-4325-87ff-b00524cbba52 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:18.969760 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828dc7ab-2f23-4711-874d-b4ea740c2bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:18.970929 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dc7ab-2f23-4711-874d-b4ea740c2bb0 None admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:18.971365 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dc7ab-2f23-4711-874d-b4ea740c2bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:18.971872 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dc7ab-2f23-4711-874d-b4ea740c2bb0 None admin] PATH_INFO: `/v3/projects/82cb5f6cfa0e46b28a37565fc2b560ed/users/828a6cffa8af470388d4b063c3c49849/roles/a8b79923b07243e385187b6641381ee1` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:18.977639 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 298/599] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 02:51:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:18.978322 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d9c00-a66f-4325-87ff-b00524cbba52 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:18.991027 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828dc7ab-2f23-4711-874d-b4ea740c2bb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=82cb5f6cfa0e46b28a37565fc2b560ed, user_id=828a6cffa8af470388d4b063c3c49849, role_id=a8b79923b07243e385187b6641381ee1)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:18.993655 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828dc7ab-2f23-4711-874d-b4ea740c2bb0 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:19.012545 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 302/600] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 02:51:18 2022] PUT /identity/v3/projects/82cb5f6cfa0e46b28a37565fc2b560ed/users/828a6cffa8af470388d4b063c3c49849/roles/a8b79923b07243e385187b6641381ee1 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 02:51:19.012545 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828dc7ab-2f23-4711-874d-b4ea740c2bb0 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:19.114936 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d9c00-a66f-4325-87ff-b00524cbba52 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:19.135234 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828dc7ab-2f23-4711-874d-b4ea740c2bb0 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:19.149460 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35982c1d-5a37-457b-afbe-dca4f6ab9021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:19.150155 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35982c1d-5a37-457b-afbe-dca4f6ab9021 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:19.150426 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35982c1d-5a37-457b-afbe-dca4f6ab9021 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:19.150688 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35982c1d-5a37-457b-afbe-dca4f6ab9021 None admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:19.151596 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35982c1d-5a37-457b-afbe-dca4f6ab9021 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:19.151927 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35982c1d-5a37-457b-afbe-dca4f6ab9021 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:19.153405 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35982c1d-5a37-457b-afbe-dca4f6ab9021 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:19.172573 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 299/601] 10.222.0.32 () {56 vars in 1139 bytes} [Tue Apr 12 02:51:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:19.173057 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952830bc-0c05-4e37-b813-2e02a71f3fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:19.173953 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952830bc-0c05-4e37-b813-2e02a71f3fe6 None admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:19.174222 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952830bc-0c05-4e37-b813-2e02a71f3fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:19.174481 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952830bc-0c05-4e37-b813-2e02a71f3fe6 None admin] PATH_INFO: `/v3/projects/82cb5f6cfa0e46b28a37565fc2b560ed/users/44248c51c2cb497b85a68dce0496a225/roles/a8b79923b07243e385187b6641381ee1` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:19.177877 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35982c1d-5a37-457b-afbe-dca4f6ab9021 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:19.191907 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952830bc-0c05-4e37-b813-2e02a71f3fe6 None admin] RBAC: Authorizing `identity:create_grant(project_id=82cb5f6cfa0e46b28a37565fc2b560ed, user_id=44248c51c2cb497b85a68dce0496a225, role_id=a8b79923b07243e385187b6641381ee1)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:19.193487 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952830bc-0c05-4e37-b813-2e02a71f3fe6 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:19.213915 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 303/602] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 02:51:19 2022] PUT /identity/v3/projects/82cb5f6cfa0e46b28a37565fc2b560ed/users/44248c51c2cb497b85a68dce0496a225/roles/a8b79923b07243e385187b6641381ee1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 02:51:19.296443 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35982c1d-5a37-457b-afbe-dca4f6ab9021 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:19.308399 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20279a-33f9-4c17-bd44-1234cfb6e7a4 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:19.308789 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20279a-33f9-4c17-bd44-1234cfb6e7a4 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:19.309063 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20279a-33f9-4c17-bd44-1234cfb6e7a4 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:19.314950 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 304/603] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:51:19.316469 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f846141-2837-46fe-b5ba-afe573b54b51 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:19.316753 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f846141-2837-46fe-b5ba-afe573b54b51 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:19.317021 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f846141-2837-46fe-b5ba-afe573b54b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:19.338608 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-3f846141-2837-46fe-b5ba-afe573b54b51 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:19.339114 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306733dd-7f11-449e-a52a-5edc5505fa73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:19.340062 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306733dd-7f11-449e-a52a-5edc5505fa73 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:19.340335 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306733dd-7f11-449e-a52a-5edc5505fa73 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:19.340604 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306733dd-7f11-449e-a52a-5edc5505fa73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:19.341468 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-3f846141-2837-46fe-b5ba-afe573b54b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:19.355555 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306733dd-7f11-449e-a52a-5edc5505fa73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:19.357610 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306733dd-7f11-449e-a52a-5edc5505fa73 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:19.380809 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-306733dd-7f11-449e-a52a-5edc5505fa73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:19.382531 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 300/604] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:51:19.388148 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306733dd-7f11-449e-a52a-5edc5505fa73 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:19.424408 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 305/605] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:51:19.448531 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f846141-2837-46fe-b5ba-afe573b54b51 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:19.486405 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306733dd-7f11-449e-a52a-5edc5505fa73 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:19.522200 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172537d3-7f64-4405-86fd-fb902c1398f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:19.522873 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172537d3-7f64-4405-86fd-fb902c1398f8 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:19.523148 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172537d3-7f64-4405-86fd-fb902c1398f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:19.523420 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172537d3-7f64-4405-86fd-fb902c1398f8 None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:19.524153 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172537d3-7f64-4405-86fd-fb902c1398f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:19.524455 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172537d3-7f64-4405-86fd-fb902c1398f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:19.525843 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172537d3-7f64-4405-86fd-fb902c1398f8 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:19.537695 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 301/606] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:51:19.543160 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172537d3-7f64-4405-86fd-fb902c1398f8 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:19.554248 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f846141-2837-46fe-b5ba-afe573b54b51 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:19.613322 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e9e3d-05c2-4a98-8656-9e247750236c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:19.614259 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e9e3d-05c2-4a98-8656-9e247750236c None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:19.614636 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e9e3d-05c2-4a98-8656-9e247750236c None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:19.615016 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e9e3d-05c2-4a98-8656-9e247750236c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:19.639477 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e9e3d-05c2-4a98-8656-9e247750236c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:51:19.646784 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-568e9e3d-05c2-4a98-8656-9e247750236c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 02:51:19.652958 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 306/607] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 02:51:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:51:19.654197 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e9e3d-05c2-4a98-8656-9e247750236c None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:19.655782 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172537d3-7f64-4405-86fd-fb902c1398f8 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:19.691553 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f89f24-e5ea-4db2-a615-4aac79a2e5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:19.692646 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f89f24-e5ea-4db2-a615-4aac79a2e5b6 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:19.693507 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f89f24-e5ea-4db2-a615-4aac79a2e5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:19.693955 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f89f24-e5ea-4db2-a615-4aac79a2e5b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:19.701339 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f89f24-e5ea-4db2-a615-4aac79a2e5b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:19.703682 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f89f24-e5ea-4db2-a615-4aac79a2e5b6 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:19.719319 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-30f89f24-e5ea-4db2-a615-4aac79a2e5b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:51:19.721932 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 302/608] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:51:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:19.727469 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f89f24-e5ea-4db2-a615-4aac79a2e5b6 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:19.834339 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f89f24-e5ea-4db2-a615-4aac79a2e5b6 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:19.842989 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e9e3d-05c2-4a98-8656-9e247750236c None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:19.886477 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5f491-5583-446b-bfad-91cc827cd812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:19.888022 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5f491-5583-446b-bfad-91cc827cd812 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:19.888630 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5f491-5583-446b-bfad-91cc827cd812 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:19.889092 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5f491-5583-446b-bfad-91cc827cd812 None admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:19.890055 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5f491-5583-446b-bfad-91cc827cd812 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:19.890547 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5f491-5583-446b-bfad-91cc827cd812 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:19.892367 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5f491-5583-446b-bfad-91cc827cd812 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:19.906092 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 303/609] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 02:51:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:51:19.912189 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5f491-5583-446b-bfad-91cc827cd812 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:19.931415 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db800d2b-03a6-4ba8-83d8-35dcddd22677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:19.932154 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db800d2b-03a6-4ba8-83d8-35dcddd22677 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:19.932520 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db800d2b-03a6-4ba8-83d8-35dcddd22677 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:19.932790 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db800d2b-03a6-4ba8-83d8-35dcddd22677 None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:19.933653 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db800d2b-03a6-4ba8-83d8-35dcddd22677 None admin] RBAC: Adding query filter params (name=service) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:19.933955 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db800d2b-03a6-4ba8-83d8-35dcddd22677 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:19.935391 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db800d2b-03a6-4ba8-83d8-35dcddd22677 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:19.962170 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 307/610] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 02:51:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:19.972805 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db800d2b-03a6-4ba8-83d8-35dcddd22677 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:20.022848 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5f491-5583-446b-bfad-91cc827cd812 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:20.059840 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc5170-dd58-4370-a4d9-7d784058e9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:20.061103 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc5170-dd58-4370-a4d9-7d784058e9aa None admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:20.061570 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc5170-dd58-4370-a4d9-7d784058e9aa None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:20.062022 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc5170-dd58-4370-a4d9-7d784058e9aa None admin] PATH_INFO: `/v3/projects/82cb5f6cfa0e46b28a37565fc2b560ed/users/8f516943aec14608b5c9d343418a2677/roles/a8b79923b07243e385187b6641381ee1` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:20.078393 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc5170-dd58-4370-a4d9-7d784058e9aa None admin] RBAC: Authorizing `identity:create_grant(project_id=82cb5f6cfa0e46b28a37565fc2b560ed, user_id=8f516943aec14608b5c9d343418a2677, role_id=a8b79923b07243e385187b6641381ee1)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:20.080454 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc5170-dd58-4370-a4d9-7d784058e9aa None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:20.096282 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 304/611] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 02:51:19 2022] PUT /identity/v3/projects/82cb5f6cfa0e46b28a37565fc2b560ed/users/8f516943aec14608b5c9d343418a2677/roles/a8b79923b07243e385187b6641381ee1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 02:51:20.210918 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db800d2b-03a6-4ba8-83d8-35dcddd22677 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:20.255459 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8874e7-ba76-46a6-8a3e-3580bdaea392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:20.256232 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8874e7-ba76-46a6-8a3e-3580bdaea392 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:20.256510 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8874e7-ba76-46a6-8a3e-3580bdaea392 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:20.256781 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8874e7-ba76-46a6-8a3e-3580bdaea392 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:20.277186 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8874e7-ba76-46a6-8a3e-3580bdaea392 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:20.278707 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8874e7-ba76-46a6-8a3e-3580bdaea392 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:20.299304 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-3c8874e7-ba76-46a6-8a3e-3580bdaea392 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:20.300946 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 308/612] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:20.306627 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc5170-dd58-4370-a4d9-7d784058e9aa None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:20.406675 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc5170-dd58-4370-a4d9-7d784058e9aa None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:20.442001 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893fde3-f62f-4e55-9582-52558b642afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:20.443032 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893fde3-f62f-4e55-9582-52558b642afc None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:20.443507 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893fde3-f62f-4e55-9582-52558b642afc None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:20.444030 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893fde3-f62f-4e55-9582-52558b642afc None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:20.444934 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893fde3-f62f-4e55-9582-52558b642afc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:20.445437 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893fde3-f62f-4e55-9582-52558b642afc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:20.447006 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893fde3-f62f-4e55-9582-52558b642afc None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:20.459155 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 305/613] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:20.464764 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8874e7-ba76-46a6-8a3e-3580bdaea392 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:20.581845 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8874e7-ba76-46a6-8a3e-3580bdaea392 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:20.615663 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb3cff-f5b5-4958-9f37-2cf994ae8f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:20.616493 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb3cff-f5b5-4958-9f37-2cf994ae8f23 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:20.616767 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb3cff-f5b5-4958-9f37-2cf994ae8f23 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:20.617036 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb3cff-f5b5-4958-9f37-2cf994ae8f23 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:20.625596 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb3cff-f5b5-4958-9f37-2cf994ae8f23 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:20.627029 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb3cff-f5b5-4958-9f37-2cf994ae8f23 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:20.640822 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-e5bb3cff-f5b5-4958-9f37-2cf994ae8f23 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 12 02:51:20.642385 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 309/614] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 02:51:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:20.648027 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893fde3-f62f-4e55-9582-52558b642afc None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:20.752681 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893fde3-f62f-4e55-9582-52558b642afc None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:20.791205 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15b2d4-d9c7-4418-b005-7fa82cb367e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:20.792299 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15b2d4-d9c7-4418-b005-7fa82cb367e4 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:20.792801 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15b2d4-d9c7-4418-b005-7fa82cb367e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:20.793266 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15b2d4-d9c7-4418-b005-7fa82cb367e4 None admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:20.794398 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c15b2d4-d9c7-4418-b005-7fa82cb367e4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:20.794900 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c15b2d4-d9c7-4418-b005-7fa82cb367e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:20.796572 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c15b2d4-d9c7-4418-b005-7fa82cb367e4 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:20.818682 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 306/615] 10.222.0.32 () {56 vars in 1135 bytes} [Tue Apr 12 02:51:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:20.826336 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb3cff-f5b5-4958-9f37-2cf994ae8f23 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:20.970176 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb3cff-f5b5-4958-9f37-2cf994ae8f23 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:21.007471 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f0c02-923e-4d3c-a05f-2adce48234c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:21.008284 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f0c02-923e-4d3c-a05f-2adce48234c9 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:21.008553 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f0c02-923e-4d3c-a05f-2adce48234c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:21.008811 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f0c02-923e-4d3c-a05f-2adce48234c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:21.019706 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f0c02-923e-4d3c-a05f-2adce48234c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:21.021159 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f0c02-923e-4d3c-a05f-2adce48234c9 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:21.038067 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-b09f0c02-923e-4d3c-a05f-2adce48234c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:21.039586 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 310/616] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:21.045185 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15b2d4-d9c7-4418-b005-7fa82cb367e4 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:21.163174 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15b2d4-d9c7-4418-b005-7fa82cb367e4 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:21.203604 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840e955-fa8a-46b3-b100-c7b3817045af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:21.204653 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840e955-fa8a-46b3-b100-c7b3817045af None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:21.205174 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840e955-fa8a-46b3-b100-c7b3817045af None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:21.205634 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840e955-fa8a-46b3-b100-c7b3817045af None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:21.206542 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840e955-fa8a-46b3-b100-c7b3817045af None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:21.207030 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840e955-fa8a-46b3-b100-c7b3817045af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:21.208628 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840e955-fa8a-46b3-b100-c7b3817045af None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:21.224871 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 307/617] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:21.230787 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f0c02-923e-4d3c-a05f-2adce48234c9 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:21.358858 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f0c02-923e-4d3c-a05f-2adce48234c9 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:21.404365 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140ad1d-ea44-4025-850f-02a18c2e8304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:21.405547 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140ad1d-ea44-4025-850f-02a18c2e8304 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:21.406041 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140ad1d-ea44-4025-850f-02a18c2e8304 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:21.406498 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140ad1d-ea44-4025-850f-02a18c2e8304 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:21.418825 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2140ad1d-ea44-4025-850f-02a18c2e8304 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:21.420619 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2140ad1d-ea44-4025-850f-02a18c2e8304 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:21.437136 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-2140ad1d-ea44-4025-850f-02a18c2e8304 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:51:21.438645 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 311/618] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:51:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:21.444325 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840e955-fa8a-46b3-b100-c7b3817045af None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:21.559944 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840e955-fa8a-46b3-b100-c7b3817045af None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:21.605162 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd2c45-50ee-425b-9460-9c7a2fc7f3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:21.606112 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd2c45-50ee-425b-9460-9c7a2fc7f3af None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:21.606579 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd2c45-50ee-425b-9460-9c7a2fc7f3af None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:21.607038 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd2c45-50ee-425b-9460-9c7a2fc7f3af None admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:21.608038 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd2c45-50ee-425b-9460-9c7a2fc7f3af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:21.608532 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd2c45-50ee-425b-9460-9c7a2fc7f3af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:21.610194 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd2c45-50ee-425b-9460-9c7a2fc7f3af None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:21.627848 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 308/619] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 02:51:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:21.633702 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140ad1d-ea44-4025-850f-02a18c2e8304 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:21.756217 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140ad1d-ea44-4025-850f-02a18c2e8304 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:21.795312 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c42f7-b690-491f-b950-e012718d79b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:21.796231 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c42f7-b690-491f-b950-e012718d79b2 None admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:21.796506 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c42f7-b690-491f-b950-e012718d79b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:21.796774 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c42f7-b690-491f-b950-e012718d79b2 None admin] PATH_INFO: `/v3/projects/82cb5f6cfa0e46b28a37565fc2b560ed/users/8e8d78f92f12405fb746ddeb2579bd2e/roles/a8b79923b07243e385187b6641381ee1` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:21.815789 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c42f7-b690-491f-b950-e012718d79b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=82cb5f6cfa0e46b28a37565fc2b560ed, user_id=8e8d78f92f12405fb746ddeb2579bd2e, role_id=a8b79923b07243e385187b6641381ee1)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:21.817152 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c42f7-b690-491f-b950-e012718d79b2 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:21.844115 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 312/620] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 02:51:21 2022] PUT /identity/v3/projects/82cb5f6cfa0e46b28a37565fc2b560ed/users/8e8d78f92f12405fb746ddeb2579bd2e/roles/a8b79923b07243e385187b6641381ee1 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 02:51:21.870706 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470debc-17f4-41c9-adba-5317f7a494b8 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:21.871163 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470debc-17f4-41c9-adba-5317f7a494b8 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:21.871441 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470debc-17f4-41c9-adba-5317f7a494b8 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:21.873345 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 309/621] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:21.879175 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95db85-5fa0-41c0-878a-9d1e9a3b8a04 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:21.879443 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95db85-5fa0-41c0-878a-9d1e9a3b8a04 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:21.879735 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95db85-5fa0-41c0-878a-9d1e9a3b8a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:21.900857 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-8e95db85-5fa0-41c0-878a-9d1e9a3b8a04 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:21.902159 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-8e95db85-5fa0-41c0-878a-9d1e9a3b8a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:21.989382 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 313/622] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:51:22.041364 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470debc-17f4-41c9-adba-5317f7a494b8 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:22.160275 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470debc-17f4-41c9-adba-5317f7a494b8 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:22.190129 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5154f-6562-4727-a9a4-5696face12ed None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:22.190400 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5154f-6562-4727-a9a4-5696face12ed None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:22.190875 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5154f-6562-4727-a9a4-5696face12ed None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:22.192438 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 314/623] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:51:22.196558 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e53508-1c52-4a84-9fbc-39ab283ff82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:22.197365 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e53508-1c52-4a84-9fbc-39ab283ff82c None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:22.197639 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e53508-1c52-4a84-9fbc-39ab283ff82c None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:22.197905 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e53508-1c52-4a84-9fbc-39ab283ff82c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:22.198937 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b67618-1dbe-4791-8fcb-cbabf0d4fae2 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:22.199449 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b67618-1dbe-4791-8fcb-cbabf0d4fae2 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:22.199942 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b67618-1dbe-4791-8fcb-cbabf0d4fae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:22.209348 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e53508-1c52-4a84-9fbc-39ab283ff82c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:51:22.217485 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-a8e53508-1c52-4a84-9fbc-39ab283ff82c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 02:51:22.219205 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 310/624] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 02:51:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:22.226514 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e53508-1c52-4a84-9fbc-39ab283ff82c None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:22.239391 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-45b67618-1dbe-4791-8fcb-cbabf0d4fae2 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:22.240917 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-45b67618-1dbe-4791-8fcb-cbabf0d4fae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:22.325645 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 315/625] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:51:22.327304 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db88757-d8e9-4811-82e7-3e1fedf858ee None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:22.328111 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db88757-d8e9-4811-82e7-3e1fedf858ee None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:22.328581 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db88757-d8e9-4811-82e7-3e1fedf858ee None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:22.330317 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 316/626] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:22.341182 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8affc91e-3e4b-49df-be71-2d35c719956a None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:22.341751 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8affc91e-3e4b-49df-be71-2d35c719956a None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:22.342205 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8affc91e-3e4b-49df-be71-2d35c719956a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:22.361971 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e53508-1c52-4a84-9fbc-39ab283ff82c None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:22.364019 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-8affc91e-3e4b-49df-be71-2d35c719956a None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:22.365373 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-8affc91e-3e4b-49df-be71-2d35c719956a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:22.395230 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a3bb0-0b21-4f01-8352-a28cb543f9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:22.395997 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a3bb0-0b21-4f01-8352-a28cb543f9e9 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:22.396272 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a3bb0-0b21-4f01-8352-a28cb543f9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:22.396544 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a3bb0-0b21-4f01-8352-a28cb543f9e9 None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:22.397276 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a3bb0-0b21-4f01-8352-a28cb543f9e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:22.397574 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a3bb0-0b21-4f01-8352-a28cb543f9e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:22.399057 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a3bb0-0b21-4f01-8352-a28cb543f9e9 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:22.407773 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 311/627] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 02:51:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:22.408670 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a3bb0-0b21-4f01-8352-a28cb543f9e9 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:22.433820 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 317/628] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:51:22.434651 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8affc91e-3e4b-49df-be71-2d35c719956a None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:22.535208 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8affc91e-3e4b-49df-be71-2d35c719956a None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:22.539074 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a3bb0-0b21-4f01-8352-a28cb543f9e9 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:22.568772 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab8b95-6fb8-4a74-bf1e-0900f2e86999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:22.569568 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab8b95-6fb8-4a74-bf1e-0900f2e86999 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:22.569839 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab8b95-6fb8-4a74-bf1e-0900f2e86999 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:22.570100 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab8b95-6fb8-4a74-bf1e-0900f2e86999 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:22.571781 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b009710-0bb0-4c55-89d2-fc57db5664cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:22.572576 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b009710-0bb0-4c55-89d2-fc57db5664cd None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:22.572849 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b009710-0bb0-4c55-89d2-fc57db5664cd None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:22.573241 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b009710-0bb0-4c55-89d2-fc57db5664cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:22.581077 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab8b95-6fb8-4a74-bf1e-0900f2e86999 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:22.582517 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab8b95-6fb8-4a74-bf1e-0900f2e86999 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:22.583680 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b009710-0bb0-4c55-89d2-fc57db5664cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:51:22.590676 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-5b009710-0bb0-4c55-89d2-fc57db5664cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 02:51:22.592225 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 312/629] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 02:51:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:22.593003 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b009710-0bb0-4c55-89d2-fc57db5664cd None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:22.603944 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-81ab8b95-6fb8-4a74-bf1e-0900f2e86999 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:22.606298 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 318/630] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:22.606948 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab8b95-6fb8-4a74-bf1e-0900f2e86999 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:22.704068 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b009710-0bb0-4c55-89d2-fc57db5664cd None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:22.705695 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab8b95-6fb8-4a74-bf1e-0900f2e86999 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:22.738583 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425cd63-cd9e-4e88-a691-144e0b4c4208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:22.739594 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec3101-33d1-40e1-b6e8-da79246498a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:22.739915 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425cd63-cd9e-4e88-a691-144e0b4c4208 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:22.740345 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425cd63-cd9e-4e88-a691-144e0b4c4208 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:22.740454 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec3101-33d1-40e1-b6e8-da79246498a1 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:22.740725 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec3101-33d1-40e1-b6e8-da79246498a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:22.740998 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec3101-33d1-40e1-b6e8-da79246498a1 None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:22.741100 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425cd63-cd9e-4e88-a691-144e0b4c4208 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:22.741749 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec3101-33d1-40e1-b6e8-da79246498a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:22.742051 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec3101-33d1-40e1-b6e8-da79246498a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:22.743412 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec3101-33d1-40e1-b6e8-da79246498a1 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:22.752575 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 319/631] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 02:51:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:22.752981 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3425cd63-cd9e-4e88-a691-144e0b4c4208 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:51:22.753465 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec3101-33d1-40e1-b6e8-da79246498a1 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:22.760646 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-3425cd63-cd9e-4e88-a691-144e0b4c4208 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 02:51:22.767054 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 313/632] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 02:51:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:22.768104 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425cd63-cd9e-4e88-a691-144e0b4c4208 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:22.852789 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec3101-33d1-40e1-b6e8-da79246498a1 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:22.866335 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425cd63-cd9e-4e88-a691-144e0b4c4208 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:22.885302 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87465abf-fc4a-4322-819d-6f1917db5961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:22.886196 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87465abf-fc4a-4322-819d-6f1917db5961 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:22.886679 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87465abf-fc4a-4322-819d-6f1917db5961 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:22.886981 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87465abf-fc4a-4322-819d-6f1917db5961 None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:22.887705 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87465abf-fc4a-4322-819d-6f1917db5961 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:22.888029 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87465abf-fc4a-4322-819d-6f1917db5961 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:22.889391 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87465abf-fc4a-4322-819d-6f1917db5961 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:22.900338 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79c06e-2fb7-4667-ba41-2716128055e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:22.901425 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79c06e-2fb7-4667-ba41-2716128055e1 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:22.901651 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 320/633] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:22.902033 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79c06e-2fb7-4667-ba41-2716128055e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:22.902494 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79c06e-2fb7-4667-ba41-2716128055e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:22.902707 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87465abf-fc4a-4322-819d-6f1917db5961 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:22.917709 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79c06e-2fb7-4667-ba41-2716128055e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:22.919298 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79c06e-2fb7-4667-ba41-2716128055e1 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:22.935648 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-ea79c06e-2fb7-4667-ba41-2716128055e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:22.937085 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 314/634] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:22.938045 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65180b-e50a-40e2-aa39-3f1a6b91177b None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:22.938318 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65180b-e50a-40e2-aa39-3f1a6b91177b None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:22.938581 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65180b-e50a-40e2-aa39-3f1a6b91177b None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:22.940062 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 315/635] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:22.944432 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65180b-e50a-40e2-aa39-3f1a6b91177b None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:23.008196 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87465abf-fc4a-4322-819d-6f1917db5961 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:23.040309 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe6126-0f8f-4983-a3fa-72a2b1cdf1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:23.040971 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe6126-0f8f-4983-a3fa-72a2b1cdf1fd None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:23.041247 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe6126-0f8f-4983-a3fa-72a2b1cdf1fd None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:23.041515 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe6126-0f8f-4983-a3fa-72a2b1cdf1fd None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:23.042436 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe6126-0f8f-4983-a3fa-72a2b1cdf1fd None admin] RBAC: Adding query filter params (name=service) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:23.042856 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe6126-0f8f-4983-a3fa-72a2b1cdf1fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:23.044410 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe6126-0f8f-4983-a3fa-72a2b1cdf1fd None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:23.046822 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65180b-e50a-40e2-aa39-3f1a6b91177b None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:23.052591 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 321/636] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 02:51:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:23.053401 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe6126-0f8f-4983-a3fa-72a2b1cdf1fd None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:23.081498 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80629034-9b89-429a-a4fd-2a46379b4371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:23.082402 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80629034-9b89-429a-a4fd-2a46379b4371 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:23.082673 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80629034-9b89-429a-a4fd-2a46379b4371 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:23.082934 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80629034-9b89-429a-a4fd-2a46379b4371 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:23.090386 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80629034-9b89-429a-a4fd-2a46379b4371 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:23.091850 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80629034-9b89-429a-a4fd-2a46379b4371 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:23.105344 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-80629034-9b89-429a-a4fd-2a46379b4371 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 12 02:51:23.111944 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 316/637] 10.222.0.32 () {56 vars in 1093 bytes} [Tue Apr 12 02:51:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:23.113891 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460348c-c0da-4373-82a4-471931673599 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:23.114172 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460348c-c0da-4373-82a4-471931673599 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:23.114445 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460348c-c0da-4373-82a4-471931673599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:23.132491 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-2460348c-c0da-4373-82a4-471931673599 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:23.134242 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-2460348c-c0da-4373-82a4-471931673599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:23.161013 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe6126-0f8f-4983-a3fa-72a2b1cdf1fd None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:23.197903 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b387c-d89a-4ea0-a70b-0497b539456c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:23.198594 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b387c-d89a-4ea0-a70b-0497b539456c None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:23.198871 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b387c-d89a-4ea0-a70b-0497b539456c None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:23.199140 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b387c-d89a-4ea0-a70b-0497b539456c None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:23.199891 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b387c-d89a-4ea0-a70b-0497b539456c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:23.200193 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b387c-d89a-4ea0-a70b-0497b539456c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:23.201567 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b387c-d89a-4ea0-a70b-0497b539456c None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:23.211923 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 317/638] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:51:23.211923 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460348c-c0da-4373-82a4-471931673599 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:23.227898 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 322/639] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:23.228939 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b387c-d89a-4ea0-a70b-0497b539456c None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:23.304862 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460348c-c0da-4373-82a4-471931673599 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:23.327673 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b387c-d89a-4ea0-a70b-0497b539456c None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:23.338234 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df2787-49ec-42b1-acf4-88f192044051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:23.339132 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df2787-49ec-42b1-acf4-88f192044051 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:23.339411 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df2787-49ec-42b1-acf4-88f192044051 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:23.339679 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df2787-49ec-42b1-acf4-88f192044051 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:23.350202 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df2787-49ec-42b1-acf4-88f192044051 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:23.351663 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df2787-49ec-42b1-acf4-88f192044051 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:23.364258 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fff6cc-7eae-4630-b5d0-747d32cc74e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:23.364927 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fff6cc-7eae-4630-b5d0-747d32cc74e5 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:23.365202 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fff6cc-7eae-4630-b5d0-747d32cc74e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:23.365469 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fff6cc-7eae-4630-b5d0-747d32cc74e5 None admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:23.366302 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fff6cc-7eae-4630-b5d0-747d32cc74e5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:23.366607 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fff6cc-7eae-4630-b5d0-747d32cc74e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:23.368040 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fff6cc-7eae-4630-b5d0-747d32cc74e5 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:23.368197 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-b8df2787-49ec-42b1-acf4-88f192044051 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:23.374276 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 318/640] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:23.374276 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df2787-49ec-42b1-acf4-88f192044051 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:23.395182 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 323/641] 10.222.0.32 () {56 vars in 1133 bytes} [Tue Apr 12 02:51:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:23.395182 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fff6cc-7eae-4630-b5d0-747d32cc74e5 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:23.469294 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df2787-49ec-42b1-acf4-88f192044051 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:23.486193 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fff6cc-7eae-4630-b5d0-747d32cc74e5 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:23.501208 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11084df-a632-4027-a7d9-69e5ef246bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:23.502007 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11084df-a632-4027-a7d9-69e5ef246bb2 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:23.502285 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11084df-a632-4027-a7d9-69e5ef246bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:23.502558 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11084df-a632-4027-a7d9-69e5ef246bb2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:23.509860 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11084df-a632-4027-a7d9-69e5ef246bb2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:23.511673 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11084df-a632-4027-a7d9-69e5ef246bb2 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:23.520320 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0784ba-3d57-481c-ad85-d466b9b1a852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:23.521121 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0784ba-3d57-481c-ad85-d466b9b1a852 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:23.521393 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0784ba-3d57-481c-ad85-d466b9b1a852 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:23.521657 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0784ba-3d57-481c-ad85-d466b9b1a852 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:23.525598 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-b11084df-a632-4027-a7d9-69e5ef246bb2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 12 02:51:23.531949 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 319/642] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:51:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:23.531949 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11084df-a632-4027-a7d9-69e5ef246bb2 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:23.537084 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0784ba-3d57-481c-ad85-d466b9b1a852 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:51:23.544613 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-3b0784ba-3d57-481c-ad85-d466b9b1a852 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 02:51:23.545849 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 324/643] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 02:51:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:23.546624 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0784ba-3d57-481c-ad85-d466b9b1a852 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:23.636392 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11084df-a632-4027-a7d9-69e5ef246bb2 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:23.647439 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0784ba-3d57-481c-ad85-d466b9b1a852 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:23.668609 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9ff57-ec93-4b06-ba31-2d06a0221702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:23.669265 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9ff57-ec93-4b06-ba31-2d06a0221702 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:23.669540 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9ff57-ec93-4b06-ba31-2d06a0221702 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:23.669806 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9ff57-ec93-4b06-ba31-2d06a0221702 None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:23.670508 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9ff57-ec93-4b06-ba31-2d06a0221702 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:23.670803 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9ff57-ec93-4b06-ba31-2d06a0221702 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:23.672304 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9ff57-ec93-4b06-ba31-2d06a0221702 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:23.680094 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591cd1cf-9385-48f8-a4eb-148fde609ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:23.680904 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cd1cf-9385-48f8-a4eb-148fde609ae2 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:23.681024 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cd1cf-9385-48f8-a4eb-148fde609ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:23.681242 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cd1cf-9385-48f8-a4eb-148fde609ae2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:23.688616 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 320/644] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:23.688616 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9ff57-ec93-4b06-ba31-2d06a0221702 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:23.751831 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591cd1cf-9385-48f8-a4eb-148fde609ae2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:23.753438 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591cd1cf-9385-48f8-a4eb-148fde609ae2 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:23.783928 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9ff57-ec93-4b06-ba31-2d06a0221702 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:23.816186 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc069f9-9d38-4bdc-bedd-2e3c97bd2326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:23.816928 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc069f9-9d38-4bdc-bedd-2e3c97bd2326 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:23.817202 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc069f9-9d38-4bdc-bedd-2e3c97bd2326 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:23.817470 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc069f9-9d38-4bdc-bedd-2e3c97bd2326 None admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:23.818286 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc069f9-9d38-4bdc-bedd-2e3c97bd2326 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:23.818587 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc069f9-9d38-4bdc-bedd-2e3c97bd2326 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:23.820050 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc069f9-9d38-4bdc-bedd-2e3c97bd2326 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:23.844390 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 321/645] 10.222.0.32 () {56 vars in 1137 bytes} [Tue Apr 12 02:51:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:23.844390 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc069f9-9d38-4bdc-bedd-2e3c97bd2326 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:23.854818 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 325/646] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:51:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:51:23.855714 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591cd1cf-9385-48f8-a4eb-148fde609ae2 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:23.942878 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc069f9-9d38-4bdc-bedd-2e3c97bd2326 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:23.948854 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591cd1cf-9385-48f8-a4eb-148fde609ae2 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:23.978293 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef33bba-2c24-4bb5-9853-d756a9621429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:23.979389 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef33bba-2c24-4bb5-9853-d756a9621429 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:23.979738 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef33bba-2c24-4bb5-9853-d756a9621429 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:23.980043 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef33bba-2c24-4bb5-9853-d756a9621429 None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:23.980791 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef33bba-2c24-4bb5-9853-d756a9621429 None admin] RBAC: Adding query filter params (name=service) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:23.981095 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef33bba-2c24-4bb5-9853-d756a9621429 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:23.982488 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef33bba-2c24-4bb5-9853-d756a9621429 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:23.986585 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9977abf-d9d1-499b-a5a0-5be73954a068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:23.987381 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9977abf-d9d1-499b-a5a0-5be73954a068 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:23.987651 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9977abf-d9d1-499b-a5a0-5be73954a068 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:23.987940 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9977abf-d9d1-499b-a5a0-5be73954a068 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:23.995136 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9977abf-d9d1-499b-a5a0-5be73954a068 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:23.995878 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 322/647] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 02:51:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:23.997031 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef33bba-2c24-4bb5-9853-d756a9621429 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:23.997164 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9977abf-d9d1-499b-a5a0-5be73954a068 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:24.010749 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-f9977abf-d9d1-499b-a5a0-5be73954a068 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 12 02:51:24.016457 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 326/648] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:51:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:24.016457 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9977abf-d9d1-499b-a5a0-5be73954a068 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:24.099358 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef33bba-2c24-4bb5-9853-d756a9621429 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:24.115351 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9977abf-d9d1-499b-a5a0-5be73954a068 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:24.141115 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b02497-fdeb-42bd-9711-e89ba3a383bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:24.141777 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b02497-fdeb-42bd-9711-e89ba3a383bd None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:24.142048 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b02497-fdeb-42bd-9711-e89ba3a383bd None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:24.142313 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b02497-fdeb-42bd-9711-e89ba3a383bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:24.147741 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899dfeee-e27e-4550-9b6b-133de323485d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:24.148525 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899dfeee-e27e-4550-9b6b-133de323485d None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:24.148799 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899dfeee-e27e-4550-9b6b-133de323485d None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:24.149057 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899dfeee-e27e-4550-9b6b-133de323485d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:24.159537 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899dfeee-e27e-4550-9b6b-133de323485d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:24.161002 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899dfeee-e27e-4550-9b6b-133de323485d None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:24.177295 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-899dfeee-e27e-4550-9b6b-133de323485d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:24.183281 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 327/649] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:24.183281 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899dfeee-e27e-4550-9b6b-133de323485d None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:24.210083 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b02497-fdeb-42bd-9711-e89ba3a383bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:24.211553 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b02497-fdeb-42bd-9711-e89ba3a383bd None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:24.279059 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899dfeee-e27e-4550-9b6b-133de323485d None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:24.306455 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 323/650] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:51:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:51:24.307320 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b02497-fdeb-42bd-9711-e89ba3a383bd None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:24.316817 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643a91a-1504-4ee8-99cc-6bbb94caa15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:24.317798 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643a91a-1504-4ee8-99cc-6bbb94caa15b None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:24.318217 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643a91a-1504-4ee8-99cc-6bbb94caa15b None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:24.318478 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643a91a-1504-4ee8-99cc-6bbb94caa15b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:24.328663 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9643a91a-1504-4ee8-99cc-6bbb94caa15b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:24.330191 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9643a91a-1504-4ee8-99cc-6bbb94caa15b None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:24.348635 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-9643a91a-1504-4ee8-99cc-6bbb94caa15b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:24.349847 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 328/651] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:24.350681 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643a91a-1504-4ee8-99cc-6bbb94caa15b None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:24.401497 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b02497-fdeb-42bd-9711-e89ba3a383bd None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:24.438765 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a928b-1a8b-41e6-8fd5-42f15f0af1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:24.439438 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a928b-1a8b-41e6-8fd5-42f15f0af1c4 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:24.439758 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a928b-1a8b-41e6-8fd5-42f15f0af1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:24.440034 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a928b-1a8b-41e6-8fd5-42f15f0af1c4 None admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:24.440857 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a928b-1a8b-41e6-8fd5-42f15f0af1c4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:24.441157 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a928b-1a8b-41e6-8fd5-42f15f0af1c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:24.442577 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a928b-1a8b-41e6-8fd5-42f15f0af1c4 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:24.443698 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643a91a-1504-4ee8-99cc-6bbb94caa15b None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:24.460953 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 324/652] 10.222.0.32 () {56 vars in 1137 bytes} [Tue Apr 12 02:51:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:24.461767 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a928b-1a8b-41e6-8fd5-42f15f0af1c4 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:24.480868 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ef4b2-5e36-443f-914c-bf2879a0ce49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:24.481544 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ef4b2-5e36-443f-914c-bf2879a0ce49 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:24.481814 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ef4b2-5e36-443f-914c-bf2879a0ce49 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:24.482071 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ef4b2-5e36-443f-914c-bf2879a0ce49 None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:24.482767 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ef4b2-5e36-443f-914c-bf2879a0ce49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:24.483062 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ef4b2-5e36-443f-914c-bf2879a0ce49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:24.484431 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ef4b2-5e36-443f-914c-bf2879a0ce49 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:24.495497 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 329/653] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:24.496799 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe862c-1237-4b46-b673-3bcdcf87c08a None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:24.497086 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe862c-1237-4b46-b673-3bcdcf87c08a None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:24.497402 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe862c-1237-4b46-b673-3bcdcf87c08a None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:24.498595 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 330/654] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:24.499289 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe862c-1237-4b46-b673-3bcdcf87c08a None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:24.568039 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a928b-1a8b-41e6-8fd5-42f15f0af1c4 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:24.593906 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe862c-1237-4b46-b673-3bcdcf87c08a None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:24.601215 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe97bb-7a71-4615-8912-7259f7fc4770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:24.601987 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe97bb-7a71-4615-8912-7259f7fc4770 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:24.602254 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe97bb-7a71-4615-8912-7259f7fc4770 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:24.602506 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe97bb-7a71-4615-8912-7259f7fc4770 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:24.612676 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe97bb-7a71-4615-8912-7259f7fc4770 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:24.614111 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe97bb-7a71-4615-8912-7259f7fc4770 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:24.625576 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8b12d-5759-4eed-ab1d-04f8fb0f22a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:24.626224 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8b12d-5759-4eed-ab1d-04f8fb0f22a4 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:24.626499 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8b12d-5759-4eed-ab1d-04f8fb0f22a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:24.626759 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8b12d-5759-4eed-ab1d-04f8fb0f22a4 None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:24.627467 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8b12d-5759-4eed-ab1d-04f8fb0f22a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:24.627770 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8b12d-5759-4eed-ab1d-04f8fb0f22a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:24.629113 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8b12d-5759-4eed-ab1d-04f8fb0f22a4 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:24.630454 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-7dfe97bb-7a71-4615-8912-7259f7fc4770 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:24.631621 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 325/655] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:24.632401 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe97bb-7a71-4615-8912-7259f7fc4770 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:24.640156 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 331/656] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:24.640992 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8b12d-5759-4eed-ab1d-04f8fb0f22a4 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:24.728008 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe97bb-7a71-4615-8912-7259f7fc4770 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:24.735764 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8b12d-5759-4eed-ab1d-04f8fb0f22a4 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:24.764313 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68efd09e-9654-4258-9d06-f0a4c76121db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:24.764949 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efd09e-9654-4258-9d06-f0a4c76121db None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:24.765219 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efd09e-9654-4258-9d06-f0a4c76121db None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:24.765479 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efd09e-9654-4258-9d06-f0a4c76121db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:24.769429 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b2803-84d0-4ed1-bf8d-4781fc572aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:24.770214 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b2803-84d0-4ed1-bf8d-4781fc572aa7 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:24.770483 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b2803-84d0-4ed1-bf8d-4781fc572aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:24.770744 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b2803-84d0-4ed1-bf8d-4781fc572aa7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:24.778561 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b2803-84d0-4ed1-bf8d-4781fc572aa7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:24.780038 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b2803-84d0-4ed1-bf8d-4781fc572aa7 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:24.793706 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-088b2803-84d0-4ed1-bf8d-4781fc572aa7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:51:24.794903 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 332/657] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:51:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:24.796089 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f71dd-fef8-4512-8dee-b3a62e82abcc None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:24.796370 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f71dd-fef8-4512-8dee-b3a62e82abcc None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:24.796635 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f71dd-fef8-4512-8dee-b3a62e82abcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:24.812938 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-a20f71dd-fef8-4512-8dee-b3a62e82abcc None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:24.814111 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-a20f71dd-fef8-4512-8dee-b3a62e82abcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:24.829240 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68efd09e-9654-4258-9d06-f0a4c76121db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:24.830674 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68efd09e-9654-4258-9d06-f0a4c76121db None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:24.879148 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 333/658] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:51:24.879994 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f71dd-fef8-4512-8dee-b3a62e82abcc None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:24.923970 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 326/659] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:51:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:51:24.924866 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68efd09e-9654-4258-9d06-f0a4c76121db None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:24.973231 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f71dd-fef8-4512-8dee-b3a62e82abcc None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:25.006476 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315dfc7-e456-4ea0-a59b-acad5098d283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:25.007050 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315dfc7-e456-4ea0-a59b-acad5098d283 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:25.007313 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315dfc7-e456-4ea0-a59b-acad5098d283 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:25.007599 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315dfc7-e456-4ea0-a59b-acad5098d283 None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:25.008334 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315dfc7-e456-4ea0-a59b-acad5098d283 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:25.008624 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315dfc7-e456-4ea0-a59b-acad5098d283 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:25.009947 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315dfc7-e456-4ea0-a59b-acad5098d283 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:25.018270 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68efd09e-9654-4258-9d06-f0a4c76121db None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:25.020611 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 334/660] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:25.021376 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315dfc7-e456-4ea0-a59b-acad5098d283 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:25.050772 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a8984-12e4-4432-9f62-a4c9027d0435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:25.051566 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a8984-12e4-4432-9f62-a4c9027d0435 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:25.051867 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a8984-12e4-4432-9f62-a4c9027d0435 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:25.052133 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a8984-12e4-4432-9f62-a4c9027d0435 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:25.059368 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a8984-12e4-4432-9f62-a4c9027d0435 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:25.060850 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a8984-12e4-4432-9f62-a4c9027d0435 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:25.074651 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-b40a8984-12e4-4432-9f62-a4c9027d0435 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 12 02:51:25.075851 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 327/661] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 02:51:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:25.076612 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a8984-12e4-4432-9f62-a4c9027d0435 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:25.124640 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315dfc7-e456-4ea0-a59b-acad5098d283 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:25.156602 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d0ca2-ffdc-4cbd-bf4c-776b3c73ec44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:25.157240 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d0ca2-ffdc-4cbd-bf4c-776b3c73ec44 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:25.157511 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d0ca2-ffdc-4cbd-bf4c-776b3c73ec44 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:25.157776 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d0ca2-ffdc-4cbd-bf4c-776b3c73ec44 None admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:25.158541 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d0ca2-ffdc-4cbd-bf4c-776b3c73ec44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:25.158835 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d0ca2-ffdc-4cbd-bf4c-776b3c73ec44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:25.160281 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d0ca2-ffdc-4cbd-bf4c-776b3c73ec44 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:25.171841 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 335/662] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 02:51:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:25.172618 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d0ca2-ffdc-4cbd-bf4c-776b3c73ec44 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:25.179397 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a8984-12e4-4432-9f62-a4c9027d0435 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:25.214935 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015ed5c-34d5-42bc-a546-19d7321136f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:25.215760 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015ed5c-34d5-42bc-a546-19d7321136f4 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:25.216054 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015ed5c-34d5-42bc-a546-19d7321136f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:25.216322 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015ed5c-34d5-42bc-a546-19d7321136f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:25.226327 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e015ed5c-34d5-42bc-a546-19d7321136f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:51:25.233394 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-e015ed5c-34d5-42bc-a546-19d7321136f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 02:51:25.234570 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 328/663] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 02:51:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:25.235331 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015ed5c-34d5-42bc-a546-19d7321136f4 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:25.273676 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d0ca2-ffdc-4cbd-bf4c-776b3c73ec44 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:25.307095 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcebd42-e944-414c-8fc2-d53301cee6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:25.308171 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcebd42-e944-414c-8fc2-d53301cee6de None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:25.308479 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcebd42-e944-414c-8fc2-d53301cee6de None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:25.308734 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcebd42-e944-414c-8fc2-d53301cee6de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:25.318610 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcebd42-e944-414c-8fc2-d53301cee6de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:25.320110 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcebd42-e944-414c-8fc2-d53301cee6de None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:25.331074 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015ed5c-34d5-42bc-a546-19d7321136f4 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:25.337132 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-6bcebd42-e944-414c-8fc2-d53301cee6de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:25.338322 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 336/664] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:25.339404 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcebd42-e944-414c-8fc2-d53301cee6de None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:25.364350 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642694d-63b2-4298-81cf-d2341144b7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:25.365139 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642694d-63b2-4298-81cf-d2341144b7d1 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:25.365414 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642694d-63b2-4298-81cf-d2341144b7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:25.365676 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642694d-63b2-4298-81cf-d2341144b7d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:25.372284 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1642694d-63b2-4298-81cf-d2341144b7d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:25.373730 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1642694d-63b2-4298-81cf-d2341144b7d1 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:25.386860 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-1642694d-63b2-4298-81cf-d2341144b7d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:51:25.388056 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 329/665] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:51:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:25.388803 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642694d-63b2-4298-81cf-d2341144b7d1 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:25.438562 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcebd42-e944-414c-8fc2-d53301cee6de None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:25.471641 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfceb8-0b5f-437f-883d-d1f07db2f956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:25.472331 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfceb8-0b5f-437f-883d-d1f07db2f956 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:25.472607 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfceb8-0b5f-437f-883d-d1f07db2f956 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:25.472873 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfceb8-0b5f-437f-883d-d1f07db2f956 None admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:25.473691 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bfceb8-0b5f-437f-883d-d1f07db2f956 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:25.473991 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bfceb8-0b5f-437f-883d-d1f07db2f956 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:25.475418 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bfceb8-0b5f-437f-883d-d1f07db2f956 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:25.480688 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642694d-63b2-4298-81cf-d2341144b7d1 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:25.492305 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 337/666] 10.222.0.32 () {56 vars in 1139 bytes} [Tue Apr 12 02:51:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:25.493078 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfceb8-0b5f-437f-883d-d1f07db2f956 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:25.514068 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9fc4b-e435-4da0-ae37-ab56fde8eb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:25.514697 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9fc4b-e435-4da0-ae37-ab56fde8eb7f None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:25.514970 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9fc4b-e435-4da0-ae37-ab56fde8eb7f None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:25.515231 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9fc4b-e435-4da0-ae37-ab56fde8eb7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:25.516067 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9fc4b-e435-4da0-ae37-ab56fde8eb7f None admin] RBAC: Adding query filter params (role.id=a8b79923b07243e385187b6641381ee1, scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed, user.id=43ee5cb310fd4538910e40ea7082708c) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:25.516382 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9fc4b-e435-4da0-ae37-ab56fde8eb7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:25.517805 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9fc4b-e435-4da0-ae37-ab56fde8eb7f None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:25.523635 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 330/667] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:51:25 2022] GET /identity/v3/role_assignments?user.id=43ee5cb310fd4538910e40ea7082708c&scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed&role.id=a8b79923b07243e385187b6641381ee1 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:25.524497 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9fc4b-e435-4da0-ae37-ab56fde8eb7f None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:25.599002 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfceb8-0b5f-437f-883d-d1f07db2f956 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:25.638679 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a4d45-dacf-4b21-a05f-fdb62189e29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:25.639354 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a4d45-dacf-4b21-a05f-fdb62189e29f None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:25.639630 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a4d45-dacf-4b21-a05f-fdb62189e29f None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:25.640001 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a4d45-dacf-4b21-a05f-fdb62189e29f None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:25.640817 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a4d45-dacf-4b21-a05f-fdb62189e29f None admin] RBAC: Adding query filter params (name=service) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:25.640988 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a4d45-dacf-4b21-a05f-fdb62189e29f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:25.642335 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a4d45-dacf-4b21-a05f-fdb62189e29f None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:25.643357 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9fc4b-e435-4da0-ae37-ab56fde8eb7f None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:25.650755 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 338/668] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 02:51:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:25.651674 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a4d45-dacf-4b21-a05f-fdb62189e29f None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:25.679301 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dda266-6b2b-47b5-b1a3-8a1d4a927024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:25.680183 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dda266-6b2b-47b5-b1a3-8a1d4a927024 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:25.680554 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dda266-6b2b-47b5-b1a3-8a1d4a927024 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:25.680920 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dda266-6b2b-47b5-b1a3-8a1d4a927024 None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:25.681737 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dda266-6b2b-47b5-b1a3-8a1d4a927024 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:25.682135 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dda266-6b2b-47b5-b1a3-8a1d4a927024 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:25.683737 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dda266-6b2b-47b5-b1a3-8a1d4a927024 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:25.697133 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 331/669] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:25.698055 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dda266-6b2b-47b5-b1a3-8a1d4a927024 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:25.770212 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a4d45-dacf-4b21-a05f-fdb62189e29f None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:25.805027 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c39ff-e251-44bc-b0e3-719d44588995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:25.805908 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c39ff-e251-44bc-b0e3-719d44588995 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:25.806280 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dda266-6b2b-47b5-b1a3-8a1d4a927024 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:25.806507 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c39ff-e251-44bc-b0e3-719d44588995 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:25.806910 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c39ff-e251-44bc-b0e3-719d44588995 None admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:25.807894 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c39ff-e251-44bc-b0e3-719d44588995 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:25.808332 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c39ff-e251-44bc-b0e3-719d44588995 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:25.809895 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c39ff-e251-44bc-b0e3-719d44588995 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:25.823141 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 339/670] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 02:51:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:25.824132 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c39ff-e251-44bc-b0e3-719d44588995 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:25.840335 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b2a8f-e520-43fa-a8c0-4918531bb4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:25.840983 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b2a8f-e520-43fa-a8c0-4918531bb4a2 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:25.841260 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b2a8f-e520-43fa-a8c0-4918531bb4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:25.841529 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b2a8f-e520-43fa-a8c0-4918531bb4a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:25.908456 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b2a8f-e520-43fa-a8c0-4918531bb4a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:25.910028 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b2a8f-e520-43fa-a8c0-4918531bb4a2 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:25.924724 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c39ff-e251-44bc-b0e3-719d44588995 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:25.960456 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb3b6a-1ece-4b3d-8c73-4f2468ff0444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:25.961333 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb3b6a-1ece-4b3d-8c73-4f2468ff0444 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:25.961668 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb3b6a-1ece-4b3d-8c73-4f2468ff0444 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:25.961992 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb3b6a-1ece-4b3d-8c73-4f2468ff0444 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:25.971662 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb3b6a-1ece-4b3d-8c73-4f2468ff0444 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:25.973205 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb3b6a-1ece-4b3d-8c73-4f2468ff0444 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:25.989493 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-babb3b6a-1ece-4b3d-8c73-4f2468ff0444 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:25.995262 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 340/671] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:25.995262 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb3b6a-1ece-4b3d-8c73-4f2468ff0444 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:26.008930 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 332/672] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:51:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:51:26.008930 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b2a8f-e520-43fa-a8c0-4918531bb4a2 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:26.097056 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb3b6a-1ece-4b3d-8c73-4f2468ff0444 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:26.102386 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b2a8f-e520-43fa-a8c0-4918531bb4a2 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:26.128577 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803edf59-6642-4b07-8ec7-f4e37e34f0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:26.129367 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803edf59-6642-4b07-8ec7-f4e37e34f0af None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:26.129635 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803edf59-6642-4b07-8ec7-f4e37e34f0af None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:26.129899 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803edf59-6642-4b07-8ec7-f4e37e34f0af None admin] PATH_INFO: `/v3/projects/service` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:26.134961 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42bdf28-a2d5-443c-a2f9-e761d08a4e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:26.135841 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42bdf28-a2d5-443c-a2f9-e761d08a4e61 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:26.136285 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42bdf28-a2d5-443c-a2f9-e761d08a4e61 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:26.136405 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803edf59-6642-4b07-8ec7-f4e37e34f0af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:26.136840 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42bdf28-a2d5-443c-a2f9-e761d08a4e61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:26.137707 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803edf59-6642-4b07-8ec7-f4e37e34f0af None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:26.138172 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42bdf28-a2d5-443c-a2f9-e761d08a4e61 None admin] RBAC: Adding query filter params (role.id=a8b79923b07243e385187b6641381ee1, scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed, user.id=44248c51c2cb497b85a68dce0496a225) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:26.138701 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42bdf28-a2d5-443c-a2f9-e761d08a4e61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:26.140362 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42bdf28-a2d5-443c-a2f9-e761d08a4e61 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:26.146370 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 333/673] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:51:26 2022] GET /identity/v3/role_assignments?user.id=44248c51c2cb497b85a68dce0496a225&scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed&role.id=a8b79923b07243e385187b6641381ee1 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:26.146970 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42bdf28-a2d5-443c-a2f9-e761d08a4e61 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:26.157615 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-803edf59-6642-4b07-8ec7-f4e37e34f0af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:51:26.160006 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 341/674] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:51:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:26.161321 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803edf59-6642-4b07-8ec7-f4e37e34f0af None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:26.251922 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42bdf28-a2d5-443c-a2f9-e761d08a4e61 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:26.275079 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803edf59-6642-4b07-8ec7-f4e37e34f0af None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:26.287160 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598848e6-18fd-43ca-a2d7-19e472791f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:26.287857 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598848e6-18fd-43ca-a2d7-19e472791f86 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:26.288127 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598848e6-18fd-43ca-a2d7-19e472791f86 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:26.288390 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598848e6-18fd-43ca-a2d7-19e472791f86 None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:26.289157 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598848e6-18fd-43ca-a2d7-19e472791f86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:26.289403 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598848e6-18fd-43ca-a2d7-19e472791f86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:26.290803 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598848e6-18fd-43ca-a2d7-19e472791f86 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:26.304396 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 334/675] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:26.305174 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598848e6-18fd-43ca-a2d7-19e472791f86 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:26.313264 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c6184-0469-4241-b15d-4a3a66fbf762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:26.314345 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c6184-0469-4241-b15d-4a3a66fbf762 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:26.314797 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c6184-0469-4241-b15d-4a3a66fbf762 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:26.315265 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c6184-0469-4241-b15d-4a3a66fbf762 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:26.326456 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c6184-0469-4241-b15d-4a3a66fbf762 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:26.328579 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c6184-0469-4241-b15d-4a3a66fbf762 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:26.347798 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-fa7c6184-0469-4241-b15d-4a3a66fbf762 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:26.349616 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 342/676] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:26.350622 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c6184-0469-4241-b15d-4a3a66fbf762 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:26.413425 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598848e6-18fd-43ca-a2d7-19e472791f86 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:26.456269 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48621ca8-a102-4014-ae5f-a0ce4b0e3e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:26.457291 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48621ca8-a102-4014-ae5f-a0ce4b0e3e83 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:26.457570 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48621ca8-a102-4014-ae5f-a0ce4b0e3e83 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:26.457833 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48621ca8-a102-4014-ae5f-a0ce4b0e3e83 None admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:26.458859 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48621ca8-a102-4014-ae5f-a0ce4b0e3e83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:26.459161 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48621ca8-a102-4014-ae5f-a0ce4b0e3e83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:26.461056 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48621ca8-a102-4014-ae5f-a0ce4b0e3e83 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:26.475693 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c6184-0469-4241-b15d-4a3a66fbf762 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:26.476082 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 335/677] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 02:51:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:26.476979 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48621ca8-a102-4014-ae5f-a0ce4b0e3e83 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:26.518091 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34fb5c8-d757-483c-9981-5a6217837290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:26.518894 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fb5c8-d757-483c-9981-5a6217837290 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:26.519166 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fb5c8-d757-483c-9981-5a6217837290 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:26.519428 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fb5c8-d757-483c-9981-5a6217837290 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:26.531600 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34fb5c8-d757-483c-9981-5a6217837290 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:26.533055 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34fb5c8-d757-483c-9981-5a6217837290 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:26.546934 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-e34fb5c8-d757-483c-9981-5a6217837290 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 12 02:51:26.548472 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 343/678] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 02:51:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:26.549300 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34fb5c8-d757-483c-9981-5a6217837290 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:26.588227 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48621ca8-a102-4014-ae5f-a0ce4b0e3e83 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:26.627497 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ca9b1-b786-452d-94bb-ff5cdbb1aa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:26.628226 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ca9b1-b786-452d-94bb-ff5cdbb1aa09 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:26.628486 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ca9b1-b786-452d-94bb-ff5cdbb1aa09 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:26.628753 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ca9b1-b786-452d-94bb-ff5cdbb1aa09 None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:26.629466 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ca9b1-b786-452d-94bb-ff5cdbb1aa09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:26.629768 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ca9b1-b786-452d-94bb-ff5cdbb1aa09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:26.631150 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ca9b1-b786-452d-94bb-ff5cdbb1aa09 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:26.643043 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 336/679] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:26.644018 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ca9b1-b786-452d-94bb-ff5cdbb1aa09 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:26.651652 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34fb5c8-d757-483c-9981-5a6217837290 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:26.685765 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399ccb5-cff5-4e62-af83-109f9a614f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:26.687074 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399ccb5-cff5-4e62-af83-109f9a614f89 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:26.687685 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399ccb5-cff5-4e62-af83-109f9a614f89 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:26.688296 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399ccb5-cff5-4e62-af83-109f9a614f89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:26.689608 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399ccb5-cff5-4e62-af83-109f9a614f89 None admin] RBAC: Adding query filter params (role.id=a8b79923b07243e385187b6641381ee1, scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed, user.id=828a6cffa8af470388d4b063c3c49849) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:26.690117 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399ccb5-cff5-4e62-af83-109f9a614f89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:26.691708 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399ccb5-cff5-4e62-af83-109f9a614f89 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:26.699180 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 344/680] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:51:26 2022] GET /identity/v3/role_assignments?user.id=828a6cffa8af470388d4b063c3c49849&scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed&role.id=a8b79923b07243e385187b6641381ee1 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:26.700359 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399ccb5-cff5-4e62-af83-109f9a614f89 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:26.751712 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ca9b1-b786-452d-94bb-ff5cdbb1aa09 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:26.787413 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4fe62-b0c8-4123-94bc-6ff45a53c208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:26.788121 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4fe62-b0c8-4123-94bc-6ff45a53c208 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:26.788383 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4fe62-b0c8-4123-94bc-6ff45a53c208 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:26.788651 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4fe62-b0c8-4123-94bc-6ff45a53c208 None admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:26.789554 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4fe62-b0c8-4123-94bc-6ff45a53c208 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:26.789774 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4fe62-b0c8-4123-94bc-6ff45a53c208 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:26.791218 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4fe62-b0c8-4123-94bc-6ff45a53c208 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:26.808072 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399ccb5-cff5-4e62-af83-109f9a614f89 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:26.809590 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 337/681] 10.222.0.32 () {56 vars in 1135 bytes} [Tue Apr 12 02:51:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:26.817524 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4fe62-b0c8-4123-94bc-6ff45a53c208 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:26.844404 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a6c46-d205-407e-a829-e6f1adfaa5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:26.845823 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a6c46-d205-407e-a829-e6f1adfaa5a2 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:26.846266 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a6c46-d205-407e-a829-e6f1adfaa5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:26.846733 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a6c46-d205-407e-a829-e6f1adfaa5a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:26.854918 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a6c46-d205-407e-a829-e6f1adfaa5a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:26.856803 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a6c46-d205-407e-a829-e6f1adfaa5a2 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:26.872475 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-b79a6c46-d205-407e-a829-e6f1adfaa5a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:51:26.874846 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 345/682] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:51:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:26.880310 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a6c46-d205-407e-a829-e6f1adfaa5a2 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:26.980176 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a6c46-d205-407e-a829-e6f1adfaa5a2 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:27.007772 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4fe62-b0c8-4123-94bc-6ff45a53c208 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:27.015087 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f686f-aeaf-44d2-b196-4b852f1f4340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:27.016102 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f686f-aeaf-44d2-b196-4b852f1f4340 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:27.016629 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f686f-aeaf-44d2-b196-4b852f1f4340 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:27.017097 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f686f-aeaf-44d2-b196-4b852f1f4340 None admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:27.018127 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f686f-aeaf-44d2-b196-4b852f1f4340 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:27.018642 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f686f-aeaf-44d2-b196-4b852f1f4340 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:27.020296 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f686f-aeaf-44d2-b196-4b852f1f4340 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:27.033389 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 346/683] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 02:51:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:51:27.039222 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f686f-aeaf-44d2-b196-4b852f1f4340 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:27.072170 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47474b14-fbb2-47a8-a958-025906541ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:27.073438 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47474b14-fbb2-47a8-a958-025906541ac6 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:27.074031 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47474b14-fbb2-47a8-a958-025906541ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:27.074485 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47474b14-fbb2-47a8-a958-025906541ac6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:27.142890 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47474b14-fbb2-47a8-a958-025906541ac6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:27.144691 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47474b14-fbb2-47a8-a958-025906541ac6 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:27.182265 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f686f-aeaf-44d2-b196-4b852f1f4340 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:27.216133 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563aa575-2cf1-42ff-b8e1-31186c678005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:27.216820 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563aa575-2cf1-42ff-b8e1-31186c678005 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:27.217092 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563aa575-2cf1-42ff-b8e1-31186c678005 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:27.217358 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563aa575-2cf1-42ff-b8e1-31186c678005 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:27.218180 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563aa575-2cf1-42ff-b8e1-31186c678005 None admin] RBAC: Adding query filter params (role.id=a8b79923b07243e385187b6641381ee1, scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed, user.id=8f516943aec14608b5c9d343418a2677) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:27.218844 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563aa575-2cf1-42ff-b8e1-31186c678005 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:27.219922 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563aa575-2cf1-42ff-b8e1-31186c678005 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:27.226216 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 347/684] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:51:27 2022] GET /identity/v3/role_assignments?user.id=8f516943aec14608b5c9d343418a2677&scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed&role.id=a8b79923b07243e385187b6641381ee1 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:27.250508 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 338/685] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:51:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:51:27.255931 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563aa575-2cf1-42ff-b8e1-31186c678005 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:27.447443 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563aa575-2cf1-42ff-b8e1-31186c678005 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:27.489640 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc935a47-a0ab-47e2-91ae-baa03a3c1205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:27.490679 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc935a47-a0ab-47e2-91ae-baa03a3c1205 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:27.491116 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc935a47-a0ab-47e2-91ae-baa03a3c1205 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:27.491536 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc935a47-a0ab-47e2-91ae-baa03a3c1205 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:27.506727 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc935a47-a0ab-47e2-91ae-baa03a3c1205 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:27.508484 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc935a47-a0ab-47e2-91ae-baa03a3c1205 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:27.530584 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-bc935a47-a0ab-47e2-91ae-baa03a3c1205 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:27.532481 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 348/686] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:27.537644 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47474b14-fbb2-47a8-a958-025906541ac6 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:27.641947 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47474b14-fbb2-47a8-a958-025906541ac6 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:27.678198 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42eb67-bc28-4cfb-a8c5-7fd39283686a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:27.678859 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42eb67-bc28-4cfb-a8c5-7fd39283686a None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:27.679124 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42eb67-bc28-4cfb-a8c5-7fd39283686a None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:27.679388 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42eb67-bc28-4cfb-a8c5-7fd39283686a None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:27.680120 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42eb67-bc28-4cfb-a8c5-7fd39283686a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:27.680416 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42eb67-bc28-4cfb-a8c5-7fd39283686a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:27.681794 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42eb67-bc28-4cfb-a8c5-7fd39283686a None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:27.693531 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 339/687] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:27.700915 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc935a47-a0ab-47e2-91ae-baa03a3c1205 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:27.849954 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc935a47-a0ab-47e2-91ae-baa03a3c1205 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:27.887222 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48b9dc-d310-4c8e-8035-73a721f7a8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:27.888066 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48b9dc-d310-4c8e-8035-73a721f7a8bf None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:27.888339 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48b9dc-d310-4c8e-8035-73a721f7a8bf None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:27.888603 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48b9dc-d310-4c8e-8035-73a721f7a8bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:27.895286 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48b9dc-d310-4c8e-8035-73a721f7a8bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:27.896729 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48b9dc-d310-4c8e-8035-73a721f7a8bf None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:27.912881 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-ac48b9dc-d310-4c8e-8035-73a721f7a8bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:51:27.914273 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 349/688] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:51:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:27.921103 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42eb67-bc28-4cfb-a8c5-7fd39283686a None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:27.984527 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cddae8-b8bd-4d20-9e7c-ee1a0d4125c9 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:27.984796 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cddae8-b8bd-4d20-9e7c-ee1a0d4125c9 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:27.985057 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cddae8-b8bd-4d20-9e7c-ee1a0d4125c9 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:27.986655 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 350/689] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:51:27.991558 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba80bd-8f70-4e3a-8853-337067496d2b None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:27.991871 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba80bd-8f70-4e3a-8853-337067496d2b None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:27.992140 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba80bd-8f70-4e3a-8853-337067496d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:28.009879 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-9eba80bd-8f70-4e3a-8853-337067496d2b None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:28.012223 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-9eba80bd-8f70-4e3a-8853-337067496d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:28.058805 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42eb67-bc28-4cfb-a8c5-7fd39283686a None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:28.117461 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 351/690] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 02:51:28.124588 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092f6f8-e446-481d-a04e-b72852cfc5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:28.125308 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092f6f8-e446-481d-a04e-b72852cfc5ca None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:28.125582 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092f6f8-e446-481d-a04e-b72852cfc5ca None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:28.125843 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092f6f8-e446-481d-a04e-b72852cfc5ca None admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:28.126624 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092f6f8-e446-481d-a04e-b72852cfc5ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:28.126923 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092f6f8-e446-481d-a04e-b72852cfc5ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:28.128387 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092f6f8-e446-481d-a04e-b72852cfc5ca None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:28.141218 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 340/691] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 02:51:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:28.148599 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092f6f8-e446-481d-a04e-b72852cfc5ca None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:28.148839 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba80bd-8f70-4e3a-8853-337067496d2b None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:28.243958 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba80bd-8f70-4e3a-8853-337067496d2b None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:28.271831 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092f6f8-e446-481d-a04e-b72852cfc5ca None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:28.288996 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d00ef-d667-4106-8750-56bf064266f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:28.289656 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d00ef-d667-4106-8750-56bf064266f6 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:28.289923 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d00ef-d667-4106-8750-56bf064266f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:28.290186 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d00ef-d667-4106-8750-56bf064266f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:28.291007 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d00ef-d667-4106-8750-56bf064266f6 None admin] RBAC: Adding query filter params (role.id=a8b79923b07243e385187b6641381ee1, scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed, user.id=8e8d78f92f12405fb746ddeb2579bd2e) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:28.291309 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d00ef-d667-4106-8750-56bf064266f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:28.293122 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d00ef-d667-4106-8750-56bf064266f6 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:28.300025 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 352/692] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:51:28 2022] GET /identity/v3/role_assignments?user.id=8e8d78f92f12405fb746ddeb2579bd2e&scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed&role.id=a8b79923b07243e385187b6641381ee1 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:28.327473 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad12fb7-36f8-4418-b10d-8bb9640d1752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:28.328624 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad12fb7-36f8-4418-b10d-8bb9640d1752 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:28.328890 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad12fb7-36f8-4418-b10d-8bb9640d1752 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:28.329147 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad12fb7-36f8-4418-b10d-8bb9640d1752 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:28.344919 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad12fb7-36f8-4418-b10d-8bb9640d1752 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:51:28.351890 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-6ad12fb7-36f8-4418-b10d-8bb9640d1752 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 02:51:28.353431 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 341/693] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 02:51:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:28.359247 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d00ef-d667-4106-8750-56bf064266f6 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:28.482144 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d00ef-d667-4106-8750-56bf064266f6 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:28.527815 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285b850-ef98-4d25-ad3b-03c8988a9c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:28.528421 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285b850-ef98-4d25-ad3b-03c8988a9c9b None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:28.528692 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285b850-ef98-4d25-ad3b-03c8988a9c9b None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:28.528955 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285b850-ef98-4d25-ad3b-03c8988a9c9b None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:28.529707 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285b850-ef98-4d25-ad3b-03c8988a9c9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:28.530000 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285b850-ef98-4d25-ad3b-03c8988a9c9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:28.531438 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285b850-ef98-4d25-ad3b-03c8988a9c9b None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:28.540800 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 353/694] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:51:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:28.546127 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad12fb7-36f8-4418-b10d-8bb9640d1752 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:28.645967 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad12fb7-36f8-4418-b10d-8bb9640d1752 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:28.679664 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2bd2f-6c67-4983-9c18-c9192b01df26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:28.680526 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2bd2f-6c67-4983-9c18-c9192b01df26 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:28.680796 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2bd2f-6c67-4983-9c18-c9192b01df26 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:28.681057 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2bd2f-6c67-4983-9c18-c9192b01df26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:28.691623 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce2bd2f-6c67-4983-9c18-c9192b01df26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:28.693095 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce2bd2f-6c67-4983-9c18-c9192b01df26 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:28.709723 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-0ce2bd2f-6c67-4983-9c18-c9192b01df26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:28.711245 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 342/695] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:28.717118 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285b850-ef98-4d25-ad3b-03c8988a9c9b None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:28.822933 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285b850-ef98-4d25-ad3b-03c8988a9c9b None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:28.860792 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1bd5f-97ef-4786-a1e1-44cbc1de45f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:28.861461 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1bd5f-97ef-4786-a1e1-44cbc1de45f1 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:28.861725 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1bd5f-97ef-4786-a1e1-44cbc1de45f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:28.861987 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1bd5f-97ef-4786-a1e1-44cbc1de45f1 None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:28.862707 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1bd5f-97ef-4786-a1e1-44cbc1de45f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:28.862998 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1bd5f-97ef-4786-a1e1-44cbc1de45f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:28.864427 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1bd5f-97ef-4786-a1e1-44cbc1de45f1 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:28.878657 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 354/696] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:28.884860 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2bd2f-6c67-4983-9c18-c9192b01df26 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:28.903428 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086440c-6047-40bb-86d3-d6f7486381c2 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:28.903751 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086440c-6047-40bb-86d3-d6f7486381c2 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:28.904011 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086440c-6047-40bb-86d3-d6f7486381c2 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:28.905961 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 355/697] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:51:28.911458 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9e82a-6bc4-49ad-b4a7-e08d81c392c6 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:28.911756 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9e82a-6bc4-49ad-b4a7-e08d81c392c6 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:28.912164 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9e82a-6bc4-49ad-b4a7-e08d81c392c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:28.936351 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-d6d9e82a-6bc4-49ad-b4a7-e08d81c392c6 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:28.937534 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-d6d9e82a-6bc4-49ad-b4a7-e08d81c392c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:29.026169 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2bd2f-6c67-4983-9c18-c9192b01df26 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:29.054490 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 356/698] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:51:29.072422 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e81956-5e9e-43b0-b2da-4718735c1db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:29.073488 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e81956-5e9e-43b0-b2da-4718735c1db1 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:29.073901 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e81956-5e9e-43b0-b2da-4718735c1db1 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:29.074170 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e81956-5e9e-43b0-b2da-4718735c1db1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:29.076019 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9e82a-6bc4-49ad-b4a7-e08d81c392c6 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:29.088272 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e81956-5e9e-43b0-b2da-4718735c1db1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:29.090079 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e81956-5e9e-43b0-b2da-4718735c1db1 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:29.116435 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-c4e81956-5e9e-43b0-b2da-4718735c1db1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 12 02:51:29.119839 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 343/699] 10.222.0.32 () {56 vars in 1093 bytes} [Tue Apr 12 02:51:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:29.123299 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e81956-5e9e-43b0-b2da-4718735c1db1 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:29.251491 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9e82a-6bc4-49ad-b4a7-e08d81c392c6 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:29.285040 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1d38b-7435-46c8-8c5c-918bd4722ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:29.286244 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1d38b-7435-46c8-8c5c-918bd4722ca0 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:29.286717 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1d38b-7435-46c8-8c5c-918bd4722ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:29.287179 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1d38b-7435-46c8-8c5c-918bd4722ca0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:29.287496 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e81956-5e9e-43b0-b2da-4718735c1db1 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:29.288275 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee1d38b-7435-46c8-8c5c-918bd4722ca0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:29.289842 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee1d38b-7435-46c8-8c5c-918bd4722ca0 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:29.303162 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-bee1d38b-7435-46c8-8c5c-918bd4722ca0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 12 02:51:29.305033 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 357/700] 10.222.0.32 () {56 vars in 1129 bytes} [Tue Apr 12 02:51:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:51:29.312280 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1d38b-7435-46c8-8c5c-918bd4722ca0 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:29.354100 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f7838-e010-439e-8b54-e8551cf71528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:29.355161 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f7838-e010-439e-8b54-e8551cf71528 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:29.355656 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f7838-e010-439e-8b54-e8551cf71528 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:29.356142 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f7838-e010-439e-8b54-e8551cf71528 None admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:29.357160 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f7838-e010-439e-8b54-e8551cf71528 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:29.357699 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f7838-e010-439e-8b54-e8551cf71528 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:29.359370 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f7838-e010-439e-8b54-e8551cf71528 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:29.378499 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 344/701] 10.222.0.32 () {56 vars in 1133 bytes} [Tue Apr 12 02:51:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:51:29.385936 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f7838-e010-439e-8b54-e8551cf71528 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:29.493389 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f7838-e010-439e-8b54-e8551cf71528 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:29.501752 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1d38b-7435-46c8-8c5c-918bd4722ca0 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:29.536939 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91adf0-ff68-484a-b8de-cc220d7012f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:29.537978 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91adf0-ff68-484a-b8de-cc220d7012f5 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:29.538446 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91adf0-ff68-484a-b8de-cc220d7012f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:29.538901 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91adf0-ff68-484a-b8de-cc220d7012f5 None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:29.539847 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91adf0-ff68-484a-b8de-cc220d7012f5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:29.540359 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91adf0-ff68-484a-b8de-cc220d7012f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:29.542223 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91adf0-ff68-484a-b8de-cc220d7012f5 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:29.547329 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 358/702] 10.222.0.32 () {56 vars in 1124 bytes} [Tue Apr 12 02:51:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:29.551124 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec40e25-fc29-4396-a532-6ca966b1c588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:29.552925 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91adf0-ff68-484a-b8de-cc220d7012f5 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:29.553921 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec40e25-fc29-4396-a532-6ca966b1c588 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:29.558162 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec40e25-fc29-4396-a532-6ca966b1c588 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:29.559192 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec40e25-fc29-4396-a532-6ca966b1c588 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:29.682594 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec40e25-fc29-4396-a532-6ca966b1c588 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:29.684945 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec40e25-fc29-4396-a532-6ca966b1c588 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:29.711748 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91adf0-ff68-484a-b8de-cc220d7012f5 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:29.762020 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc057a19-237b-4469-9b7d-be0d39c81536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:29.762689 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc057a19-237b-4469-9b7d-be0d39c81536 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:29.762964 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc057a19-237b-4469-9b7d-be0d39c81536 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:29.763230 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc057a19-237b-4469-9b7d-be0d39c81536 None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:29.763955 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc057a19-237b-4469-9b7d-be0d39c81536 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:29.764256 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc057a19-237b-4469-9b7d-be0d39c81536 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:29.765615 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc057a19-237b-4469-9b7d-be0d39c81536 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:29.771591 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 359/703] 10.222.0.32 () {56 vars in 1124 bytes} [Tue Apr 12 02:51:29 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:51:29.866031 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 345/704] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:51:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:51:29.871885 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc057a19-237b-4469-9b7d-be0d39c81536 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:29.886650 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e9d60-cfe3-48b8-afd9-3a8af44a2b79 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:29.886978 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e9d60-cfe3-48b8-afd9-3a8af44a2b79 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:29.887186 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e9d60-cfe3-48b8-afd9-3a8af44a2b79 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:29.888853 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 346/705] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:29.894261 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f1569-f4f9-4ccf-a3b5-1697a212593a None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:29.894545 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f1569-f4f9-4ccf-a3b5-1697a212593a None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:29.894805 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f1569-f4f9-4ccf-a3b5-1697a212593a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:29.937995 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-7c0f1569-f4f9-4ccf-a3b5-1697a212593a None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:29.939196 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-7c0f1569-f4f9-4ccf-a3b5-1697a212593a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:29.984355 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc057a19-237b-4469-9b7d-be0d39c81536 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:30.017342 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9594dab-61b6-4c15-9007-3a8b00ca10d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:30.018140 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9594dab-61b6-4c15-9007-3a8b00ca10d5 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:30.018410 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9594dab-61b6-4c15-9007-3a8b00ca10d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:30.018679 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9594dab-61b6-4c15-9007-3a8b00ca10d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:30.029658 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9594dab-61b6-4c15-9007-3a8b00ca10d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:30.031100 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9594dab-61b6-4c15-9007-3a8b00ca10d5 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:30.048165 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 347/706] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Apr 12 02:51:30.055760 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-e9594dab-61b6-4c15-9007-3a8b00ca10d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:30.055760 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 360/707] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:51:30.056241 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f1569-f4f9-4ccf-a3b5-1697a212593a None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:30.087010 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9594dab-61b6-4c15-9007-3a8b00ca10d5 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:30.250668 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f1569-f4f9-4ccf-a3b5-1697a212593a None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:30.270526 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9594dab-61b6-4c15-9007-3a8b00ca10d5 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:30.300908 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46ddff-8a8e-41ba-bcb4-da5f48140bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:30.301850 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46ddff-8a8e-41ba-bcb4-da5f48140bf5 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:30.302289 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46ddff-8a8e-41ba-bcb4-da5f48140bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:30.302547 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46ddff-8a8e-41ba-bcb4-da5f48140bf5 None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:30.303434 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46ddff-8a8e-41ba-bcb4-da5f48140bf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:30.303954 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46ddff-8a8e-41ba-bcb4-da5f48140bf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:30.305513 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46ddff-8a8e-41ba-bcb4-da5f48140bf5 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:30.312887 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82fd4ab-13bf-4e04-8aaf-178e2118760a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:30.313848 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fd4ab-13bf-4e04-8aaf-178e2118760a None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:30.314668 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fd4ab-13bf-4e04-8aaf-178e2118760a None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:30.315102 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fd4ab-13bf-4e04-8aaf-178e2118760a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:30.317900 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 348/708] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:30.319221 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f665075-68f6-4d3d-b9b1-c68ae2c28d3a None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:30.319652 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f665075-68f6-4d3d-b9b1-c68ae2c28d3a None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:30.320159 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f665075-68f6-4d3d-b9b1-c68ae2c28d3a None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:30.321904 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 349/709] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:30.322770 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f665075-68f6-4d3d-b9b1-c68ae2c28d3a None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:30.328639 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82fd4ab-13bf-4e04-8aaf-178e2118760a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:30.330074 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82fd4ab-13bf-4e04-8aaf-178e2118760a None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:30.349777 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-e82fd4ab-13bf-4e04-8aaf-178e2118760a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:30.351254 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 361/710] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:51:30.352980 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b574e-3d1a-4059-ada2-70a4a1ca642f None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:30.353257 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b574e-3d1a-4059-ada2-70a4a1ca642f None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:30.353521 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b574e-3d1a-4059-ada2-70a4a1ca642f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:30.378075 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-8c9b574e-3d1a-4059-ada2-70a4a1ca642f None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:30.379616 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-8c9b574e-3d1a-4059-ada2-70a4a1ca642f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:30.431981 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f665075-68f6-4d3d-b9b1-c68ae2c28d3a None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:30.459967 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 362/711] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:51:30.460929 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b574e-3d1a-4059-ada2-70a4a1ca642f None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:30.467817 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff1f76-f6b9-4380-9df4-319f357d79c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:30.468842 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff1f76-f6b9-4380-9df4-319f357d79c5 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:30.469352 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff1f76-f6b9-4380-9df4-319f357d79c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:30.469825 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff1f76-f6b9-4380-9df4-319f357d79c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:30.477107 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff1f76-f6b9-4380-9df4-319f357d79c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:30.478863 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff1f76-f6b9-4380-9df4-319f357d79c5 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:30.493455 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-5dff1f76-f6b9-4380-9df4-319f357d79c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:51:30.495823 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 350/712] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:51:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:30.499526 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff1f76-f6b9-4380-9df4-319f357d79c5 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:30.578768 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b574e-3d1a-4059-ada2-70a4a1ca642f None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:30.608659 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff1f76-f6b9-4380-9df4-319f357d79c5 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:30.619231 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503b8f8-8cc4-4d0f-8c9f-5375145753ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:30.620224 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503b8f8-8cc4-4d0f-8c9f-5375145753ee None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:30.620500 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503b8f8-8cc4-4d0f-8c9f-5375145753ee None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:30.620766 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503b8f8-8cc4-4d0f-8c9f-5375145753ee None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:30.621646 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c503b8f8-8cc4-4d0f-8c9f-5375145753ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:30.622307 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c503b8f8-8cc4-4d0f-8c9f-5375145753ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:30.623948 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c503b8f8-8cc4-4d0f-8c9f-5375145753ee None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:30.639996 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 363/713] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:30.640911 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503b8f8-8cc4-4d0f-8c9f-5375145753ee None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:30.642678 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba29823-1c1f-4b7c-b459-66119bbaa49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:30.643482 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba29823-1c1f-4b7c-b459-66119bbaa49e None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:30.643769 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba29823-1c1f-4b7c-b459-66119bbaa49e None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:30.644038 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba29823-1c1f-4b7c-b459-66119bbaa49e None admin] PATH_INFO: `/v3/services/network` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:30.644853 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba29823-1c1f-4b7c-b459-66119bbaa49e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:30.647136 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba29823-1c1f-4b7c-b459-66119bbaa49e None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:30.663385 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-0ba29823-1c1f-4b7c-b459-66119bbaa49e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 12 02:51:30.671453 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 351/714] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:51:30 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:30.672726 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba29823-1c1f-4b7c-b459-66119bbaa49e None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:30.758707 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503b8f8-8cc4-4d0f-8c9f-5375145753ee None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:30.779029 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba29823-1c1f-4b7c-b459-66119bbaa49e None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:30.792455 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15fbd2-bc2f-4518-b78a-74599796b6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:30.793403 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15fbd2-bc2f-4518-b78a-74599796b6d5 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:30.793895 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15fbd2-bc2f-4518-b78a-74599796b6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:30.794357 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15fbd2-bc2f-4518-b78a-74599796b6d5 None admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:30.795338 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15fbd2-bc2f-4518-b78a-74599796b6d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:30.795881 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15fbd2-bc2f-4518-b78a-74599796b6d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:30.797500 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15fbd2-bc2f-4518-b78a-74599796b6d5 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:30.810572 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 364/715] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 02:51:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:30.812997 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15fbd2-bc2f-4518-b78a-74599796b6d5 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:30.823133 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084857b1-c7bb-4073-82c0-843392ab9278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:30.824143 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084857b1-c7bb-4073-82c0-843392ab9278 None admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:30.824628 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084857b1-c7bb-4073-82c0-843392ab9278 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:30.825092 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084857b1-c7bb-4073-82c0-843392ab9278 None admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:30.825978 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084857b1-c7bb-4073-82c0-843392ab9278 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:30.828037 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084857b1-c7bb-4073-82c0-843392ab9278 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:30.853297 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 352/716] 10.222.0.32 () {60 vars in 1132 bytes} [Tue Apr 12 02:51:30 2022] POST /identity/v3/users => generated 254 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 02:51:30.854807 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084857b1-c7bb-4073-82c0-843392ab9278 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:30.922414 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15fbd2-bc2f-4518-b78a-74599796b6d5 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:30.959123 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18203e-32ab-4e20-b442-e3665f87743c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:30.959850 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18203e-32ab-4e20-b442-e3665f87743c None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:30.960124 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18203e-32ab-4e20-b442-e3665f87743c None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:30.960442 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18203e-32ab-4e20-b442-e3665f87743c None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:30.961166 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f18203e-32ab-4e20-b442-e3665f87743c None admin] RBAC: Adding query filter params (name=network) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:30.961450 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f18203e-32ab-4e20-b442-e3665f87743c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:30.962960 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f18203e-32ab-4e20-b442-e3665f87743c None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:30.967535 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084857b1-c7bb-4073-82c0-843392ab9278 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:30.968463 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 365/717] 10.222.0.32 () {56 vars in 1112 bytes} [Tue Apr 12 02:51:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:30.974067 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18203e-32ab-4e20-b442-e3665f87743c None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:31.007355 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11e356-11a4-4dec-8416-7ec5ce86cab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:31.008574 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11e356-11a4-4dec-8416-7ec5ce86cab7 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:31.010593 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11e356-11a4-4dec-8416-7ec5ce86cab7 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:31.011125 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11e356-11a4-4dec-8416-7ec5ce86cab7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:31.012219 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11e356-11a4-4dec-8416-7ec5ce86cab7 None admin] RBAC: Adding query filter params (role.id=c0f19d3800f44637822d5162ffe4b497, scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed, user.id=43ee5cb310fd4538910e40ea7082708c) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:31.012732 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11e356-11a4-4dec-8416-7ec5ce86cab7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:31.014535 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11e356-11a4-4dec-8416-7ec5ce86cab7 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:31.021803 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 353/718] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:51:30 2022] GET /identity/v3/role_assignments?user.id=43ee5cb310fd4538910e40ea7082708c&scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed&role.id=c0f19d3800f44637822d5162ffe4b497 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:31.086302 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18203e-32ab-4e20-b442-e3665f87743c None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:31.123912 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d73741-7434-4dcb-8802-fbf4fd909604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:31.124496 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d73741-7434-4dcb-8802-fbf4fd909604 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:31.124764 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d73741-7434-4dcb-8802-fbf4fd909604 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:31.125023 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d73741-7434-4dcb-8802-fbf4fd909604 None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:31.125787 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d73741-7434-4dcb-8802-fbf4fd909604 None admin] RBAC: Adding query filter params (type=network) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:31.126086 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d73741-7434-4dcb-8802-fbf4fd909604 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:31.127501 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d73741-7434-4dcb-8802-fbf4fd909604 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:31.134028 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 366/719] 10.222.0.32 () {56 vars in 1112 bytes} [Tue Apr 12 02:51:30 2022] GET /identity/v3/services?type=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:51:31.493594 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceabc28-8039-4383-8c20-3957117ea9b0 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:31.493978 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceabc28-8039-4383-8c20-3957117ea9b0 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:31.494152 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceabc28-8039-4383-8c20-3957117ea9b0 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:31.495987 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 354/720] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:31.501193 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f6031-429e-41dd-8b73-fbf7ca505be3 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:31.501474 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f6031-429e-41dd-8b73-fbf7ca505be3 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:31.501741 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f6031-429e-41dd-8b73-fbf7ca505be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:31.524807 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-fe0f6031-429e-41dd-8b73-fbf7ca505be3 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:31.526085 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-fe0f6031-429e-41dd-8b73-fbf7ca505be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:31.606478 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 367/721] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 02:51:31.642567 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceabc28-8039-4383-8c20-3957117ea9b0 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:31.757984 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceabc28-8039-4383-8c20-3957117ea9b0 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:31.801271 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a70ba6-fb31-4a72-8c60-2eb1c05b088a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:31.802062 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a70ba6-fb31-4a72-8c60-2eb1c05b088a None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:31.802332 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a70ba6-fb31-4a72-8c60-2eb1c05b088a None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:31.802595 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a70ba6-fb31-4a72-8c60-2eb1c05b088a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:31.824603 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a70ba6-fb31-4a72-8c60-2eb1c05b088a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:51:31.831823 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-f6a70ba6-fb31-4a72-8c60-2eb1c05b088a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 02:51:31.833411 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 355/722] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 02:51:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:31.839468 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f6031-429e-41dd-8b73-fbf7ca505be3 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:31.939138 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f6031-429e-41dd-8b73-fbf7ca505be3 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:31.979201 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffcbe2-e06e-4391-9982-8d2b606474b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:31.979905 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffcbe2-e06e-4391-9982-8d2b606474b9 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:31.980189 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffcbe2-e06e-4391-9982-8d2b606474b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:31.980473 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffcbe2-e06e-4391-9982-8d2b606474b9 None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:31.981197 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ffcbe2-e06e-4391-9982-8d2b606474b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:31.981497 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ffcbe2-e06e-4391-9982-8d2b606474b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:31.982841 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ffcbe2-e06e-4391-9982-8d2b606474b9 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:31.993221 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 368/723] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:51:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:31.999499 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a70ba6-fb31-4a72-8c60-2eb1c05b088a None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:32.160648 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a70ba6-fb31-4a72-8c60-2eb1c05b088a None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:32.226272 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c14653-5394-4c66-9225-143a4790e33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:32.227088 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c14653-5394-4c66-9225-143a4790e33d None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:32.227408 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c14653-5394-4c66-9225-143a4790e33d None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:32.227681 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c14653-5394-4c66-9225-143a4790e33d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:32.245856 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c14653-5394-4c66-9225-143a4790e33d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:32.247341 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c14653-5394-4c66-9225-143a4790e33d None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:32.267236 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-a5c14653-5394-4c66-9225-143a4790e33d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:32.268816 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 356/724] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:32.274042 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffcbe2-e06e-4391-9982-8d2b606474b9 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:32.304135 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c19b01-5200-41c8-9c69-50128c533322 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:32.304406 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c19b01-5200-41c8-9c69-50128c533322 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:32.304720 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c19b01-5200-41c8-9c69-50128c533322 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:32.306061 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 357/725] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:51:32.312031 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eef0a2-4378-48be-b2b6-ced6ac8e0e74 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:32.312307 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eef0a2-4378-48be-b2b6-ced6ac8e0e74 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:32.312578 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eef0a2-4378-48be-b2b6-ced6ac8e0e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:32.343029 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-11eef0a2-4378-48be-b2b6-ced6ac8e0e74 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:32.346454 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-11eef0a2-4378-48be-b2b6-ced6ac8e0e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:32.462060 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 358/726] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 02:51:32.465801 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffcbe2-e06e-4391-9982-8d2b606474b9 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:32.534909 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05769e-0232-4d34-9e11-18aa1b7c755e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:32.535943 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05769e-0232-4d34-9e11-18aa1b7c755e None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:32.536438 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05769e-0232-4d34-9e11-18aa1b7c755e None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:32.536905 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05769e-0232-4d34-9e11-18aa1b7c755e None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:32.537741 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05769e-0232-4d34-9e11-18aa1b7c755e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:32.538039 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05769e-0232-4d34-9e11-18aa1b7c755e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:32.541411 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05769e-0232-4d34-9e11-18aa1b7c755e None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:32.542289 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eef0a2-4378-48be-b2b6-ced6ac8e0e74 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:32.560121 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 369/727] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:32.562533 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05769e-0232-4d34-9e11-18aa1b7c755e None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:32.677697 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05769e-0232-4d34-9e11-18aa1b7c755e None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:32.758727 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964059e-a7cc-447f-a7fd-43ef3da7ca08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:32.759893 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964059e-a7cc-447f-a7fd-43ef3da7ca08 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:32.760383 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964059e-a7cc-447f-a7fd-43ef3da7ca08 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:32.760958 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964059e-a7cc-447f-a7fd-43ef3da7ca08 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:32.768737 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eef0a2-4378-48be-b2b6-ced6ac8e0e74 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:32.784651 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3964059e-a7cc-447f-a7fd-43ef3da7ca08 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:32.786139 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3964059e-a7cc-447f-a7fd-43ef3da7ca08 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:32.811476 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-3964059e-a7cc-447f-a7fd-43ef3da7ca08 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 12 02:51:32.813166 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 370/728] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 02:51:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:51:32.821751 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964059e-a7cc-447f-a7fd-43ef3da7ca08 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:32.823145 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7030f-b515-4fb7-be51-8fcbefeb5057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:32.824526 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7030f-b515-4fb7-be51-8fcbefeb5057 None admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:32.825376 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7030f-b515-4fb7-be51-8fcbefeb5057 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:32.827688 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7030f-b515-4fb7-be51-8fcbefeb5057 None admin] PATH_INFO: `/v3/services` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:32.828920 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7030f-b515-4fb7-be51-8fcbefeb5057 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:32.831440 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7030f-b515-4fb7-be51-8fcbefeb5057 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:32.852376 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 359/729] 10.222.0.32 () {60 vars in 1141 bytes} [Tue Apr 12 02:51:32 2022] POST /identity/v3/services => generated 251 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 02:51:32.971919 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964059e-a7cc-447f-a7fd-43ef3da7ca08 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:33.040069 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d2d41-d4d2-4b46-94c0-494915c59ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:33.041469 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d2d41-d4d2-4b46-94c0-494915c59ecf None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:33.042255 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d2d41-d4d2-4b46-94c0-494915c59ecf None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:33.042918 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d2d41-d4d2-4b46-94c0-494915c59ecf None admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:33.044665 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d2d41-d4d2-4b46-94c0-494915c59ecf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:33.045362 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d2d41-d4d2-4b46-94c0-494915c59ecf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:33.047599 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d2d41-d4d2-4b46-94c0-494915c59ecf None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:33.075582 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 371/730] 10.222.0.32 () {56 vars in 1135 bytes} [Tue Apr 12 02:51:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:33.081939 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7030f-b515-4fb7-be51-8fcbefeb5057 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:33.193595 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7030f-b515-4fb7-be51-8fcbefeb5057 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:33.228092 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60076546-a914-4eb3-b70e-693431d8e94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:33.229143 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60076546-a914-4eb3-b70e-693431d8e94a None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:33.229609 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60076546-a914-4eb3-b70e-693431d8e94a None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:33.230087 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60076546-a914-4eb3-b70e-693431d8e94a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:33.296672 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60076546-a914-4eb3-b70e-693431d8e94a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:33.298451 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60076546-a914-4eb3-b70e-693431d8e94a None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:33.396173 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 360/731] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:51:33 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 02:51:33.402313 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d2d41-d4d2-4b46-94c0-494915c59ecf None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:33.515421 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d2d41-d4d2-4b46-94c0-494915c59ecf None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:33.570483 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ebaab-43f3-4935-a0a7-2311287eca0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:33.571641 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ebaab-43f3-4935-a0a7-2311287eca0d None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:33.572131 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ebaab-43f3-4935-a0a7-2311287eca0d None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:33.572583 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ebaab-43f3-4935-a0a7-2311287eca0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:33.587014 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ebaab-43f3-4935-a0a7-2311287eca0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:33.589036 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ebaab-43f3-4935-a0a7-2311287eca0d None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:33.621739 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-d26ebaab-43f3-4935-a0a7-2311287eca0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:33.623339 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 372/732] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:51:33.629025 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60076546-a914-4eb3-b70e-693431d8e94a None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:33.752563 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60076546-a914-4eb3-b70e-693431d8e94a None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:33.804577 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea61ecd-6113-4b1d-99ea-20cd17409f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:33.805362 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea61ecd-6113-4b1d-99ea-20cd17409f08 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:33.805536 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea61ecd-6113-4b1d-99ea-20cd17409f08 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:33.805793 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea61ecd-6113-4b1d-99ea-20cd17409f08 None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:33.806528 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea61ecd-6113-4b1d-99ea-20cd17409f08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:33.806830 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea61ecd-6113-4b1d-99ea-20cd17409f08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:33.808610 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea61ecd-6113-4b1d-99ea-20cd17409f08 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:33.821462 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 361/733] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:33.828055 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ebaab-43f3-4935-a0a7-2311287eca0d None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:33.972736 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ebaab-43f3-4935-a0a7-2311287eca0d None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:34.018438 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515b6e6-b36b-4be3-a1fa-961df709c462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:34.019230 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515b6e6-b36b-4be3-a1fa-961df709c462 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:34.019499 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515b6e6-b36b-4be3-a1fa-961df709c462 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:34.019796 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515b6e6-b36b-4be3-a1fa-961df709c462 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:34.028789 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2515b6e6-b36b-4be3-a1fa-961df709c462 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:34.030225 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2515b6e6-b36b-4be3-a1fa-961df709c462 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:34.049679 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4394f-2696-4bd0-a3da-c114cc8e1a9d None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:34.050287 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4394f-2696-4bd0-a3da-c114cc8e1a9d None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:34.050415 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-2515b6e6-b36b-4be3-a1fa-961df709c462 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:51:34.050876 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4394f-2696-4bd0-a3da-c114cc8e1a9d None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:34.051860 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 373/734] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:51:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:34.053075 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 362/735] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:51:34.056957 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515b6e6-b36b-4be3-a1fa-961df709c462 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:34.058640 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec9cb2-d0a0-4830-87e8-7bea2d0c5831 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:34.058917 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec9cb2-d0a0-4830-87e8-7bea2d0c5831 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:34.059186 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec9cb2-d0a0-4830-87e8-7bea2d0c5831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:34.075798 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-f9ec9cb2-d0a0-4830-87e8-7bea2d0c5831 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:34.077252 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-f9ec9cb2-d0a0-4830-87e8-7bea2d0c5831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:34.144334 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 363/736] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:34 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:51:34.182372 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec9cb2-d0a0-4830-87e8-7bea2d0c5831 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:34.214996 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515b6e6-b36b-4be3-a1fa-961df709c462 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:34.248347 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a72af4-ce50-4726-a607-667960bd22fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:34.249043 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a72af4-ce50-4726-a607-667960bd22fb None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:34.249317 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a72af4-ce50-4726-a607-667960bd22fb None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:34.249577 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a72af4-ce50-4726-a607-667960bd22fb None admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:34.250344 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a72af4-ce50-4726-a607-667960bd22fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:34.250641 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a72af4-ce50-4726-a607-667960bd22fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:34.252073 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a72af4-ce50-4726-a607-667960bd22fb None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:34.263212 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 374/737] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 02:51:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:34.264534 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31d52e-bf35-48b3-b52d-c25c2f180679 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:34.264809 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31d52e-bf35-48b3-b52d-c25c2f180679 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:34.265071 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31d52e-bf35-48b3-b52d-c25c2f180679 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:34.266413 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 375/738] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:34.267297 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3faa57-b21f-48db-822f-4e7c0b05c3c7 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:34.267623 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3faa57-b21f-48db-822f-4e7c0b05c3c7 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:34.267912 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3faa57-b21f-48db-822f-4e7c0b05c3c7 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:34.269197 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 376/739] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:34.272601 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3faa57-b21f-48db-822f-4e7c0b05c3c7 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:34.285639 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec9cb2-d0a0-4830-87e8-7bea2d0c5831 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:34.318786 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b094d-fda5-44f3-8a69-7fb8fde6ef72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:34.319551 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b094d-fda5-44f3-8a69-7fb8fde6ef72 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:34.319914 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b094d-fda5-44f3-8a69-7fb8fde6ef72 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:34.320186 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b094d-fda5-44f3-8a69-7fb8fde6ef72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:34.330676 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b094d-fda5-44f3-8a69-7fb8fde6ef72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:51:34.337453 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-979b094d-fda5-44f3-8a69-7fb8fde6ef72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 02:51:34.338697 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 364/740] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 02:51:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:51:34.344749 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed46a67-36e2-404e-9c85-e2cb6bd8cf35 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:34.345024 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed46a67-36e2-404e-9c85-e2cb6bd8cf35 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:34.345285 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed46a67-36e2-404e-9c85-e2cb6bd8cf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:34.361305 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-aed46a67-36e2-404e-9c85-e2cb6bd8cf35 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:34.362446 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-aed46a67-36e2-404e-9c85-e2cb6bd8cf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:34.372028 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3faa57-b21f-48db-822f-4e7c0b05c3c7 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:34.405086 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40feb6-7d55-417f-968b-22cf11cefd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:34.405732 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40feb6-7d55-417f-968b-22cf11cefd66 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:34.406001 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40feb6-7d55-417f-968b-22cf11cefd66 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:34.406266 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40feb6-7d55-417f-968b-22cf11cefd66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:34.407076 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f40feb6-7d55-417f-968b-22cf11cefd66 None admin] RBAC: Adding query filter params (role.id=c0f19d3800f44637822d5162ffe4b497, scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed, user.id=8e8d78f92f12405fb746ddeb2579bd2e) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:34.407378 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f40feb6-7d55-417f-968b-22cf11cefd66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:34.408816 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f40feb6-7d55-417f-968b-22cf11cefd66 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:34.423753 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 377/741] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:51:34 2022] GET /identity/v3/role_assignments?user.id=8e8d78f92f12405fb746ddeb2579bd2e&scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed&role.id=c0f19d3800f44637822d5162ffe4b497 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:34.423753 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e732e14-5a8d-464c-b59d-7b0ab241aa03 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:34.423753 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e732e14-5a8d-464c-b59d-7b0ab241aa03 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:34.423753 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e732e14-5a8d-464c-b59d-7b0ab241aa03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:34.433422 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-2e732e14-5a8d-464c-b59d-7b0ab241aa03 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:34.434669 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-2e732e14-5a8d-464c-b59d-7b0ab241aa03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:34.445719 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 365/742] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:34 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:51:34.447066 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed46a67-36e2-404e-9c85-e2cb6bd8cf35 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:34.524442 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 378/743] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:34 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 02:51:34.525590 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e732e14-5a8d-464c-b59d-7b0ab241aa03 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:34.583854 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed46a67-36e2-404e-9c85-e2cb6bd8cf35 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:34.626304 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c1d26-d462-4aaf-8339-e8dd351ed9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:34.627337 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c1d26-d462-4aaf-8339-e8dd351ed9eb None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:34.627848 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c1d26-d462-4aaf-8339-e8dd351ed9eb None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:34.628333 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c1d26-d462-4aaf-8339-e8dd351ed9eb None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:34.629269 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c1d26-d462-4aaf-8339-e8dd351ed9eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:34.629736 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c1d26-d462-4aaf-8339-e8dd351ed9eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:34.631302 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c1d26-d462-4aaf-8339-e8dd351ed9eb None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:34.640741 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 366/744] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:51:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:34.641988 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c1d26-d462-4aaf-8339-e8dd351ed9eb None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:34.648357 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e732e14-5a8d-464c-b59d-7b0ab241aa03 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:34.691571 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe3433-9ab8-4fd8-9384-404ea79418a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:34.692767 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe3433-9ab8-4fd8-9384-404ea79418a1 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:34.693051 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe3433-9ab8-4fd8-9384-404ea79418a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:34.693320 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe3433-9ab8-4fd8-9384-404ea79418a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:34.706207 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe3433-9ab8-4fd8-9384-404ea79418a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:51:34.715797 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-19fe3433-9ab8-4fd8-9384-404ea79418a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 02:51:34.717469 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 379/745] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 02:51:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:34.718740 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe3433-9ab8-4fd8-9384-404ea79418a1 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:34.755150 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c1d26-d462-4aaf-8339-e8dd351ed9eb None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:34.788476 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92add141-64a2-4f75-b3f0-ca7fd0dac1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:34.789136 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92add141-64a2-4f75-b3f0-ca7fd0dac1ad None admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:34.789409 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92add141-64a2-4f75-b3f0-ca7fd0dac1ad None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:34.789674 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92add141-64a2-4f75-b3f0-ca7fd0dac1ad None admin] PATH_INFO: `/v3/services` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:34.790381 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92add141-64a2-4f75-b3f0-ca7fd0dac1ad None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:34.791881 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92add141-64a2-4f75-b3f0-ca7fd0dac1ad None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:34.812060 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 367/746] 10.222.0.32 () {60 vars in 1141 bytes} [Tue Apr 12 02:51:34 2022] POST /identity/v3/services => generated 240 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 02:51:34.813319 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92add141-64a2-4f75-b3f0-ca7fd0dac1ad None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:34.839716 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe3433-9ab8-4fd8-9384-404ea79418a1 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:34.883274 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3884d2-31e7-433b-8298-820d90217ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:34.884171 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3884d2-31e7-433b-8298-820d90217ab7 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:34.884430 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3884d2-31e7-433b-8298-820d90217ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:34.884695 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3884d2-31e7-433b-8298-820d90217ab7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:34.898427 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3884d2-31e7-433b-8298-820d90217ab7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:34.899976 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3884d2-31e7-433b-8298-820d90217ab7 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:34.920401 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-5f3884d2-31e7-433b-8298-820d90217ab7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:34.922015 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 380/747] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:34.928864 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3884d2-31e7-433b-8298-820d90217ab7 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:35.017042 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92add141-64a2-4f75-b3f0-ca7fd0dac1ad None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:35.083474 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4650d-a46d-48dd-ab49-2db24ab354d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:35.084197 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4650d-a46d-48dd-ab49-2db24ab354d7 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:35.084474 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4650d-a46d-48dd-ab49-2db24ab354d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:35.084742 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4650d-a46d-48dd-ab49-2db24ab354d7 None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:35.086443 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d4650d-a46d-48dd-ab49-2db24ab354d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:35.086749 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d4650d-a46d-48dd-ab49-2db24ab354d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:35.089287 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d4650d-a46d-48dd-ab49-2db24ab354d7 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:35.103116 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 368/748] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 02:51:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:35.111153 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4650d-a46d-48dd-ab49-2db24ab354d7 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:35.123576 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3884d2-31e7-433b-8298-820d90217ab7 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:35.157821 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dfc722-2bf9-43ac-8537-52d6a284f8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:35.158486 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfc722-2bf9-43ac-8537-52d6a284f8a5 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:35.158760 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfc722-2bf9-43ac-8537-52d6a284f8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:35.159029 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfc722-2bf9-43ac-8537-52d6a284f8a5 None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:35.159787 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dfc722-2bf9-43ac-8537-52d6a284f8a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:35.160094 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dfc722-2bf9-43ac-8537-52d6a284f8a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:35.161469 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dfc722-2bf9-43ac-8537-52d6a284f8a5 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:35.174970 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 381/749] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:35.180460 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dfc722-2bf9-43ac-8537-52d6a284f8a5 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:35.214617 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4650d-a46d-48dd-ab49-2db24ab354d7 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:35.248191 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d5086-821c-45b7-a673-a1fed6d64cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:35.248981 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d5086-821c-45b7-a673-a1fed6d64cd6 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:35.249248 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d5086-821c-45b7-a673-a1fed6d64cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:35.249506 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d5086-821c-45b7-a673-a1fed6d64cd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:35.260568 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d5086-821c-45b7-a673-a1fed6d64cd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:35.262085 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d5086-821c-45b7-a673-a1fed6d64cd6 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:35.279438 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-e14d5086-821c-45b7-a673-a1fed6d64cd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:35.281078 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 369/750] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:35.286641 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dfc722-2bf9-43ac-8537-52d6a284f8a5 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:35.291670 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d5086-821c-45b7-a673-a1fed6d64cd6 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:35.323336 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530569c-d4f1-4608-b8f2-590299e27eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:35.324168 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530569c-d4f1-4608-b8f2-590299e27eea None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:35.324443 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530569c-d4f1-4608-b8f2-590299e27eea None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:35.324708 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530569c-d4f1-4608-b8f2-590299e27eea None admin] PATH_INFO: `/v3/users/nova` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:35.332641 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6530569c-d4f1-4608-b8f2-590299e27eea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:35.334090 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6530569c-d4f1-4608-b8f2-590299e27eea None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:35.348050 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-6530569c-d4f1-4608-b8f2-590299e27eea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 12 02:51:35.349563 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 382/751] 10.222.0.32 () {56 vars in 1093 bytes} [Tue Apr 12 02:51:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:51:35.355267 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530569c-d4f1-4608-b8f2-590299e27eea None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:35.391710 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d5086-821c-45b7-a673-a1fed6d64cd6 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:35.424982 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e98f5-f3d9-4b77-8daf-693147a3aad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:35.425638 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e98f5-f3d9-4b77-8daf-693147a3aad8 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:35.425911 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e98f5-f3d9-4b77-8daf-693147a3aad8 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:35.426177 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e98f5-f3d9-4b77-8daf-693147a3aad8 None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:35.426885 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e98f5-f3d9-4b77-8daf-693147a3aad8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:35.427182 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e98f5-f3d9-4b77-8daf-693147a3aad8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:35.428594 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e98f5-f3d9-4b77-8daf-693147a3aad8 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:35.444998 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 370/752] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:51:35.446228 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e98f5-f3d9-4b77-8daf-693147a3aad8 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:35.456197 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530569c-d4f1-4608-b8f2-590299e27eea None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:35.490183 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c79ab-3a45-45b6-baa6-6b54efddbbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:35.490851 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c79ab-3a45-45b6-baa6-6b54efddbbce None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:35.491128 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c79ab-3a45-45b6-baa6-6b54efddbbce None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:35.491397 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c79ab-3a45-45b6-baa6-6b54efddbbce None admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:35.492267 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c79ab-3a45-45b6-baa6-6b54efddbbce None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:35.492571 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c79ab-3a45-45b6-baa6-6b54efddbbce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:35.494009 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c79ab-3a45-45b6-baa6-6b54efddbbce None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:35.513315 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 383/753] 10.222.0.32 () {56 vars in 1133 bytes} [Tue Apr 12 02:51:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:51:35.519334 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c79ab-3a45-45b6-baa6-6b54efddbbce None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:35.551266 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e98f5-f3d9-4b77-8daf-693147a3aad8 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:35.585042 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a2c65-e3d2-4716-8842-f81c92781da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:35.585961 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a2c65-e3d2-4716-8842-f81c92781da9 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:35.586232 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a2c65-e3d2-4716-8842-f81c92781da9 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:35.586495 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a2c65-e3d2-4716-8842-f81c92781da9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:35.594964 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a2c65-e3d2-4716-8842-f81c92781da9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:35.596904 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a2c65-e3d2-4716-8842-f81c92781da9 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:35.614874 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-7a3a2c65-e3d2-4716-8842-f81c92781da9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 12 02:51:35.621023 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 371/754] 10.222.0.32 () {56 vars in 1117 bytes} [Tue Apr 12 02:51:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:51:35.622307 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a2c65-e3d2-4716-8842-f81c92781da9 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:35.629349 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c79ab-3a45-45b6-baa6-6b54efddbbce None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:35.663416 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca827f-d696-4f93-9dbb-3d50fc56974c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:35.664289 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca827f-d696-4f93-9dbb-3d50fc56974c None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:35.664664 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca827f-d696-4f93-9dbb-3d50fc56974c None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:35.664935 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca827f-d696-4f93-9dbb-3d50fc56974c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:35.675528 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ca827f-d696-4f93-9dbb-3d50fc56974c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:35.677098 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ca827f-d696-4f93-9dbb-3d50fc56974c None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:35.695027 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-99ca827f-d696-4f93-9dbb-3d50fc56974c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:35.696634 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 384/755] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:35.702209 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca827f-d696-4f93-9dbb-3d50fc56974c None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:35.721853 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a2c65-e3d2-4716-8842-f81c92781da9 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:35.754532 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d0d4b-b4ce-442b-8b10-fe59021cd374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:35.755199 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d0d4b-b4ce-442b-8b10-fe59021cd374 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:35.755469 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d0d4b-b4ce-442b-8b10-fe59021cd374 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:35.755742 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d0d4b-b4ce-442b-8b10-fe59021cd374 None admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:35.756573 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d0d4b-b4ce-442b-8b10-fe59021cd374 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:35.756870 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d0d4b-b4ce-442b-8b10-fe59021cd374 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:35.758313 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d0d4b-b4ce-442b-8b10-fe59021cd374 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:35.779594 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 372/756] 10.222.0.32 () {56 vars in 1149 bytes} [Tue Apr 12 02:51:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:51:35.780852 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d0d4b-b4ce-442b-8b10-fe59021cd374 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:35.802009 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca827f-d696-4f93-9dbb-3d50fc56974c None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:35.836287 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657e9b6-4927-4093-ab05-abff4ba390f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:35.836952 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657e9b6-4927-4093-ab05-abff4ba390f3 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:35.837230 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657e9b6-4927-4093-ab05-abff4ba390f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:35.837497 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657e9b6-4927-4093-ab05-abff4ba390f3 None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:35.838271 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657e9b6-4927-4093-ab05-abff4ba390f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:35.838635 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657e9b6-4927-4093-ab05-abff4ba390f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:35.840176 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657e9b6-4927-4093-ab05-abff4ba390f3 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:35.852509 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 385/757] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:51:35.858491 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657e9b6-4927-4093-ab05-abff4ba390f3 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:35.878737 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d0d4b-b4ce-442b-8b10-fe59021cd374 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:35.914012 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336019d-8e54-4f66-a7b8-9926b2564c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:35.914661 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336019d-8e54-4f66-a7b8-9926b2564c24 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:35.914932 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336019d-8e54-4f66-a7b8-9926b2564c24 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:35.915197 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336019d-8e54-4f66-a7b8-9926b2564c24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:35.959641 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657e9b6-4927-4093-ab05-abff4ba390f3 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:35.981361 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336019d-8e54-4f66-a7b8-9926b2564c24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:35.982991 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336019d-8e54-4f66-a7b8-9926b2564c24 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:35.993284 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d9c36-00df-4580-8ee9-6eec56e35c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:35.994079 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d9c36-00df-4580-8ee9-6eec56e35c88 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:35.994357 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d9c36-00df-4580-8ee9-6eec56e35c88 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:35.994685 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d9c36-00df-4580-8ee9-6eec56e35c88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:36.001726 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d9c36-00df-4580-8ee9-6eec56e35c88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:36.003164 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d9c36-00df-4580-8ee9-6eec56e35c88 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:36.016086 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-f71d9c36-00df-4580-8ee9-6eec56e35c88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:51:36.017580 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 386/758] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:51:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:51:36.018844 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c7f32-8666-49b3-baa2-b963c54fbdf4 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:36.023807 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c7f32-8666-49b3-baa2-b963c54fbdf4 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:36.024133 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c7f32-8666-49b3-baa2-b963c54fbdf4 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:36.025463 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 387/759] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:36.026275 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c7f32-8666-49b3-baa2-b963c54fbdf4 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:36.085264 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 373/760] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:51:35 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 02:51:36.086715 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafb376-a830-4655-929c-9a9a6fc8ee0e None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:36.086996 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafb376-a830-4655-929c-9a9a6fc8ee0e None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:36.087258 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafb376-a830-4655-929c-9a9a6fc8ee0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:36.104784 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-cbafb376-a830-4655-929c-9a9a6fc8ee0e None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:36.106235 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-cbafb376-a830-4655-929c-9a9a6fc8ee0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:36.128033 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c7f32-8666-49b3-baa2-b963c54fbdf4 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:36.167873 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72581ae-4165-41d7-a61c-032ca2d541b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:36.168461 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72581ae-4165-41d7-a61c-032ca2d541b9 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:36.168739 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72581ae-4165-41d7-a61c-032ca2d541b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:36.169008 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72581ae-4165-41d7-a61c-032ca2d541b9 None admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:36.169796 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72581ae-4165-41d7-a61c-032ca2d541b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:36.170096 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72581ae-4165-41d7-a61c-032ca2d541b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:36.174931 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72581ae-4165-41d7-a61c-032ca2d541b9 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:36.176330 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 374/761] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:51:36.177235 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafb376-a830-4655-929c-9a9a6fc8ee0e None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:36.192645 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 388/762] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 02:51:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:36.193551 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72581ae-4165-41d7-a61c-032ca2d541b9 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:36.279952 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafb376-a830-4655-929c-9a9a6fc8ee0e None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:36.290810 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72581ae-4165-41d7-a61c-032ca2d541b9 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:36.313532 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bdfa5-237c-49c2-b58a-1801d4d2f702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:36.314690 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bdfa5-237c-49c2-b58a-1801d4d2f702 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:36.315149 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bdfa5-237c-49c2-b58a-1801d4d2f702 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:36.315690 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bdfa5-237c-49c2-b58a-1801d4d2f702 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:36.324365 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb4c98-7dd3-402f-8b50-003d2b65d449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:36.325309 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb4c98-7dd3-402f-8b50-003d2b65d449 None admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:36.325615 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb4c98-7dd3-402f-8b50-003d2b65d449 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:36.325884 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb4c98-7dd3-402f-8b50-003d2b65d449 None admin] PATH_INFO: `/v3/projects/82cb5f6cfa0e46b28a37565fc2b560ed/users/43ee5cb310fd4538910e40ea7082708c/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:36.326882 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23bdfa5-237c-49c2-b58a-1801d4d2f702 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:36.328186 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb4c98-7dd3-402f-8b50-003d2b65d449 None admin] RBAC: Authorizing `identity:create_grant(project_id=82cb5f6cfa0e46b28a37565fc2b560ed, user_id=43ee5cb310fd4538910e40ea7082708c, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:36.329091 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23bdfa5-237c-49c2-b58a-1801d4d2f702 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:36.329639 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb4c98-7dd3-402f-8b50-003d2b65d449 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:36.351752 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 389/763] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 02:51:36 2022] PUT /identity/v3/projects/82cb5f6cfa0e46b28a37565fc2b560ed/users/43ee5cb310fd4538910e40ea7082708c/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 02:51:36.351752 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb4c98-7dd3-402f-8b50-003d2b65d449 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:36.352039 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-e23bdfa5-237c-49c2-b58a-1801d4d2f702 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:36.358060 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 375/764] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:36.359079 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bdfa5-237c-49c2-b58a-1801d4d2f702 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:36.486187 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bdfa5-237c-49c2-b58a-1801d4d2f702 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:36.525364 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb847605-4d88-4a8e-91f8-f221a9dd843e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:36.526108 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb847605-4d88-4a8e-91f8-f221a9dd843e None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:36.526408 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb847605-4d88-4a8e-91f8-f221a9dd843e None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:36.526634 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb847605-4d88-4a8e-91f8-f221a9dd843e None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:36.527403 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb847605-4d88-4a8e-91f8-f221a9dd843e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:36.527706 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb847605-4d88-4a8e-91f8-f221a9dd843e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:36.529394 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb847605-4d88-4a8e-91f8-f221a9dd843e None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:36.542898 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 376/765] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:36.548269 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb847605-4d88-4a8e-91f8-f221a9dd843e None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:36.595095 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb4c98-7dd3-402f-8b50-003d2b65d449 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:36.630473 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273e5d4-5cc7-4eee-af75-41151f6f30ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:36.631291 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273e5d4-5cc7-4eee-af75-41151f6f30ad None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:36.631563 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273e5d4-5cc7-4eee-af75-41151f6f30ad None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:36.631877 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273e5d4-5cc7-4eee-af75-41151f6f30ad None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:36.632534 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273e5d4-5cc7-4eee-af75-41151f6f30ad None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:36.633905 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273e5d4-5cc7-4eee-af75-41151f6f30ad None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:36.645727 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-a273e5d4-5cc7-4eee-af75-41151f6f30ad None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 12 02:51:36.647300 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 390/766] 10.222.0.32 () {56 vars in 1129 bytes} [Tue Apr 12 02:51:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:36.653774 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273e5d4-5cc7-4eee-af75-41151f6f30ad None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:36.674787 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb847605-4d88-4a8e-91f8-f221a9dd843e None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:36.728262 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4d9fb-674a-4e2e-8fab-3ded0c884dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:36.729615 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4d9fb-674a-4e2e-8fab-3ded0c884dc7 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:36.729893 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4d9fb-674a-4e2e-8fab-3ded0c884dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:36.730161 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4d9fb-674a-4e2e-8fab-3ded0c884dc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:36.740068 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4d9fb-674a-4e2e-8fab-3ded0c884dc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:36.741777 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4d9fb-674a-4e2e-8fab-3ded0c884dc7 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:36.757254 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-7ad4d9fb-674a-4e2e-8fab-3ded0c884dc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:51:36.759219 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 377/767] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:51:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:51:36.765021 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4d9fb-674a-4e2e-8fab-3ded0c884dc7 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:36.791562 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273e5d4-5cc7-4eee-af75-41151f6f30ad None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:36.844268 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c90ee-3995-45a7-9d08-4863f8d3d1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:36.845249 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c90ee-3995-45a7-9d08-4863f8d3d1d8 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:36.845696 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c90ee-3995-45a7-9d08-4863f8d3d1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:36.846133 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c90ee-3995-45a7-9d08-4863f8d3d1d8 None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:36.847477 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c90ee-3995-45a7-9d08-4863f8d3d1d8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:36.847977 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c90ee-3995-45a7-9d08-4863f8d3d1d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:36.849539 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c90ee-3995-45a7-9d08-4863f8d3d1d8 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:36.855672 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 391/768] 10.222.0.32 () {56 vars in 1124 bytes} [Tue Apr 12 02:51:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:51:36.862617 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c90ee-3995-45a7-9d08-4863f8d3d1d8 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:36.969518 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c90ee-3995-45a7-9d08-4863f8d3d1d8 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:37.005045 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7e61d-ce51-405b-98af-0f4cecfbc8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:37.006392 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7e61d-ce51-405b-98af-0f4cecfbc8d4 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:37.006844 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7e61d-ce51-405b-98af-0f4cecfbc8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:37.007300 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7e61d-ce51-405b-98af-0f4cecfbc8d4 None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:37.008220 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7e61d-ce51-405b-98af-0f4cecfbc8d4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:37.008691 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7e61d-ce51-405b-98af-0f4cecfbc8d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:37.010268 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7e61d-ce51-405b-98af-0f4cecfbc8d4 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:37.013830 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4d9fb-674a-4e2e-8fab-3ded0c884dc7 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:37.016617 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 392/769] 10.222.0.32 () {56 vars in 1124 bytes} [Tue Apr 12 02:51:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:37.022228 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7e61d-ce51-405b-98af-0f4cecfbc8d4 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:37.105679 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e4a8e-247e-4e43-bf01-67f8b2941c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:37.106528 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e4a8e-247e-4e43-bf01-67f8b2941c22 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:37.106637 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e4a8e-247e-4e43-bf01-67f8b2941c22 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:37.106862 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e4a8e-247e-4e43-bf01-67f8b2941c22 None admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:37.107676 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e4a8e-247e-4e43-bf01-67f8b2941c22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:37.107964 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e4a8e-247e-4e43-bf01-67f8b2941c22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:37.109396 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e4a8e-247e-4e43-bf01-67f8b2941c22 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:37.129313 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 378/770] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 02:51:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:37.130198 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7e61d-ce51-405b-98af-0f4cecfbc8d4 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:37.139749 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e4a8e-247e-4e43-bf01-67f8b2941c22 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:37.198969 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ba5f4-7f62-45d4-9217-c5afa39d5968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:37.199641 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ba5f4-7f62-45d4-9217-c5afa39d5968 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:37.199938 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ba5f4-7f62-45d4-9217-c5afa39d5968 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:37.200209 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ba5f4-7f62-45d4-9217-c5afa39d5968 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:37.201005 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ba5f4-7f62-45d4-9217-c5afa39d5968 None admin] RBAC: Adding query filter params (interface=public, service_id=d7983c66b4c644c3aff23a54075b3861, region_id=RegionOne) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:37.201309 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ba5f4-7f62-45d4-9217-c5afa39d5968 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:37.202675 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ba5f4-7f62-45d4-9217-c5afa39d5968 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:37.222942 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 393/771] 10.222.0.32 () {56 vars in 1251 bytes} [Tue Apr 12 02:51:37 2022] GET /identity/v3/endpoints?service_id=d7983c66b4c644c3aff23a54075b3861&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:37.228344 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ba5f4-7f62-45d4-9217-c5afa39d5968 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:37.278444 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e4a8e-247e-4e43-bf01-67f8b2941c22 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:37.323450 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a304f-06ff-465b-b506-ea4ebfdf4835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:37.324213 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a304f-06ff-465b-b506-ea4ebfdf4835 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:37.324487 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a304f-06ff-465b-b506-ea4ebfdf4835 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:37.324804 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a304f-06ff-465b-b506-ea4ebfdf4835 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:37.325658 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a304f-06ff-465b-b506-ea4ebfdf4835 None admin] RBAC: Adding query filter params (role.id=a8b79923b07243e385187b6641381ee1, scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed, user.id=83115653901749f6ade6638593fb54e9) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:37.325967 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a304f-06ff-465b-b506-ea4ebfdf4835 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:37.327422 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a304f-06ff-465b-b506-ea4ebfdf4835 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:37.333526 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 379/772] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:51:37 2022] GET /identity/v3/role_assignments?user.id=83115653901749f6ade6638593fb54e9&scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed&role.id=a8b79923b07243e385187b6641381ee1 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:37.334783 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782a685-ec88-4e8c-80e7-408f0039163e None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:37.335060 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782a685-ec88-4e8c-80e7-408f0039163e None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:37.335326 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782a685-ec88-4e8c-80e7-408f0039163e None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:37.336826 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 380/773] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:37.349880 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254407c6-1bc4-474c-a1e7-f3d49804643e None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:37.350227 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254407c6-1bc4-474c-a1e7-f3d49804643e None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:37.350920 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254407c6-1bc4-474c-a1e7-f3d49804643e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:37.384803 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-254407c6-1bc4-474c-a1e7-f3d49804643e None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:37.386025 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-254407c6-1bc4-474c-a1e7-f3d49804643e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:37.446090 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ba5f4-7f62-45d4-9217-c5afa39d5968 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:37.481902 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 381/774] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:51:37.504792 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254407c6-1bc4-474c-a1e7-f3d49804643e None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:37.508409 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2e72c-9b71-490f-bab2-59fb3de5f7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:37.509150 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2e72c-9b71-490f-bab2-59fb3de5f7c1 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:37.509426 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2e72c-9b71-490f-bab2-59fb3de5f7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:37.509695 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2e72c-9b71-490f-bab2-59fb3de5f7c1 None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:37.510424 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde2e72c-9b71-490f-bab2-59fb3de5f7c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:37.512075 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde2e72c-9b71-490f-bab2-59fb3de5f7c1 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:37.519935 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 394/775] 10.222.0.32 () {56 vars in 1087 bytes} [Tue Apr 12 02:51:37 2022] GET /identity/v3/services => generated 772 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:51:37.681070 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254407c6-1bc4-474c-a1e7-f3d49804643e None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:37.730946 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c920e2f-241b-4101-80e1-e86846b0f989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:37.731782 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c920e2f-241b-4101-80e1-e86846b0f989 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:37.732061 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c920e2f-241b-4101-80e1-e86846b0f989 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:37.732327 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c920e2f-241b-4101-80e1-e86846b0f989 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:37.748771 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c920e2f-241b-4101-80e1-e86846b0f989 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:51:37.755771 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-6c920e2f-241b-4101-80e1-e86846b0f989 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 02:51:37.757042 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 382/776] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 02:51:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:51:37.763276 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2e72c-9b71-490f-bab2-59fb3de5f7c1 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:37.911829 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2e72c-9b71-490f-bab2-59fb3de5f7c1 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:37.947563 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a388eb4-a17d-4d08-bd91-45fa94773706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:37.949063 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a388eb4-a17d-4d08-bd91-45fa94773706 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:37.949696 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a388eb4-a17d-4d08-bd91-45fa94773706 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:37.950388 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a388eb4-a17d-4d08-bd91-45fa94773706 None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:37.951333 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a388eb4-a17d-4d08-bd91-45fa94773706 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:37.951812 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a388eb4-a17d-4d08-bd91-45fa94773706 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:37.953693 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a388eb4-a17d-4d08-bd91-45fa94773706 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:37.962366 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 395/777] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:51:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:37.968947 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c920e2f-241b-4101-80e1-e86846b0f989 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:37.989502 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5279614-27fa-46f7-9446-445dca3c4fca None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:37.989824 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5279614-27fa-46f7-9446-445dca3c4fca None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:37.990045 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5279614-27fa-46f7-9446-445dca3c4fca None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:37.991547 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 396/778] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:37.997074 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569387e-93ac-46fd-8807-05c4e33f676e None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:37.997350 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569387e-93ac-46fd-8807-05c4e33f676e None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:37.997621 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569387e-93ac-46fd-8807-05c4e33f676e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:38.017144 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-3569387e-93ac-46fd-8807-05c4e33f676e None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:38.018145 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-3569387e-93ac-46fd-8807-05c4e33f676e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:38.088344 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 397/779] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 02:51:38.091840 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c920e2f-241b-4101-80e1-e86846b0f989 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:38.125761 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569387e-93ac-46fd-8807-05c4e33f676e None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:38.126396 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b87c79-e6b2-4740-96e4-4ba32f9563e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:38.127423 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b87c79-e6b2-4740-96e4-4ba32f9563e2 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:38.127912 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b87c79-e6b2-4740-96e4-4ba32f9563e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:38.128362 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b87c79-e6b2-4740-96e4-4ba32f9563e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:38.139636 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b87c79-e6b2-4740-96e4-4ba32f9563e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:38.141451 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b87c79-e6b2-4740-96e4-4ba32f9563e2 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:38.158188 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-b8b87c79-e6b2-4740-96e4-4ba32f9563e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:38.160073 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 383/780] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:51:38.166115 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b87c79-e6b2-4740-96e4-4ba32f9563e2 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:38.286607 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569387e-93ac-46fd-8807-05c4e33f676e None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:38.326310 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b87c79-e6b2-4740-96e4-4ba32f9563e2 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:38.352182 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089c192-3f41-4356-9a26-63910e7a1594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:38.354752 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089c192-3f41-4356-9a26-63910e7a1594 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:38.356292 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089c192-3f41-4356-9a26-63910e7a1594 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:38.356868 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089c192-3f41-4356-9a26-63910e7a1594 None admin] PATH_INFO: `/v3/services/network` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:38.358539 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089c192-3f41-4356-9a26-63910e7a1594 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:38.360351 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089c192-3f41-4356-9a26-63910e7a1594 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:38.377105 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-8089c192-3f41-4356-9a26-63910e7a1594 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 12 02:51:38.378941 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 398/781] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:51:38 2022] GET /identity/v3/services/network => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:51:38.384329 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089c192-3f41-4356-9a26-63910e7a1594 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:38.402392 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066044e4-6dea-4177-91fd-50b24f5a9381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:38.403360 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066044e4-6dea-4177-91fd-50b24f5a9381 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:38.403851 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066044e4-6dea-4177-91fd-50b24f5a9381 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:38.405651 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066044e4-6dea-4177-91fd-50b24f5a9381 None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:38.406582 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066044e4-6dea-4177-91fd-50b24f5a9381 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:38.407828 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066044e4-6dea-4177-91fd-50b24f5a9381 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:38.409395 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066044e4-6dea-4177-91fd-50b24f5a9381 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:38.424802 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 384/782] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:38.432754 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066044e4-6dea-4177-91fd-50b24f5a9381 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:38.505616 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089c192-3f41-4356-9a26-63910e7a1594 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:38.540883 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22993852-6c45-4822-953b-e46f7001ff3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:38.541686 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22993852-6c45-4822-953b-e46f7001ff3c None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:38.542332 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22993852-6c45-4822-953b-e46f7001ff3c None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:38.542585 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22993852-6c45-4822-953b-e46f7001ff3c None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:38.543294 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22993852-6c45-4822-953b-e46f7001ff3c None admin] RBAC: Adding query filter params (name=network) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:38.543644 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22993852-6c45-4822-953b-e46f7001ff3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:38.545038 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22993852-6c45-4822-953b-e46f7001ff3c None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:38.549948 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 399/783] 10.222.0.32 () {56 vars in 1112 bytes} [Tue Apr 12 02:51:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:51:38.555525 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22993852-6c45-4822-953b-e46f7001ff3c None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:38.659762 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066044e4-6dea-4177-91fd-50b24f5a9381 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:38.661447 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22993852-6c45-4822-953b-e46f7001ff3c None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:38.700277 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1c19a-d471-4d68-b7cc-f668d7df1531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:38.700809 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1c19a-d471-4d68-b7cc-f668d7df1531 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:38.701265 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1c19a-d471-4d68-b7cc-f668d7df1531 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:38.701662 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1c19a-d471-4d68-b7cc-f668d7df1531 None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:38.702500 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1c19a-d471-4d68-b7cc-f668d7df1531 None admin] RBAC: Adding query filter params (type=network) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:38.703240 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1c19a-d471-4d68-b7cc-f668d7df1531 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:38.704822 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1c19a-d471-4d68-b7cc-f668d7df1531 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:38.710371 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 400/784] 10.222.0.32 () {56 vars in 1112 bytes} [Tue Apr 12 02:51:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:38.716960 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1c19a-d471-4d68-b7cc-f668d7df1531 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:38.721390 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7fc08f-2b86-457a-b3e9-6d72aabac245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:38.722200 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fc08f-2b86-457a-b3e9-6d72aabac245 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:38.722481 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fc08f-2b86-457a-b3e9-6d72aabac245 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:38.722762 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fc08f-2b86-457a-b3e9-6d72aabac245 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:38.740920 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7fc08f-2b86-457a-b3e9-6d72aabac245 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:38.742324 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7fc08f-2b86-457a-b3e9-6d72aabac245 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:38.763466 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-cc7fc08f-2b86-457a-b3e9-6d72aabac245 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 12 02:51:38.773212 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 385/785] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 02:51:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:38.778958 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7fc08f-2b86-457a-b3e9-6d72aabac245 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:38.823131 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1c19a-d471-4d68-b7cc-f668d7df1531 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:38.857691 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef692d7-eaf0-4860-862c-40df5fbedfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:38.858730 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef692d7-eaf0-4860-862c-40df5fbedfdb None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:38.859233 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef692d7-eaf0-4860-862c-40df5fbedfdb None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:38.859715 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef692d7-eaf0-4860-862c-40df5fbedfdb None admin] PATH_INFO: `/v3/endpoints` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:38.860744 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef692d7-eaf0-4860-862c-40df5fbedfdb None admin] RBAC: Adding query filter params (interface=public, service_id=b88a0505c0d74a0f868c57b7909cdf75, region_id=RegionOne) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:38.861318 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef692d7-eaf0-4860-862c-40df5fbedfdb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:38.862928 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef692d7-eaf0-4860-862c-40df5fbedfdb None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:38.868657 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 401/786] 10.222.0.32 () {56 vars in 1251 bytes} [Tue Apr 12 02:51:38 2022] GET /identity/v3/endpoints?service_id=b88a0505c0d74a0f868c57b7909cdf75&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:38.874701 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef692d7-eaf0-4860-862c-40df5fbedfdb None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:38.973463 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef692d7-eaf0-4860-862c-40df5fbedfdb None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:39.014458 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b41817-6092-417d-903c-82ae07f6f3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:39.015531 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b41817-6092-417d-903c-82ae07f6f3de None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:39.016642 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b41817-6092-417d-903c-82ae07f6f3de None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:39.017277 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b41817-6092-417d-903c-82ae07f6f3de None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:39.019234 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b41817-6092-417d-903c-82ae07f6f3de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:39.020838 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b41817-6092-417d-903c-82ae07f6f3de None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:39.030782 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 402/787] 10.222.0.32 () {56 vars in 1087 bytes} [Tue Apr 12 02:51:38 2022] GET /identity/v3/services => generated 772 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:39.032558 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380863b3-415d-4898-b0e4-05257e2906e9 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:39.034748 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7fc08f-2b86-457a-b3e9-6d72aabac245 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:39.037047 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380863b3-415d-4898-b0e4-05257e2906e9 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:39.038290 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380863b3-415d-4898-b0e4-05257e2906e9 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:39.045478 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 403/788] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:39 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:39.052483 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ffb3a-cd6b-476b-b5e0-a68610f4c87f None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:39.053035 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ffb3a-cd6b-476b-b5e0-a68610f4c87f None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:39.053576 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ffb3a-cd6b-476b-b5e0-a68610f4c87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:39.072978 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-b28ffb3a-cd6b-476b-b5e0-a68610f4c87f None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:39.076384 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-b28ffb3a-cd6b-476b-b5e0-a68610f4c87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:39.119368 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885150a1-00c5-4bfb-a4d7-8fc16525e81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:39.121252 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885150a1-00c5-4bfb-a4d7-8fc16525e81f None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:39.121752 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885150a1-00c5-4bfb-a4d7-8fc16525e81f None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:39.122206 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885150a1-00c5-4bfb-a4d7-8fc16525e81f None admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:39.123239 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885150a1-00c5-4bfb-a4d7-8fc16525e81f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:39.123764 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885150a1-00c5-4bfb-a4d7-8fc16525e81f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:39.125510 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885150a1-00c5-4bfb-a4d7-8fc16525e81f None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:39.157034 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 386/789] 10.222.0.32 () {56 vars in 1135 bytes} [Tue Apr 12 02:51:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:51:39.162331 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885150a1-00c5-4bfb-a4d7-8fc16525e81f None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:39.180668 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 404/790] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 02:51:39.235874 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ffb3a-cd6b-476b-b5e0-a68610f4c87f None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:39.312306 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885150a1-00c5-4bfb-a4d7-8fc16525e81f None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:39.347459 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c746980-03dd-4e99-b7a2-d8f9b4aec310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:39.348265 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c746980-03dd-4e99-b7a2-d8f9b4aec310 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:39.348535 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c746980-03dd-4e99-b7a2-d8f9b4aec310 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:39.348797 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c746980-03dd-4e99-b7a2-d8f9b4aec310 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:39.360367 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c746980-03dd-4e99-b7a2-d8f9b4aec310 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:39.361823 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c746980-03dd-4e99-b7a2-d8f9b4aec310 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:39.378793 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-6c746980-03dd-4e99-b7a2-d8f9b4aec310 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:39.379518 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ffb3a-cd6b-476b-b5e0-a68610f4c87f None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:39.380538 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 387/791] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:51:39.386268 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c746980-03dd-4e99-b7a2-d8f9b4aec310 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:39.419772 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874886a-0bc1-4aee-9851-bc269bee747a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:39.420664 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874886a-0bc1-4aee-9851-bc269bee747a None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:39.420936 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874886a-0bc1-4aee-9851-bc269bee747a None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:39.421196 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874886a-0bc1-4aee-9851-bc269bee747a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:39.431339 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b874886a-0bc1-4aee-9851-bc269bee747a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:51:39.438305 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-b874886a-0bc1-4aee-9851-bc269bee747a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 02:51:39.443319 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 405/792] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 02:51:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:39.445925 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874886a-0bc1-4aee-9851-bc269bee747a None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:39.487599 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c746980-03dd-4e99-b7a2-d8f9b4aec310 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:39.521222 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f978dc9-4221-45b7-89a1-57e48bbf06dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:39.521902 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f978dc9-4221-45b7-89a1-57e48bbf06dc None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:39.522191 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f978dc9-4221-45b7-89a1-57e48bbf06dc None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:39.522450 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f978dc9-4221-45b7-89a1-57e48bbf06dc None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:39.523236 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f978dc9-4221-45b7-89a1-57e48bbf06dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:39.523536 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f978dc9-4221-45b7-89a1-57e48bbf06dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:39.525093 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f978dc9-4221-45b7-89a1-57e48bbf06dc None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:39.540452 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 388/793] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:39.547551 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f978dc9-4221-45b7-89a1-57e48bbf06dc None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:39.603544 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874886a-0bc1-4aee-9851-bc269bee747a None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:39.637478 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c78c6e-a810-4002-bf0b-671d300008a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:39.638139 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c78c6e-a810-4002-bf0b-671d300008a6 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:39.638409 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c78c6e-a810-4002-bf0b-671d300008a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:39.638672 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c78c6e-a810-4002-bf0b-671d300008a6 None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:39.639409 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c78c6e-a810-4002-bf0b-671d300008a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:39.639702 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c78c6e-a810-4002-bf0b-671d300008a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:39.641217 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c78c6e-a810-4002-bf0b-671d300008a6 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:39.648198 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f978dc9-4221-45b7-89a1-57e48bbf06dc None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:39.654487 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 406/794] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:51:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:51:39.655790 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c78c6e-a810-4002-bf0b-671d300008a6 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:39.682270 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd105ea-df9f-416d-871c-9f8c505b72e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:39.683216 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd105ea-df9f-416d-871c-9f8c505b72e8 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:39.683534 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd105ea-df9f-416d-871c-9f8c505b72e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:39.683830 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd105ea-df9f-416d-871c-9f8c505b72e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:39.690687 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd105ea-df9f-416d-871c-9f8c505b72e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:39.692328 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd105ea-df9f-416d-871c-9f8c505b72e8 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:39.706572 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-fbd105ea-df9f-416d-871c-9f8c505b72e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:51:39.708124 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 389/795] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:51:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:39.714190 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd105ea-df9f-416d-871c-9f8c505b72e8 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:39.753570 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c78c6e-a810-4002-bf0b-671d300008a6 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:39.785964 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3885a8-8e44-44e6-99dc-78de09efb7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:39.786762 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3885a8-8e44-44e6-99dc-78de09efb7c7 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:39.787032 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3885a8-8e44-44e6-99dc-78de09efb7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:39.787297 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3885a8-8e44-44e6-99dc-78de09efb7c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:39.798058 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3885a8-8e44-44e6-99dc-78de09efb7c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:39.799494 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3885a8-8e44-44e6-99dc-78de09efb7c7 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:39.815704 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-0d3885a8-8e44-44e6-99dc-78de09efb7c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:39.816013 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd105ea-df9f-416d-871c-9f8c505b72e8 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:39.821581 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 407/796] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:51:39.822805 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3885a8-8e44-44e6-99dc-78de09efb7c7 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:39.849639 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5c9ee-3f1e-4b39-a5cc-04bf7562e0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:39.850301 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5c9ee-3f1e-4b39-a5cc-04bf7562e0b4 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:39.850573 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5c9ee-3f1e-4b39-a5cc-04bf7562e0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:39.850838 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5c9ee-3f1e-4b39-a5cc-04bf7562e0b4 None admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:39.851612 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe5c9ee-3f1e-4b39-a5cc-04bf7562e0b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:39.851945 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe5c9ee-3f1e-4b39-a5cc-04bf7562e0b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:39.853501 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe5c9ee-3f1e-4b39-a5cc-04bf7562e0b4 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:39.866674 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 390/797] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 02:51:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:39.872788 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5c9ee-3f1e-4b39-a5cc-04bf7562e0b4 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:39.967129 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3885a8-8e44-44e6-99dc-78de09efb7c7 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:40.013600 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c557f-7013-410e-8642-9a191ef2267c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:40.014173 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c557f-7013-410e-8642-9a191ef2267c None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:40.014453 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c557f-7013-410e-8642-9a191ef2267c None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:40.015750 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c557f-7013-410e-8642-9a191ef2267c None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:40.015750 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555c557f-7013-410e-8642-9a191ef2267c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:40.015750 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555c557f-7013-410e-8642-9a191ef2267c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:40.017073 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555c557f-7013-410e-8642-9a191ef2267c None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:40.057899 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 408/798] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:40.057899 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c557f-7013-410e-8642-9a191ef2267c None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:40.135754 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5c9ee-3f1e-4b39-a5cc-04bf7562e0b4 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:40.168599 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26212c-f41f-4f2e-bf8c-05b585344e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:40.169501 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26212c-f41f-4f2e-bf8c-05b585344e4e None admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:40.169769 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26212c-f41f-4f2e-bf8c-05b585344e4e None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:40.170031 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26212c-f41f-4f2e-bf8c-05b585344e4e None admin] PATH_INFO: `/v3/projects/82cb5f6cfa0e46b28a37565fc2b560ed/users/8e8d78f92f12405fb746ddeb2579bd2e/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:40.172983 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed26212c-f41f-4f2e-bf8c-05b585344e4e None admin] RBAC: Authorizing `identity:create_grant(project_id=82cb5f6cfa0e46b28a37565fc2b560ed, user_id=8e8d78f92f12405fb746ddeb2579bd2e, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:40.174470 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed26212c-f41f-4f2e-bf8c-05b585344e4e None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:40.194925 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 391/799] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 02:51:39 2022] PUT /identity/v3/projects/82cb5f6cfa0e46b28a37565fc2b560ed/users/8e8d78f92f12405fb746ddeb2579bd2e/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 02:51:40.200781 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d21f7-6699-470c-aa4c-657eedf47cb7 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:40.201145 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d21f7-6699-470c-aa4c-657eedf47cb7 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:40.203097 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d21f7-6699-470c-aa4c-657eedf47cb7 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:40.203097 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 392/800] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:40.211540 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc4c95-abdf-484f-815e-0a25094afea0 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:40.213619 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc4c95-abdf-484f-815e-0a25094afea0 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:40.213868 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc4c95-abdf-484f-815e-0a25094afea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:40.231580 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c557f-7013-410e-8642-9a191ef2267c None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:40.247454 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-56fc4c95-abdf-484f-815e-0a25094afea0 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:40.248709 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-56fc4c95-abdf-484f-815e-0a25094afea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:40.275947 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89d89b-5d8b-4436-94de-12c5fc7b12c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:40.275947 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89d89b-5d8b-4436-94de-12c5fc7b12c8 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:40.275947 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89d89b-5d8b-4436-94de-12c5fc7b12c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:40.275947 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89d89b-5d8b-4436-94de-12c5fc7b12c8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:40.282977 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89d89b-5d8b-4436-94de-12c5fc7b12c8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:40.284485 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89d89b-5d8b-4436-94de-12c5fc7b12c8 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:40.301260 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-7b89d89b-5d8b-4436-94de-12c5fc7b12c8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 12 02:51:40.307547 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 409/801] 10.222.0.32 () {56 vars in 1093 bytes} [Tue Apr 12 02:51:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:51:40.308827 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89d89b-5d8b-4436-94de-12c5fc7b12c8 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:40.397857 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 393/802] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:51:40.409617 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89d89b-5d8b-4436-94de-12c5fc7b12c8 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:40.446045 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41084568-3e7a-4673-ab5f-362ed1ad09ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:40.446737 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41084568-3e7a-4673-ab5f-362ed1ad09ad None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:40.447010 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41084568-3e7a-4673-ab5f-362ed1ad09ad None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:40.447270 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41084568-3e7a-4673-ab5f-362ed1ad09ad None admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:40.447371 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc4c95-abdf-484f-815e-0a25094afea0 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:40.448880 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41084568-3e7a-4673-ab5f-362ed1ad09ad None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:40.449177 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41084568-3e7a-4673-ab5f-362ed1ad09ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:40.450639 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41084568-3e7a-4673-ab5f-362ed1ad09ad None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:40.475758 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 410/803] 10.222.0.32 () {56 vars in 1133 bytes} [Tue Apr 12 02:51:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:51:40.475758 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41084568-3e7a-4673-ab5f-362ed1ad09ad None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:40.593650 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41084568-3e7a-4673-ab5f-362ed1ad09ad None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:40.606897 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc4c95-abdf-484f-815e-0a25094afea0 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:40.637265 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467a35f-54e4-43cd-9f36-017dc3122419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:40.638188 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467a35f-54e4-43cd-9f36-017dc3122419 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:40.638599 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467a35f-54e4-43cd-9f36-017dc3122419 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:40.639017 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467a35f-54e4-43cd-9f36-017dc3122419 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:40.644246 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86225335-67d1-445f-a585-3d0885c1115c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:40.645039 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86225335-67d1-445f-a585-3d0885c1115c None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:40.645365 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86225335-67d1-445f-a585-3d0885c1115c None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:40.645625 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86225335-67d1-445f-a585-3d0885c1115c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:40.656887 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86225335-67d1-445f-a585-3d0885c1115c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:51:40.664566 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-86225335-67d1-445f-a585-3d0885c1115c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 02:51:40.666132 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 394/804] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 02:51:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:40.672033 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86225335-67d1-445f-a585-3d0885c1115c None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:40.709001 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467a35f-54e4-43cd-9f36-017dc3122419 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:40.710722 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467a35f-54e4-43cd-9f36-017dc3122419 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:40.770420 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86225335-67d1-445f-a585-3d0885c1115c None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:40.803413 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b69c0-b96e-4122-ad6c-2504a9426cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:40.804303 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b69c0-b96e-4122-ad6c-2504a9426cb8 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:40.804421 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b69c0-b96e-4122-ad6c-2504a9426cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:40.804679 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b69c0-b96e-4122-ad6c-2504a9426cb8 None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:40.805418 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b69c0-b96e-4122-ad6c-2504a9426cb8 None admin] RBAC: Adding query filter params (name=service) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:40.805705 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b69c0-b96e-4122-ad6c-2504a9426cb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:40.807237 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b69c0-b96e-4122-ad6c-2504a9426cb8 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:40.813040 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 411/805] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:51:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 02:51:40.814474 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467a35f-54e4-43cd-9f36-017dc3122419 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:40.815887 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 395/806] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 02:51:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:51:40.822970 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b69c0-b96e-4122-ad6c-2504a9426cb8 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:40.910600 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467a35f-54e4-43cd-9f36-017dc3122419 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:40.920146 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b69c0-b96e-4122-ad6c-2504a9426cb8 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:40.943502 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee0822e-6603-4fe6-b8c4-b0f3f1353677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:40.944546 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0822e-6603-4fe6-b8c4-b0f3f1353677 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:40.944977 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0822e-6603-4fe6-b8c4-b0f3f1353677 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:40.945379 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0822e-6603-4fe6-b8c4-b0f3f1353677 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:40.952419 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2ee5f-ca78-438a-bfd4-08b7aae8bb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:40.953525 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2ee5f-ca78-438a-bfd4-08b7aae8bb01 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:40.953794 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2ee5f-ca78-438a-bfd4-08b7aae8bb01 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:40.954056 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2ee5f-ca78-438a-bfd4-08b7aae8bb01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:40.957426 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee0822e-6603-4fe6-b8c4-b0f3f1353677 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:40.959048 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee0822e-6603-4fe6-b8c4-b0f3f1353677 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:40.964784 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2ee5f-ca78-438a-bfd4-08b7aae8bb01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:40.966544 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2ee5f-ca78-438a-bfd4-08b7aae8bb01 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:40.976749 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-dee0822e-6603-4fe6-b8c4-b0f3f1353677 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:40.982931 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 412/807] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:51:40.983058 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-37d2ee5f-ca78-438a-bfd4-08b7aae8bb01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:40.984596 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e8277-190a-459a-9bee-746b32d80c9b None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:40.985013 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e8277-190a-459a-9bee-746b32d80c9b None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:40.985874 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e8277-190a-459a-9bee-746b32d80c9b None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:40.987299 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 413/809] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:40.987884 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 396/809] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:40.988383 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e8277-190a-459a-9bee-746b32d80c9b None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:40.989830 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2ee5f-ca78-438a-bfd4-08b7aae8bb01 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:41.087197 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2ee5f-ca78-438a-bfd4-08b7aae8bb01 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:41.089066 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e8277-190a-459a-9bee-746b32d80c9b None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:41.121723 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d232b-c732-45f5-b554-ccb1786989ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:41.122489 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d232b-c732-45f5-b554-ccb1786989ac None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:41.122815 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d232b-c732-45f5-b554-ccb1786989ac None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:41.123171 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d232b-c732-45f5-b554-ccb1786989ac None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:41.124024 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d232b-c732-45f5-b554-ccb1786989ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:41.124348 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5065acd7-3bad-419f-a5b7-954a1279f4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:41.124488 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d232b-c732-45f5-b554-ccb1786989ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:41.125276 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065acd7-3bad-419f-a5b7-954a1279f4de None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:41.125687 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065acd7-3bad-419f-a5b7-954a1279f4de None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:41.126081 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065acd7-3bad-419f-a5b7-954a1279f4de None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:41.126185 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d232b-c732-45f5-b554-ccb1786989ac None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:41.127019 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5065acd7-3bad-419f-a5b7-954a1279f4de None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:41.127448 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5065acd7-3bad-419f-a5b7-954a1279f4de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:41.128935 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5065acd7-3bad-419f-a5b7-954a1279f4de None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:41.144898 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 397/811] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:51:41.144898 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169e46f-001d-4f5a-8e43-dfd8b0172211 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:41.144898 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169e46f-001d-4f5a-8e43-dfd8b0172211 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:41.144898 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169e46f-001d-4f5a-8e43-dfd8b0172211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:41.145743 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 414/811] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:41.146829 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5065acd7-3bad-419f-a5b7-954a1279f4de None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:41.161355 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-b169e46f-001d-4f5a-8e43-dfd8b0172211 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:41.162471 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-b169e46f-001d-4f5a-8e43-dfd8b0172211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:41.227632 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 398/812] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:51:41.228554 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169e46f-001d-4f5a-8e43-dfd8b0172211 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:41.246856 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5065acd7-3bad-419f-a5b7-954a1279f4de None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:41.284145 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0e270-dcf9-4e3b-a148-f647f640390d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:41.285243 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0e270-dcf9-4e3b-a148-f647f640390d None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:41.285654 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0e270-dcf9-4e3b-a148-f647f640390d None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:41.286055 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0e270-dcf9-4e3b-a148-f647f640390d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:41.294957 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0e270-dcf9-4e3b-a148-f647f640390d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:41.296622 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0e270-dcf9-4e3b-a148-f647f640390d None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:41.310743 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-11c0e270-dcf9-4e3b-a148-f647f640390d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 12 02:51:41.312537 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 415/813] 10.222.0.32 () {56 vars in 1117 bytes} [Tue Apr 12 02:51:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:41.313445 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0e270-dcf9-4e3b-a148-f647f640390d None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:41.331470 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169e46f-001d-4f5a-8e43-dfd8b0172211 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:41.364562 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e14fa-51fe-4811-97e0-7a2737780278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:41.365356 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e14fa-51fe-4811-97e0-7a2737780278 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:41.365617 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e14fa-51fe-4811-97e0-7a2737780278 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:41.365880 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e14fa-51fe-4811-97e0-7a2737780278 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:41.373344 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e14fa-51fe-4811-97e0-7a2737780278 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:41.374875 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e14fa-51fe-4811-97e0-7a2737780278 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:41.388123 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-6f3e14fa-51fe-4811-97e0-7a2737780278 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:51:41.394171 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 399/814] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:51:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:41.394171 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e14fa-51fe-4811-97e0-7a2737780278 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:41.418343 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0e270-dcf9-4e3b-a148-f647f640390d None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:41.454632 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9714859-ce38-42db-a50e-19774b090507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:41.455479 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9714859-ce38-42db-a50e-19774b090507 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:41.455781 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9714859-ce38-42db-a50e-19774b090507 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:41.456049 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9714859-ce38-42db-a50e-19774b090507 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:41.456698 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9714859-ce38-42db-a50e-19774b090507 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:41.458067 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9714859-ce38-42db-a50e-19774b090507 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:41.469744 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-a9714859-ce38-42db-a50e-19774b090507 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 12 02:51:41.471333 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 416/815] 10.222.0.32 () {56 vars in 1129 bytes} [Tue Apr 12 02:51:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:41.472193 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9714859-ce38-42db-a50e-19774b090507 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:41.496120 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e14fa-51fe-4811-97e0-7a2737780278 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:41.531259 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc708c9-ba58-4138-8bd0-8693acea66dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:41.531951 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc708c9-ba58-4138-8bd0-8693acea66dd None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:41.532225 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc708c9-ba58-4138-8bd0-8693acea66dd None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:41.532490 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc708c9-ba58-4138-8bd0-8693acea66dd None admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:41.533315 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc708c9-ba58-4138-8bd0-8693acea66dd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:41.533621 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc708c9-ba58-4138-8bd0-8693acea66dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:41.535066 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc708c9-ba58-4138-8bd0-8693acea66dd None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:41.553353 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 400/816] 10.222.0.32 () {56 vars in 1149 bytes} [Tue Apr 12 02:51:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:41.554213 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc708c9-ba58-4138-8bd0-8693acea66dd None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:41.582168 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9714859-ce38-42db-a50e-19774b090507 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:41.627896 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa02223-e4f9-4497-822c-64662fdf4012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:41.628967 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa02223-e4f9-4497-822c-64662fdf4012 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:41.629321 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa02223-e4f9-4497-822c-64662fdf4012 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:41.629851 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa02223-e4f9-4497-822c-64662fdf4012 None admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:41.630810 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa02223-e4f9-4497-822c-64662fdf4012 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:41.631126 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa02223-e4f9-4497-822c-64662fdf4012 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:41.633353 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa02223-e4f9-4497-822c-64662fdf4012 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:41.648898 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 417/817] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 02:51:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:41.650075 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa02223-e4f9-4497-822c-64662fdf4012 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:41.673634 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc708c9-ba58-4138-8bd0-8693acea66dd None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:41.713077 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bf088-adbc-4736-ad0f-d762b4787461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:41.713775 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bf088-adbc-4736-ad0f-d762b4787461 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:41.714052 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bf088-adbc-4736-ad0f-d762b4787461 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:41.714321 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bf088-adbc-4736-ad0f-d762b4787461 None admin] PATH_INFO: `/v3/services` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:41.715019 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4bf088-adbc-4736-ad0f-d762b4787461 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:41.715321 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4bf088-adbc-4736-ad0f-d762b4787461 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:41.716761 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4bf088-adbc-4736-ad0f-d762b4787461 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:41.722343 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 401/818] 10.222.0.32 () {56 vars in 1124 bytes} [Tue Apr 12 02:51:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:41.723390 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bf088-adbc-4736-ad0f-d762b4787461 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:41.760842 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa02223-e4f9-4497-822c-64662fdf4012 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:41.795740 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6d51c-bf15-4391-ab85-c91d88050ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:41.796779 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6d51c-bf15-4391-ab85-c91d88050ed8 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:41.797188 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6d51c-bf15-4391-ab85-c91d88050ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:41.797601 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6d51c-bf15-4391-ab85-c91d88050ed8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:41.808265 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf6d51c-bf15-4391-ab85-c91d88050ed8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:41.809966 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf6d51c-bf15-4391-ab85-c91d88050ed8 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:41.829086 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-caf6d51c-bf15-4391-ab85-c91d88050ed8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:41.830897 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bf088-adbc-4736-ad0f-d762b4787461 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:41.835040 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 418/819] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:41.836052 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6d51c-bf15-4391-ab85-c91d88050ed8 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:41.866346 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c60031-4cf2-44cb-8ce9-cb6435f3bf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:41.867013 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c60031-4cf2-44cb-8ce9-cb6435f3bf3e None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:41.867290 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c60031-4cf2-44cb-8ce9-cb6435f3bf3e None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:41.867562 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c60031-4cf2-44cb-8ce9-cb6435f3bf3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:41.868505 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c60031-4cf2-44cb-8ce9-cb6435f3bf3e None admin] RBAC: Adding query filter params (role.id=c0f19d3800f44637822d5162ffe4b497, scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed, user.id=43ee5cb310fd4538910e40ea7082708c) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:41.868718 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c60031-4cf2-44cb-8ce9-cb6435f3bf3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:41.870270 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c60031-4cf2-44cb-8ce9-cb6435f3bf3e None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:41.876194 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 402/820] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:51:41 2022] GET /identity/v3/role_assignments?user.id=43ee5cb310fd4538910e40ea7082708c&scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed&role.id=c0f19d3800f44637822d5162ffe4b497 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:41.877290 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c60031-4cf2-44cb-8ce9-cb6435f3bf3e None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:41.937609 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6d51c-bf15-4391-ab85-c91d88050ed8 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:41.977533 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f27cc-81da-441c-92a5-94aea5295d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:41.979088 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f27cc-81da-441c-92a5-94aea5295d38 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:41.979510 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f27cc-81da-441c-92a5-94aea5295d38 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:41.979987 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f27cc-81da-441c-92a5-94aea5295d38 None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:41.981282 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f27cc-81da-441c-92a5-94aea5295d38 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:41.982089 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f27cc-81da-441c-92a5-94aea5295d38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:41.983936 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f27cc-81da-441c-92a5-94aea5295d38 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:41.990988 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 419/821] 10.222.0.32 () {56 vars in 1124 bytes} [Tue Apr 12 02:51:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:41.992716 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667fade-8ff2-42d7-8541-a4d699a03450 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:41.993149 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667fade-8ff2-42d7-8541-a4d699a03450 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:41.993556 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667fade-8ff2-42d7-8541-a4d699a03450 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:41.995517 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 420/822] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:41.996500 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667fade-8ff2-42d7-8541-a4d699a03450 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:42.017183 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c60031-4cf2-44cb-8ce9-cb6435f3bf3e None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:42.060178 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527fa76-192b-4905-94f8-3876608ba196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:42.060980 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527fa76-192b-4905-94f8-3876608ba196 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:42.061466 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527fa76-192b-4905-94f8-3876608ba196 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:42.061906 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527fa76-192b-4905-94f8-3876608ba196 None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:42.063304 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6527fa76-192b-4905-94f8-3876608ba196 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:42.063866 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6527fa76-192b-4905-94f8-3876608ba196 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:42.065891 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6527fa76-192b-4905-94f8-3876608ba196 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:42.089345 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 403/823] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:42.091049 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38dfc3b-c17b-4959-9be1-5a4fd7e4678a None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:42.091506 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38dfc3b-c17b-4959-9be1-5a4fd7e4678a None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:42.091971 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38dfc3b-c17b-4959-9be1-5a4fd7e4678a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:42.108969 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-a38dfc3b-c17b-4959-9be1-5a4fd7e4678a None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:42.110431 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-a38dfc3b-c17b-4959-9be1-5a4fd7e4678a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:42.119807 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667fade-8ff2-42d7-8541-a4d699a03450 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:42.166293 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98363247-09da-4e42-8bfb-692aad362086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:42.167597 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98363247-09da-4e42-8bfb-692aad362086 None admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:42.168051 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98363247-09da-4e42-8bfb-692aad362086 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:42.168472 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98363247-09da-4e42-8bfb-692aad362086 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:42.169380 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98363247-09da-4e42-8bfb-692aad362086 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:42.171594 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98363247-09da-4e42-8bfb-692aad362086 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:42.184417 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 404/824] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:51:42.186064 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38dfc3b-c17b-4959-9be1-5a4fd7e4678a None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:42.198128 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 421/825] 10.222.0.32 () {60 vars in 1144 bytes} [Tue Apr 12 02:51:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 02:51:42.255032 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98363247-09da-4e42-8bfb-692aad362086 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:42.312334 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38dfc3b-c17b-4959-9be1-5a4fd7e4678a None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:42.365068 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4747e-8ae4-4e85-96e6-ea329e97b2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:42.365872 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4747e-8ae4-4e85-96e6-ea329e97b2d6 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:42.366144 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4747e-8ae4-4e85-96e6-ea329e97b2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:42.366410 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4747e-8ae4-4e85-96e6-ea329e97b2d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:42.369233 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98363247-09da-4e42-8bfb-692aad362086 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:42.374773 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4747e-8ae4-4e85-96e6-ea329e97b2d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:42.376275 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4747e-8ae4-4e85-96e6-ea329e97b2d6 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:42.404000 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d0948-34eb-4f7e-bcf2-99f4d2f693c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:42.404843 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d0948-34eb-4f7e-bcf2-99f4d2f693c2 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:42.405117 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d0948-34eb-4f7e-bcf2-99f4d2f693c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:42.405380 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d0948-34eb-4f7e-bcf2-99f4d2f693c2 None admin] PATH_INFO: `/v3/services/network` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:42.405571 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-70c4747e-8ae4-4e85-96e6-ea329e97b2d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:51:42.406022 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d0948-34eb-4f7e-bcf2-99f4d2f693c2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:42.407194 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 405/826] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:51:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:42.407373 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d0948-34eb-4f7e-bcf2-99f4d2f693c2 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:42.412707 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4747e-8ae4-4e85-96e6-ea329e97b2d6 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:42.419079 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-fc4d0948-34eb-4f7e-bcf2-99f4d2f693c2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 12 02:51:42.420721 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 422/827] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:51:42 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:51:42.440060 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d0948-34eb-4f7e-bcf2-99f4d2f693c2 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:42.533202 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4747e-8ae4-4e85-96e6-ea329e97b2d6 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:42.569167 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29a3cc-19c5-4ddb-b272-9655645b2480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:42.569821 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29a3cc-19c5-4ddb-b272-9655645b2480 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:42.570093 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29a3cc-19c5-4ddb-b272-9655645b2480 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:42.570393 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29a3cc-19c5-4ddb-b272-9655645b2480 None admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:42.571167 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29a3cc-19c5-4ddb-b272-9655645b2480 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:42.571463 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29a3cc-19c5-4ddb-b272-9655645b2480 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:42.573143 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29a3cc-19c5-4ddb-b272-9655645b2480 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:42.586006 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 406/828] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 02:51:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:42.587832 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d0948-34eb-4f7e-bcf2-99f4d2f693c2 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:42.591693 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29a3cc-19c5-4ddb-b272-9655645b2480 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:42.622216 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c2f3e-369f-4042-939e-f35db74e3184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:42.622615 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c2f3e-369f-4042-939e-f35db74e3184 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:42.622885 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c2f3e-369f-4042-939e-f35db74e3184 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:42.623147 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c2f3e-369f-4042-939e-f35db74e3184 None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:42.623871 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c2f3e-369f-4042-939e-f35db74e3184 None admin] RBAC: Adding query filter params (name=network) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:42.624223 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c2f3e-369f-4042-939e-f35db74e3184 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:42.625517 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c2f3e-369f-4042-939e-f35db74e3184 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:42.634607 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 423/829] 10.222.0.32 () {56 vars in 1112 bytes} [Tue Apr 12 02:51:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:42.635986 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c2f3e-369f-4042-939e-f35db74e3184 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:42.718956 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29a3cc-19c5-4ddb-b272-9655645b2480 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:42.751175 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c2f3e-369f-4042-939e-f35db74e3184 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:42.767140 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc126622-a32e-4887-8ad1-0551366d9006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:42.769618 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc126622-a32e-4887-8ad1-0551366d9006 None admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:42.769892 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc126622-a32e-4887-8ad1-0551366d9006 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:42.770158 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc126622-a32e-4887-8ad1-0551366d9006 None admin] PATH_INFO: `/v3/projects/82cb5f6cfa0e46b28a37565fc2b560ed/users/83115653901749f6ade6638593fb54e9/roles/a8b79923b07243e385187b6641381ee1` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:42.797527 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc126622-a32e-4887-8ad1-0551366d9006 None admin] RBAC: Authorizing `identity:create_grant(project_id=82cb5f6cfa0e46b28a37565fc2b560ed, user_id=83115653901749f6ade6638593fb54e9, role_id=a8b79923b07243e385187b6641381ee1)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:42.799110 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc126622-a32e-4887-8ad1-0551366d9006 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:42.805430 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8e48c-a29f-42bd-a014-576e8e180965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:42.806090 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8e48c-a29f-42bd-a014-576e8e180965 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:42.806358 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8e48c-a29f-42bd-a014-576e8e180965 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:42.806673 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8e48c-a29f-42bd-a014-576e8e180965 None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:42.807583 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8e48c-a29f-42bd-a014-576e8e180965 None admin] RBAC: Adding query filter params (type=network) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:42.808020 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8e48c-a29f-42bd-a014-576e8e180965 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:42.809899 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8e48c-a29f-42bd-a014-576e8e180965 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:42.819009 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 424/830] 10.222.0.32 () {56 vars in 1112 bytes} [Tue Apr 12 02:51:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:42.829223 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 407/831] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 02:51:42 2022] PUT /identity/v3/projects/82cb5f6cfa0e46b28a37565fc2b560ed/users/83115653901749f6ade6638593fb54e9/roles/a8b79923b07243e385187b6641381ee1 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 02:51:42.830651 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8e48c-a29f-42bd-a014-576e8e180965 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:42.950944 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8e48c-a29f-42bd-a014-576e8e180965 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:42.984474 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09de3e1-0881-4c31-8a65-91508d2209bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:42.985148 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09de3e1-0881-4c31-8a65-91508d2209bd None admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:42.985476 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09de3e1-0881-4c31-8a65-91508d2209bd None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:42.985739 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09de3e1-0881-4c31-8a65-91508d2209bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:42.986539 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09de3e1-0881-4c31-8a65-91508d2209bd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:42.988141 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09de3e1-0881-4c31-8a65-91508d2209bd None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:43.017854 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 425/832] 10.222.0.32 () {60 vars in 1144 bytes} [Tue Apr 12 02:51:42 2022] POST /identity/v3/endpoints => generated 327 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 02:51:43.114654 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a60d3-c55e-4754-952e-aee27c2fa220 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:43.114832 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a60d3-c55e-4754-952e-aee27c2fa220 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:43.115105 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a60d3-c55e-4754-952e-aee27c2fa220 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:43.116492 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 408/833] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:43.122246 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb942c3-7f63-4bda-8e69-5997f10d0f23 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:43.122530 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb942c3-7f63-4bda-8e69-5997f10d0f23 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:43.122785 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb942c3-7f63-4bda-8e69-5997f10d0f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:43.141894 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-3fb942c3-7f63-4bda-8e69-5997f10d0f23 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:43.143462 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-3fb942c3-7f63-4bda-8e69-5997f10d0f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:43.237383 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 426/834] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:51:43.283437 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a60d3-c55e-4754-952e-aee27c2fa220 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:43.416331 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a60d3-c55e-4754-952e-aee27c2fa220 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:43.459229 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c078317-d5ad-47bd-a22c-266355406e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:43.460062 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c078317-d5ad-47bd-a22c-266355406e6e None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:43.460339 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c078317-d5ad-47bd-a22c-266355406e6e None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:43.460607 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c078317-d5ad-47bd-a22c-266355406e6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:43.473724 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c078317-d5ad-47bd-a22c-266355406e6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:51:43.480732 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-0c078317-d5ad-47bd-a22c-266355406e6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 02:51:43.482256 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 409/835] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 02:51:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:43.487924 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb942c3-7f63-4bda-8e69-5997f10d0f23 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:43.585796 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb942c3-7f63-4bda-8e69-5997f10d0f23 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:43.618936 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895fe0a-31b6-45cf-b0f4-7cd0120e2a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:43.619850 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895fe0a-31b6-45cf-b0f4-7cd0120e2a47 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:43.620138 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895fe0a-31b6-45cf-b0f4-7cd0120e2a47 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:43.620382 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895fe0a-31b6-45cf-b0f4-7cd0120e2a47 None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:43.621122 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895fe0a-31b6-45cf-b0f4-7cd0120e2a47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:43.621421 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895fe0a-31b6-45cf-b0f4-7cd0120e2a47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:43.622959 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895fe0a-31b6-45cf-b0f4-7cd0120e2a47 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:43.631381 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 427/836] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:51:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:43.636923 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c078317-d5ad-47bd-a22c-266355406e6e None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:43.734180 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c078317-d5ad-47bd-a22c-266355406e6e None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:43.772186 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907e595-97a0-4716-a6c3-7516745ccc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:43.772981 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907e595-97a0-4716-a6c3-7516745ccc33 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:43.773252 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907e595-97a0-4716-a6c3-7516745ccc33 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:43.773518 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907e595-97a0-4716-a6c3-7516745ccc33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:43.784260 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7907e595-97a0-4716-a6c3-7516745ccc33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:43.785720 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7907e595-97a0-4716-a6c3-7516745ccc33 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:43.802224 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-7907e595-97a0-4716-a6c3-7516745ccc33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:43.803762 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 410/837] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:43.809356 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895fe0a-31b6-45cf-b0f4-7cd0120e2a47 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:43.910684 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895fe0a-31b6-45cf-b0f4-7cd0120e2a47 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:43.947035 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ec33b-8f45-486b-bab4-3478ba022b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:43.947794 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ec33b-8f45-486b-bab4-3478ba022b34 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:43.948077 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ec33b-8f45-486b-bab4-3478ba022b34 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:43.948352 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ec33b-8f45-486b-bab4-3478ba022b34 None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:43.949077 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ec33b-8f45-486b-bab4-3478ba022b34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:43.949379 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ec33b-8f45-486b-bab4-3478ba022b34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:43.950758 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ec33b-8f45-486b-bab4-3478ba022b34 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:43.963823 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 428/838] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:43.969570 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907e595-97a0-4716-a6c3-7516745ccc33 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:44.072085 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907e595-97a0-4716-a6c3-7516745ccc33 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:44.107522 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6c30a-1c47-4a1e-a443-4e8cc4574d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:44.108348 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6c30a-1c47-4a1e-a443-4e8cc4574d62 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:44.108623 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6c30a-1c47-4a1e-a443-4e8cc4574d62 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:44.108885 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6c30a-1c47-4a1e-a443-4e8cc4574d62 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:44.116521 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c6c30a-1c47-4a1e-a443-4e8cc4574d62 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:44.117966 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c6c30a-1c47-4a1e-a443-4e8cc4574d62 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:44.131535 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-61c6c30a-1c47-4a1e-a443-4e8cc4574d62 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 12 02:51:44.133079 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 411/839] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 02:51:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:44.139010 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ec33b-8f45-486b-bab4-3478ba022b34 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:44.238802 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ec33b-8f45-486b-bab4-3478ba022b34 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:44.274437 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc021bb-5e51-4aab-a7da-b876ed11269d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:44.275113 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc021bb-5e51-4aab-a7da-b876ed11269d None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:44.275390 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc021bb-5e51-4aab-a7da-b876ed11269d None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:44.275767 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc021bb-5e51-4aab-a7da-b876ed11269d None admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:44.276645 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc021bb-5e51-4aab-a7da-b876ed11269d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:44.276978 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc021bb-5e51-4aab-a7da-b876ed11269d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:44.278404 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc021bb-5e51-4aab-a7da-b876ed11269d None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:44.297866 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 429/840] 10.222.0.32 () {56 vars in 1135 bytes} [Tue Apr 12 02:51:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:44.303963 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6c30a-1c47-4a1e-a443-4e8cc4574d62 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:44.406316 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6c30a-1c47-4a1e-a443-4e8cc4574d62 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:44.437331 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa4d58-49ab-465b-8177-27426483b965 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:44.437644 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa4d58-49ab-465b-8177-27426483b965 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:44.437886 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa4d58-49ab-465b-8177-27426483b965 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:44.439514 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 430/841] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:44.441146 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3746411-2857-456e-8602-b6d35eb1758e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:44.442030 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3746411-2857-456e-8602-b6d35eb1758e None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:44.442491 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3746411-2857-456e-8602-b6d35eb1758e None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:44.442976 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3746411-2857-456e-8602-b6d35eb1758e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:44.444458 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6522b-93c0-4225-9062-cbbaca377a66 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:44.444795 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6522b-93c0-4225-9062-cbbaca377a66 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:44.445071 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6522b-93c0-4225-9062-cbbaca377a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:44.461665 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-01c6522b-93c0-4225-9062-cbbaca377a66 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:44.462831 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-01c6522b-93c0-4225-9062-cbbaca377a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:44.511006 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3746411-2857-456e-8602-b6d35eb1758e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:44.512844 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3746411-2857-456e-8602-b6d35eb1758e None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:44.535993 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 431/842] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 02:51:44.555755 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6522b-93c0-4225-9062-cbbaca377a66 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:44.615672 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 412/843] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:51:44 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 02:51:44.623052 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3746411-2857-456e-8602-b6d35eb1758e None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:44.655372 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6522b-93c0-4225-9062-cbbaca377a66 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:44.688982 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f0e55-a497-46ad-9014-7c8aa130d0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:44.689867 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f0e55-a497-46ad-9014-7c8aa130d0c5 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:44.690322 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f0e55-a497-46ad-9014-7c8aa130d0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:44.690766 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f0e55-a497-46ad-9014-7c8aa130d0c5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:44.691862 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f0e55-a497-46ad-9014-7c8aa130d0c5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:44.693228 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f0e55-a497-46ad-9014-7c8aa130d0c5 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:44.707547 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-9d2f0e55-a497-46ad-9014-7c8aa130d0c5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 12 02:51:44.714957 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 432/844] 10.222.0.32 () {56 vars in 1132 bytes} [Tue Apr 12 02:51:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:51:44.717082 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f0e55-a497-46ad-9014-7c8aa130d0c5 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:44.740600 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3746411-2857-456e-8602-b6d35eb1758e None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:44.782737 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb89c4-ab0c-49ec-943f-f5e5f119e9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:44.784386 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb89c4-ab0c-49ec-943f-f5e5f119e9e2 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:44.785116 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb89c4-ab0c-49ec-943f-f5e5f119e9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:44.785642 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb89c4-ab0c-49ec-943f-f5e5f119e9e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:44.799454 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb89c4-ab0c-49ec-943f-f5e5f119e9e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:44.801271 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb89c4-ab0c-49ec-943f-f5e5f119e9e2 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:44.823635 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-3deb89c4-ab0c-49ec-943f-f5e5f119e9e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:44.826214 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 413/845] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:44.827580 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f0e55-a497-46ad-9014-7c8aa130d0c5 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:44.832018 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb89c4-ab0c-49ec-943f-f5e5f119e9e2 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:44.866754 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e890ddd-9ebc-4ecb-93ca-f3472f9bc776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:44.867523 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e890ddd-9ebc-4ecb-93ca-f3472f9bc776 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:44.867912 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e890ddd-9ebc-4ecb-93ca-f3472f9bc776 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:44.868251 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e890ddd-9ebc-4ecb-93ca-f3472f9bc776 None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:44.869029 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e890ddd-9ebc-4ecb-93ca-f3472f9bc776 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:44.869482 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e890ddd-9ebc-4ecb-93ca-f3472f9bc776 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:44.870896 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e890ddd-9ebc-4ecb-93ca-f3472f9bc776 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:44.875762 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 433/846] 10.222.0.32 () {56 vars in 1126 bytes} [Tue Apr 12 02:51:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:51:44.881253 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e890ddd-9ebc-4ecb-93ca-f3472f9bc776 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:44.942637 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb89c4-ab0c-49ec-943f-f5e5f119e9e2 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:44.982362 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f19fa8-cec8-4389-9d4c-14c2290b4e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:44.983302 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f19fa8-cec8-4389-9d4c-14c2290b4e23 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:44.983584 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f19fa8-cec8-4389-9d4c-14c2290b4e23 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:44.983899 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f19fa8-cec8-4389-9d4c-14c2290b4e23 None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:44.984616 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f19fa8-cec8-4389-9d4c-14c2290b4e23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:44.984918 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f19fa8-cec8-4389-9d4c-14c2290b4e23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:44.986829 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f19fa8-cec8-4389-9d4c-14c2290b4e23 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:45.005530 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 414/847] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:45.007263 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f19fa8-cec8-4389-9d4c-14c2290b4e23 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:45.008465 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e890ddd-9ebc-4ecb-93ca-f3472f9bc776 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:45.042223 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f71c3c-a044-4153-8792-12209e4b9ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:45.042916 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f71c3c-a044-4153-8792-12209e4b9ddf None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:45.043193 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f71c3c-a044-4153-8792-12209e4b9ddf None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:45.043463 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f71c3c-a044-4153-8792-12209e4b9ddf None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:45.044228 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f71c3c-a044-4153-8792-12209e4b9ddf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:45.044530 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f71c3c-a044-4153-8792-12209e4b9ddf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:45.045985 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f71c3c-a044-4153-8792-12209e4b9ddf None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:45.059915 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 434/848] 10.222.0.32 () {56 vars in 1126 bytes} [Tue Apr 12 02:51:44 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:51:45.109330 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b3d71-5427-43de-88c8-3d208eb6646f None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:45.109616 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b3d71-5427-43de-88c8-3d208eb6646f None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:45.109889 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b3d71-5427-43de-88c8-3d208eb6646f None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:45.111519 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 435/849] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:45.118751 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24185d-ca10-4f1d-af28-90eef03088cd None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:45.118751 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24185d-ca10-4f1d-af28-90eef03088cd None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:45.119025 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24185d-ca10-4f1d-af28-90eef03088cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:45.122364 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f19fa8-cec8-4389-9d4c-14c2290b4e23 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:45.137250 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-5f24185d-ca10-4f1d-af28-90eef03088cd None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:45.138457 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-5f24185d-ca10-4f1d-af28-90eef03088cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:45.166675 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2436745c-ad02-4f37-92b1-9c51eba19024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:45.168055 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436745c-ad02-4f37-92b1-9c51eba19024 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:45.168487 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436745c-ad02-4f37-92b1-9c51eba19024 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:45.168906 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436745c-ad02-4f37-92b1-9c51eba19024 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:45.176526 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2436745c-ad02-4f37-92b1-9c51eba19024 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:45.178262 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2436745c-ad02-4f37-92b1-9c51eba19024 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:45.193060 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-2436745c-ad02-4f37-92b1-9c51eba19024 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:51:45.194863 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 415/850] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:51:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:45.205117 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2436745c-ad02-4f37-92b1-9c51eba19024 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:45.211228 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 436/851] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 02:51:45.238467 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24185d-ca10-4f1d-af28-90eef03088cd None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:45.331203 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2436745c-ad02-4f37-92b1-9c51eba19024 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:45.360057 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24185d-ca10-4f1d-af28-90eef03088cd None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:45.372045 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d2511-0b50-403e-94c2-373ff56e6597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:45.372704 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d2511-0b50-403e-94c2-373ff56e6597 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:45.372971 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d2511-0b50-403e-94c2-373ff56e6597 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:45.373232 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d2511-0b50-403e-94c2-373ff56e6597 None admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:45.374014 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d2511-0b50-403e-94c2-373ff56e6597 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:45.374311 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d2511-0b50-403e-94c2-373ff56e6597 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:45.375815 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d2511-0b50-403e-94c2-373ff56e6597 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:45.387763 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 416/852] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 02:51:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:45.397282 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d2511-0b50-403e-94c2-373ff56e6597 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:45.401019 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdee06-a052-41ba-8a1a-28ac61d21d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:45.402084 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdee06-a052-41ba-8a1a-28ac61d21d35 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:45.402546 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdee06-a052-41ba-8a1a-28ac61d21d35 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:45.403046 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdee06-a052-41ba-8a1a-28ac61d21d35 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:45.403899 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cdee06-a052-41ba-8a1a-28ac61d21d35 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:45.405532 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cdee06-a052-41ba-8a1a-28ac61d21d35 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:45.417224 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-25cdee06-a052-41ba-8a1a-28ac61d21d35 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 12 02:51:45.418736 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 437/853] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 02:51:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:51:45.427835 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdee06-a052-41ba-8a1a-28ac61d21d35 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:45.498628 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d2511-0b50-403e-94c2-373ff56e6597 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:45.531032 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2950a9a-7e3f-402c-ab79-a835a241b969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:45.531674 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2950a9a-7e3f-402c-ab79-a835a241b969 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:45.531969 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2950a9a-7e3f-402c-ab79-a835a241b969 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:45.532074 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdee06-a052-41ba-8a1a-28ac61d21d35 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:45.532255 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2950a9a-7e3f-402c-ab79-a835a241b969 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:45.533036 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2950a9a-7e3f-402c-ab79-a835a241b969 None admin] RBAC: Adding query filter params (role.id=c0f19d3800f44637822d5162ffe4b497, scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed, user.id=8e8d78f92f12405fb746ddeb2579bd2e) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:45.533378 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2950a9a-7e3f-402c-ab79-a835a241b969 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:45.534779 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2950a9a-7e3f-402c-ab79-a835a241b969 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:45.540677 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 417/854] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:51:45 2022] GET /identity/v3/role_assignments?user.id=8e8d78f92f12405fb746ddeb2579bd2e&scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed&role.id=c0f19d3800f44637822d5162ffe4b497 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:45.541760 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93df82-d19e-46e0-9311-4af38565a1d0 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:45.542033 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93df82-d19e-46e0-9311-4af38565a1d0 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:45.542338 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93df82-d19e-46e0-9311-4af38565a1d0 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:45.547971 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 418/855] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:45.549247 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39388db-9c7e-4312-b45d-80e3175a054a None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:45.549527 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39388db-9c7e-4312-b45d-80e3175a054a None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:45.549793 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39388db-9c7e-4312-b45d-80e3175a054a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:45.567649 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9429ca-bde2-4dbe-9196-3e987aab2798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:45.568365 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9429ca-bde2-4dbe-9196-3e987aab2798 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:45.568641 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9429ca-bde2-4dbe-9196-3e987aab2798 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:45.568911 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9429ca-bde2-4dbe-9196-3e987aab2798 None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:45.569626 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9429ca-bde2-4dbe-9196-3e987aab2798 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:45.569925 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9429ca-bde2-4dbe-9196-3e987aab2798 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:45.571320 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9429ca-bde2-4dbe-9196-3e987aab2798 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:45.575354 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-d39388db-9c7e-4312-b45d-80e3175a054a None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:45.581406 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 438/856] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 02:51:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:45.581617 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-d39388db-9c7e-4312-b45d-80e3175a054a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:45.583048 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9429ca-bde2-4dbe-9196-3e987aab2798 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:45.679483 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 419/857] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 02:51:45.705313 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39388db-9c7e-4312-b45d-80e3175a054a None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:45.713052 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9429ca-bde2-4dbe-9196-3e987aab2798 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:45.749384 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c25c1c-4755-45f5-b80c-3a04f5d69e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:45.750498 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c25c1c-4755-45f5-b80c-3a04f5d69e3b None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:45.750982 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c25c1c-4755-45f5-b80c-3a04f5d69e3b None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:45.751487 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c25c1c-4755-45f5-b80c-3a04f5d69e3b None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:45.752412 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c25c1c-4755-45f5-b80c-3a04f5d69e3b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:45.752906 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c25c1c-4755-45f5-b80c-3a04f5d69e3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:45.754438 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c25c1c-4755-45f5-b80c-3a04f5d69e3b None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:45.760675 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 439/858] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 02:51:45 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:45.826419 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39388db-9c7e-4312-b45d-80e3175a054a None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:45.863098 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf8cc3-5bb2-4b1a-8c67-1745028fea89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:45.863940 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf8cc3-5bb2-4b1a-8c67-1745028fea89 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:45.864211 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf8cc3-5bb2-4b1a-8c67-1745028fea89 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:45.864531 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf8cc3-5bb2-4b1a-8c67-1745028fea89 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:45.876153 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf8cc3-5bb2-4b1a-8c67-1745028fea89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:51:45.883226 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-eecf8cc3-5bb2-4b1a-8c67-1745028fea89 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 02:51:45.884843 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 420/859] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 02:51:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:51:45.891313 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c25c1c-4755-45f5-b80c-3a04f5d69e3b None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:46.001731 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c25c1c-4755-45f5-b80c-3a04f5d69e3b None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:46.033994 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7852c8-cca4-4080-a9d0-b079eaf0d27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:46.034659 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7852c8-cca4-4080-a9d0-b079eaf0d27d None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:46.034931 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7852c8-cca4-4080-a9d0-b079eaf0d27d None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:46.035188 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7852c8-cca4-4080-a9d0-b079eaf0d27d None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:46.035951 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7852c8-cca4-4080-a9d0-b079eaf0d27d None admin] RBAC: Adding query filter params (name=service) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:46.036246 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7852c8-cca4-4080-a9d0-b079eaf0d27d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:46.037665 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7852c8-cca4-4080-a9d0-b079eaf0d27d None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:46.046262 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 440/860] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 02:51:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:46.051905 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf8cc3-5bb2-4b1a-8c67-1745028fea89 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:46.148358 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf8cc3-5bb2-4b1a-8c67-1745028fea89 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:46.184988 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a49b13-c36e-419f-b952-94bf42bfeb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:46.186154 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a49b13-c36e-419f-b952-94bf42bfeb3a None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:46.186638 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a49b13-c36e-419f-b952-94bf42bfeb3a None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:46.187109 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a49b13-c36e-419f-b952-94bf42bfeb3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:46.198638 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a49b13-c36e-419f-b952-94bf42bfeb3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:46.200406 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a49b13-c36e-419f-b952-94bf42bfeb3a None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:46.217528 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-f8a49b13-c36e-419f-b952-94bf42bfeb3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:46.219348 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 421/861] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:51:46.225205 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7852c8-cca4-4080-a9d0-b079eaf0d27d None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:46.332584 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7852c8-cca4-4080-a9d0-b079eaf0d27d None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:46.366159 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15845878-5921-4714-8589-f349c32a1851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:46.367209 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15845878-5921-4714-8589-f349c32a1851 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:46.367699 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15845878-5921-4714-8589-f349c32a1851 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:46.368203 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15845878-5921-4714-8589-f349c32a1851 None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:46.369140 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15845878-5921-4714-8589-f349c32a1851 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:46.369904 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15845878-5921-4714-8589-f349c32a1851 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:46.371629 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15845878-5921-4714-8589-f349c32a1851 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:46.383709 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 441/862] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:46.389875 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a49b13-c36e-419f-b952-94bf42bfeb3a None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:46.488690 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a49b13-c36e-419f-b952-94bf42bfeb3a None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:46.528931 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6e5b4-2aec-4e8a-a5af-1eb5de0c1472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:46.530120 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6e5b4-2aec-4e8a-a5af-1eb5de0c1472 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:46.530612 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6e5b4-2aec-4e8a-a5af-1eb5de0c1472 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:46.531077 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6e5b4-2aec-4e8a-a5af-1eb5de0c1472 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:46.539878 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6e5b4-2aec-4e8a-a5af-1eb5de0c1472 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:46.541836 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6e5b4-2aec-4e8a-a5af-1eb5de0c1472 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:46.555967 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-5ee6e5b4-2aec-4e8a-a5af-1eb5de0c1472 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 12 02:51:46.558138 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 422/863] 10.222.0.32 () {56 vars in 1117 bytes} [Tue Apr 12 02:51:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:46.563993 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15845878-5921-4714-8589-f349c32a1851 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:46.662584 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15845878-5921-4714-8589-f349c32a1851 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:46.700459 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35881ad5-6367-4bb8-9144-5a8c5255cebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:46.701141 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35881ad5-6367-4bb8-9144-5a8c5255cebf None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:46.701417 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35881ad5-6367-4bb8-9144-5a8c5255cebf None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:46.701690 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35881ad5-6367-4bb8-9144-5a8c5255cebf None admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:46.702526 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35881ad5-6367-4bb8-9144-5a8c5255cebf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:46.703143 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35881ad5-6367-4bb8-9144-5a8c5255cebf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:46.704599 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35881ad5-6367-4bb8-9144-5a8c5255cebf None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:46.726443 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 442/864] 10.222.0.32 () {56 vars in 1149 bytes} [Tue Apr 12 02:51:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:46.732287 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6e5b4-2aec-4e8a-a5af-1eb5de0c1472 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:46.834917 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6e5b4-2aec-4e8a-a5af-1eb5de0c1472 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:46.868947 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f473b8d-3465-494f-8bf8-b989964381e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:46.869574 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f473b8d-3465-494f-8bf8-b989964381e9 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:46.870037 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f473b8d-3465-494f-8bf8-b989964381e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:46.870480 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f473b8d-3465-494f-8bf8-b989964381e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:46.937741 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f473b8d-3465-494f-8bf8-b989964381e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:46.939209 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f473b8d-3465-494f-8bf8-b989964381e9 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:47.040576 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 423/865] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:51:46 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 02:51:47.049536 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35881ad5-6367-4bb8-9144-5a8c5255cebf None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:47.154314 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35881ad5-6367-4bb8-9144-5a8c5255cebf None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:47.190885 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab187d97-11e9-47cd-94fc-62a71e8c70ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:47.192007 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab187d97-11e9-47cd-94fc-62a71e8c70ed None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:47.192493 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab187d97-11e9-47cd-94fc-62a71e8c70ed None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:47.192938 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab187d97-11e9-47cd-94fc-62a71e8c70ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:47.203819 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab187d97-11e9-47cd-94fc-62a71e8c70ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:47.205502 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab187d97-11e9-47cd-94fc-62a71e8c70ed None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:47.222917 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-ab187d97-11e9-47cd-94fc-62a71e8c70ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:47.224681 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 443/866] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:47.230652 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f473b8d-3465-494f-8bf8-b989964381e9 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:47.340110 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f473b8d-3465-494f-8bf8-b989964381e9 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:47.374502 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2db63-b195-4609-8b3b-af9d64f7e103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:47.375491 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2db63-b195-4609-8b3b-af9d64f7e103 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:47.375978 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2db63-b195-4609-8b3b-af9d64f7e103 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:47.376433 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2db63-b195-4609-8b3b-af9d64f7e103 None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:47.377339 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2db63-b195-4609-8b3b-af9d64f7e103 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:47.377852 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2db63-b195-4609-8b3b-af9d64f7e103 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:47.379454 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2db63-b195-4609-8b3b-af9d64f7e103 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:47.396040 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 424/867] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:47.398289 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab187d97-11e9-47cd-94fc-62a71e8c70ed None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:47.500242 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab187d97-11e9-47cd-94fc-62a71e8c70ed None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:47.534705 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f314f3c-2f29-45a9-89ed-6fb953c7739a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:47.536567 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b0ca2-743c-49e3-8f86-398fb20f77be None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:47.536706 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f314f3c-2f29-45a9-89ed-6fb953c7739a None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:47.536927 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f314f3c-2f29-45a9-89ed-6fb953c7739a None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:47.537206 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f314f3c-2f29-45a9-89ed-6fb953c7739a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:47.537614 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b0ca2-743c-49e3-8f86-398fb20f77be None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:47.538067 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b0ca2-743c-49e3-8f86-398fb20f77be None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:47.540425 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 425/868] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:51:47.547173 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f314f3c-2f29-45a9-89ed-6fb953c7739a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:47.548907 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea315d-e01d-45af-8c70-489edf58e642 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:47.549189 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea315d-e01d-45af-8c70-489edf58e642 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:47.549421 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f314f3c-2f29-45a9-89ed-6fb953c7739a None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:47.549541 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea315d-e01d-45af-8c70-489edf58e642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:47.566211 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-a0ea315d-e01d-45af-8c70-489edf58e642 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:47.566756 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-1f314f3c-2f29-45a9-89ed-6fb953c7739a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:51:47.567382 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-a0ea315d-e01d-45af-8c70-489edf58e642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:47.568734 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 444/869] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:51:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:47.575208 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f314f3c-2f29-45a9-89ed-6fb953c7739a None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:47.647885 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 426/870] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 02:51:47.663496 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea315d-e01d-45af-8c70-489edf58e642 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:47.683217 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f314f3c-2f29-45a9-89ed-6fb953c7739a None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:47.718941 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38983b4c-1b4a-441a-b180-9ddf93d14f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:47.720062 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38983b4c-1b4a-441a-b180-9ddf93d14f02 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:47.720549 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38983b4c-1b4a-441a-b180-9ddf93d14f02 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:47.721009 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38983b4c-1b4a-441a-b180-9ddf93d14f02 None admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:47.721994 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38983b4c-1b4a-441a-b180-9ddf93d14f02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:47.722488 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38983b4c-1b4a-441a-b180-9ddf93d14f02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:47.724199 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38983b4c-1b4a-441a-b180-9ddf93d14f02 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:47.737302 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 445/871] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 02:51:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:51:47.743609 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38983b4c-1b4a-441a-b180-9ddf93d14f02 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:47.763776 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea315d-e01d-45af-8c70-489edf58e642 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:47.797067 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64b53a-d085-453b-ba46-eaf76caa2a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:47.797746 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64b53a-d085-453b-ba46-eaf76caa2a72 None admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:47.798021 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64b53a-d085-453b-ba46-eaf76caa2a72 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:47.798290 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64b53a-d085-453b-ba46-eaf76caa2a72 None admin] PATH_INFO: `/v3/services` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:47.799343 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf64b53a-d085-453b-ba46-eaf76caa2a72 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:47.800486 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf64b53a-d085-453b-ba46-eaf76caa2a72 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:47.823874 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 427/872] 10.222.0.32 () {60 vars in 1141 bytes} [Tue Apr 12 02:51:47 2022] POST /identity/v3/services => generated 269 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 02:51:47.862566 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38983b4c-1b4a-441a-b180-9ddf93d14f02 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:47.912129 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961053d3-cc90-4c49-9585-838b7b170715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:47.912806 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961053d3-cc90-4c49-9585-838b7b170715 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:47.913084 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961053d3-cc90-4c49-9585-838b7b170715 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:47.913352 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961053d3-cc90-4c49-9585-838b7b170715 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:47.914185 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961053d3-cc90-4c49-9585-838b7b170715 None admin] RBAC: Adding query filter params (role.id=a8b79923b07243e385187b6641381ee1, scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed, user.id=83115653901749f6ade6638593fb54e9) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:47.914558 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961053d3-cc90-4c49-9585-838b7b170715 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:47.916042 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961053d3-cc90-4c49-9585-838b7b170715 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:47.923519 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 446/873] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:51:47 2022] GET /identity/v3/role_assignments?user.id=83115653901749f6ade6638593fb54e9&scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed&role.id=a8b79923b07243e385187b6641381ee1 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:48.050018 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1653e3c-78e8-408c-9c01-ce342c2fd882 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:48.050662 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1653e3c-78e8-408c-9c01-ce342c2fd882 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:48.051133 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1653e3c-78e8-408c-9c01-ce342c2fd882 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:48.053073 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 428/874] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:48.058859 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29756fd2-cddd-424b-83b4-5e7f8e7c784b None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:48.059447 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29756fd2-cddd-424b-83b4-5e7f8e7c784b None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:48.060021 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29756fd2-cddd-424b-83b4-5e7f8e7c784b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:48.079102 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-29756fd2-cddd-424b-83b4-5e7f8e7c784b None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:48.080346 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-29756fd2-cddd-424b-83b4-5e7f8e7c784b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:48.151434 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 447/875] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:48 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:51:48.173592 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1653e3c-78e8-408c-9c01-ce342c2fd882 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:48.201666 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df4de8-c7a0-4913-90dd-fb3166f13f65 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:48.201948 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df4de8-c7a0-4913-90dd-fb3166f13f65 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:48.203491 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df4de8-c7a0-4913-90dd-fb3166f13f65 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:48.204162 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 448/876] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:51:48.211388 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53807b77-fe1f-41dc-af39-4df87bc9daaf None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:48.211885 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53807b77-fe1f-41dc-af39-4df87bc9daaf None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:48.212167 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53807b77-fe1f-41dc-af39-4df87bc9daaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:48.229324 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-53807b77-fe1f-41dc-af39-4df87bc9daaf None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:48.230481 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-53807b77-fe1f-41dc-af39-4df87bc9daaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:48.290862 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1653e3c-78e8-408c-9c01-ce342c2fd882 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:48.313406 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 449/877] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:48 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 02:51:48.330179 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc043987-c10d-4414-aa3b-23300b4086b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:48.331306 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc043987-c10d-4414-aa3b-23300b4086b8 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:48.331825 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc043987-c10d-4414-aa3b-23300b4086b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:48.332312 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc043987-c10d-4414-aa3b-23300b4086b8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:48.333254 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc043987-c10d-4414-aa3b-23300b4086b8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:48.334892 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc043987-c10d-4414-aa3b-23300b4086b8 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:48.338484 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53807b77-fe1f-41dc-af39-4df87bc9daaf None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:48.351753 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-dc043987-c10d-4414-aa3b-23300b4086b8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 12 02:51:48.354128 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 429/878] 10.222.0.32 () {56 vars in 1126 bytes} [Tue Apr 12 02:51:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:48.361632 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc043987-c10d-4414-aa3b-23300b4086b8 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:48.449666 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53807b77-fe1f-41dc-af39-4df87bc9daaf None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:48.482144 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38467bba-7f90-4150-b7dd-d9176887dafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:48.482810 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38467bba-7f90-4150-b7dd-d9176887dafa None admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:48.483086 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38467bba-7f90-4150-b7dd-d9176887dafa None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:48.483356 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38467bba-7f90-4150-b7dd-d9176887dafa None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:48.484118 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38467bba-7f90-4150-b7dd-d9176887dafa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:48.484519 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc043987-c10d-4414-aa3b-23300b4086b8 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:48.485496 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38467bba-7f90-4150-b7dd-d9176887dafa None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:48.507287 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 450/879] 10.222.0.32 () {60 vars in 1141 bytes} [Tue Apr 12 02:51:48 2022] POST /identity/v3/services => generated 251 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 02:51:48.526152 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0dbcf-5926-4686-a9a8-3c21bbfdb28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:48.526838 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0dbcf-5926-4686-a9a8-3c21bbfdb28e None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:48.527110 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0dbcf-5926-4686-a9a8-3c21bbfdb28e None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:48.527373 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0dbcf-5926-4686-a9a8-3c21bbfdb28e None admin] PATH_INFO: `/v3/services` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:48.532044 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e0dbcf-5926-4686-a9a8-3c21bbfdb28e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:48.532044 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e0dbcf-5926-4686-a9a8-3c21bbfdb28e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:48.532044 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e0dbcf-5926-4686-a9a8-3c21bbfdb28e None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:48.536973 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 430/880] 10.222.0.32 () {56 vars in 1122 bytes} [Tue Apr 12 02:51:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:48.547882 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38467bba-7f90-4150-b7dd-d9176887dafa None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:48.649189 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38467bba-7f90-4150-b7dd-d9176887dafa None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:48.684949 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e314a34-c75f-4597-8f3f-29e4e7d18c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:48.685755 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e314a34-c75f-4597-8f3f-29e4e7d18c44 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:48.685952 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e314a34-c75f-4597-8f3f-29e4e7d18c44 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:48.686162 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e314a34-c75f-4597-8f3f-29e4e7d18c44 None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:48.686872 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e314a34-c75f-4597-8f3f-29e4e7d18c44 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:48.687284 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e314a34-c75f-4597-8f3f-29e4e7d18c44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:48.688692 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e314a34-c75f-4597-8f3f-29e4e7d18c44 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:48.694098 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 451/881] 10.222.0.32 () {56 vars in 1122 bytes} [Tue Apr 12 02:51:48 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:50.255127 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356091c-9a86-443b-aa9a-b6333042958d None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:50.255649 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356091c-9a86-443b-aa9a-b6333042958d None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:50.255649 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356091c-9a86-443b-aa9a-b6333042958d None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:50.257269 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 431/882] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:50.263257 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ec97a-6fc8-41c2-87c3-f355cbf3a1be None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:50.263750 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ec97a-6fc8-41c2-87c3-f355cbf3a1be None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:50.264000 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ec97a-6fc8-41c2-87c3-f355cbf3a1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:50.282186 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-971ec97a-6fc8-41c2-87c3-f355cbf3a1be None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:50.283362 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-971ec97a-6fc8-41c2-87c3-f355cbf3a1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:50.357071 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 452/883] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:51:50.381202 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356091c-9a86-443b-aa9a-b6333042958d None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:50.410286 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0f90d-2ad8-4fca-8c99-3f1f48af2b0a None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:50.410712 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0f90d-2ad8-4fca-8c99-3f1f48af2b0a None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:50.411099 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0f90d-2ad8-4fca-8c99-3f1f48af2b0a None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:50.412592 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 453/884] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:51:50.418229 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd556da-1c40-46fc-b515-e78db4611ba3 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:50.418616 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd556da-1c40-46fc-b515-e78db4611ba3 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:50.418983 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd556da-1c40-46fc-b515-e78db4611ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:50.435620 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-6bd556da-1c40-46fc-b515-e78db4611ba3 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:50.436935 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-6bd556da-1c40-46fc-b515-e78db4611ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:50.486825 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356091c-9a86-443b-aa9a-b6333042958d None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:50.512076 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 454/885] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 02:51:50.522909 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7765b-45b9-409b-8667-3cfb84ee40d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:50.523747 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7765b-45b9-409b-8667-3cfb84ee40d0 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:50.524040 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7765b-45b9-409b-8667-3cfb84ee40d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:50.524306 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7765b-45b9-409b-8667-3cfb84ee40d0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:50.524951 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7765b-45b9-409b-8667-3cfb84ee40d0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:50.526756 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7765b-45b9-409b-8667-3cfb84ee40d0 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:50.532934 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd556da-1c40-46fc-b515-e78db4611ba3 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:50.538822 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-39b7765b-45b9-409b-8667-3cfb84ee40d0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 12 02:51:50.540336 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 432/886] 10.222.0.32 () {56 vars in 1132 bytes} [Tue Apr 12 02:51:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:50.546538 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7765b-45b9-409b-8667-3cfb84ee40d0 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:50.630394 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd556da-1c40-46fc-b515-e78db4611ba3 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:50.646079 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7765b-45b9-409b-8667-3cfb84ee40d0 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:50.666134 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93202f4-bcb8-4661-8e55-61ef71557157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:50.667000 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93202f4-bcb8-4661-8e55-61ef71557157 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:50.667280 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93202f4-bcb8-4661-8e55-61ef71557157 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:50.667661 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93202f4-bcb8-4661-8e55-61ef71557157 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:50.678978 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93202f4-bcb8-4661-8e55-61ef71557157 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:51:50.683258 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27280287-b62f-47fc-9f41-3819a0d3f07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:50.683956 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27280287-b62f-47fc-9f41-3819a0d3f07a None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:50.684231 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27280287-b62f-47fc-9f41-3819a0d3f07a None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:50.684493 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27280287-b62f-47fc-9f41-3819a0d3f07a None admin] PATH_INFO: `/v3/services` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:50.685192 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27280287-b62f-47fc-9f41-3819a0d3f07a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:50.685492 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27280287-b62f-47fc-9f41-3819a0d3f07a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:50.686887 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27280287-b62f-47fc-9f41-3819a0d3f07a None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:50.688818 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-c93202f4-bcb8-4661-8e55-61ef71557157 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 12 02:51:50.695041 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 455/887] 10.222.0.32 () {56 vars in 1120 bytes} [Tue Apr 12 02:51:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:51:50.695875 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 433/888] 10.222.0.32 () {56 vars in 1126 bytes} [Tue Apr 12 02:51:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:51:50.696874 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93202f4-bcb8-4661-8e55-61ef71557157 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:50.698272 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27280287-b62f-47fc-9f41-3819a0d3f07a None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:50.811243 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93202f4-bcb8-4661-8e55-61ef71557157 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:50.813137 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27280287-b62f-47fc-9f41-3819a0d3f07a None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:50.844919 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f06b0-4dbe-4de6-95fe-3fe1335696f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:50.845424 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f06b0-4dbe-4de6-95fe-3fe1335696f8 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:50.845697 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f06b0-4dbe-4de6-95fe-3fe1335696f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:50.845964 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f06b0-4dbe-4de6-95fe-3fe1335696f8 None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:50.846713 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f06b0-4dbe-4de6-95fe-3fe1335696f8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:50.846993 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f06b0-4dbe-4de6-95fe-3fe1335696f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:50.848422 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f06b0-4dbe-4de6-95fe-3fe1335696f8 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:50.851041 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffc349-f473-40d4-be28-4566c629de4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:50.851937 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffc349-f473-40d4-be28-4566c629de4a None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:50.852420 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffc349-f473-40d4-be28-4566c629de4a None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:50.852889 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffc349-f473-40d4-be28-4566c629de4a None admin] PATH_INFO: `/v3/services` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:50.853824 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cffc349-f473-40d4-be28-4566c629de4a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:50.854618 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cffc349-f473-40d4-be28-4566c629de4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:50.856240 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cffc349-f473-40d4-be28-4566c629de4a None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:50.861401 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 456/889] 10.222.0.32 () {56 vars in 1115 bytes} [Tue Apr 12 02:51:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:50.862336 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f06b0-4dbe-4de6-95fe-3fe1335696f8 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:50.867826 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 434/890] 10.222.0.32 () {56 vars in 1126 bytes} [Tue Apr 12 02:51:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:50.869972 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffc349-f473-40d4-be28-4566c629de4a None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:50.961970 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f06b0-4dbe-4de6-95fe-3fe1335696f8 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:50.965781 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffc349-f473-40d4-be28-4566c629de4a None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:50.996574 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3827661-ae3b-42f4-a300-1443a74d1aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:50.997362 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3827661-ae3b-42f4-a300-1443a74d1aa7 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:50.997633 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3827661-ae3b-42f4-a300-1443a74d1aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:50.997895 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3827661-ae3b-42f4-a300-1443a74d1aa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:51.001370 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f8c92-fd00-4282-ad3e-16038a5768e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:51.002269 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f8c92-fd00-4282-ad3e-16038a5768e9 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:51.002751 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f8c92-fd00-4282-ad3e-16038a5768e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:51.003215 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f8c92-fd00-4282-ad3e-16038a5768e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:51.004294 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f8c92-fd00-4282-ad3e-16038a5768e9 None admin] RBAC: Adding query filter params (interface=public, service_id=522aea412384480295acb5d53f066e81, region_id=RegionOne) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:51.004826 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f8c92-fd00-4282-ad3e-16038a5768e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:51.006420 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f8c92-fd00-4282-ad3e-16038a5768e9 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:51.007994 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3827661-ae3b-42f4-a300-1443a74d1aa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:51.009394 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3827661-ae3b-42f4-a300-1443a74d1aa7 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:51.018958 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 435/891] 10.222.0.32 () {56 vars in 1251 bytes} [Tue Apr 12 02:51:50 2022] GET /identity/v3/endpoints?service_id=522aea412384480295acb5d53f066e81&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:51.018958 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded030e7-4323-4959-b285-5fc7d43681e1 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:51.018958 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded030e7-4323-4959-b285-5fc7d43681e1 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:51.018958 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded030e7-4323-4959-b285-5fc7d43681e1 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:51.020269 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 436/892] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:51.021776 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded030e7-4323-4959-b285-5fc7d43681e1 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:51.030839 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-a3827661-ae3b-42f4-a300-1443a74d1aa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:51.035300 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 457/893] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:51.035300 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb35e6-4814-41e1-85cf-27acbc6d49e5 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:51.035300 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb35e6-4814-41e1-85cf-27acbc6d49e5 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:51.035300 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb35e6-4814-41e1-85cf-27acbc6d49e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:51.050452 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-9beb35e6-4814-41e1-85cf-27acbc6d49e5 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:51.051611 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-9beb35e6-4814-41e1-85cf-27acbc6d49e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:51.114482 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 458/894] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:51:51.115706 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2103fd0-8c75-4468-b311-1a435a22dc9d None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:51.116021 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2103fd0-8c75-4468-b311-1a435a22dc9d None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:51.116292 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2103fd0-8c75-4468-b311-1a435a22dc9d None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:51.117702 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 459/895] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:51.117828 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded030e7-4323-4959-b285-5fc7d43681e1 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:51.122480 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2103fd0-8c75-4468-b311-1a435a22dc9d None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:51.151480 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e727a83-2387-4986-9773-de3acd99b417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:51.152162 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e727a83-2387-4986-9773-de3acd99b417 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:51.152435 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e727a83-2387-4986-9773-de3acd99b417 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:51.152700 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e727a83-2387-4986-9773-de3acd99b417 None admin] PATH_INFO: `/v3/services` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:51.153376 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e727a83-2387-4986-9773-de3acd99b417 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:51.154765 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e727a83-2387-4986-9773-de3acd99b417 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:51.160186 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 437/896] 10.222.0.32 () {56 vars in 1087 bytes} [Tue Apr 12 02:51:51 2022] GET /identity/v3/services => generated 1268 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 02:51:51.161349 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930b5c4-388d-49fe-bf61-53595e427a3b None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:51.161625 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930b5c4-388d-49fe-bf61-53595e427a3b None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:51.161885 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930b5c4-388d-49fe-bf61-53595e427a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:51.178907 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-5930b5c4-388d-49fe-bf61-53595e427a3b None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:51.180164 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-5930b5c4-388d-49fe-bf61-53595e427a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:51.239283 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2103fd0-8c75-4468-b311-1a435a22dc9d None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:51.253617 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 438/897] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:51:51.254536 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930b5c4-388d-49fe-bf61-53595e427a3b None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:51.280398 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75f8f0-36c1-41c3-870f-3e393e22629c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:51.281122 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75f8f0-36c1-41c3-870f-3e393e22629c None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:51.281393 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75f8f0-36c1-41c3-870f-3e393e22629c None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:51.281706 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75f8f0-36c1-41c3-870f-3e393e22629c None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:51.282425 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75f8f0-36c1-41c3-870f-3e393e22629c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:51.282772 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75f8f0-36c1-41c3-870f-3e393e22629c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:51.284216 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75f8f0-36c1-41c3-870f-3e393e22629c None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:51.295951 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 460/898] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:51.296821 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75f8f0-36c1-41c3-870f-3e393e22629c None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:51.359820 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930b5c4-388d-49fe-bf61-53595e427a3b None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:51.394694 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f8cc6-e54d-4d3b-832a-a360588fd626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:51.395412 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f8cc6-e54d-4d3b-832a-a360588fd626 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:51.395683 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f8cc6-e54d-4d3b-832a-a360588fd626 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:51.396000 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f8cc6-e54d-4d3b-832a-a360588fd626 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:51.396638 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68f8cc6-e54d-4d3b-832a-a360588fd626 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:51.398014 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68f8cc6-e54d-4d3b-832a-a360588fd626 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:51.405275 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75f8f0-36c1-41c3-870f-3e393e22629c None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:51.408945 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-f68f8cc6-e54d-4d3b-832a-a360588fd626 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 12 02:51:51.415209 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 439/899] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 02:51:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:51.415209 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f8cc6-e54d-4d3b-832a-a360588fd626 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:51.437813 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ca968-0c78-4f2f-8c8a-8752d07fe825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:51.438483 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ca968-0c78-4f2f-8c8a-8752d07fe825 None admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:51.438761 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ca968-0c78-4f2f-8c8a-8752d07fe825 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:51.439031 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ca968-0c78-4f2f-8c8a-8752d07fe825 None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:51.439761 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ca968-0c78-4f2f-8c8a-8752d07fe825 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:51.441199 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ca968-0c78-4f2f-8c8a-8752d07fe825 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:51.459773 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 461/900] 10.222.0.32 () {60 vars in 1141 bytes} [Tue Apr 12 02:51:51 2022] POST /identity/v3/services => generated 241 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 02:51:51.459773 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ca968-0c78-4f2f-8c8a-8752d07fe825 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:51.537166 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f8cc6-e54d-4d3b-832a-a360588fd626 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:51.573892 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ca968-0c78-4f2f-8c8a-8752d07fe825 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:51.580436 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e0c44-d52e-4bf0-b649-5d23efe2f366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:51.581527 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e0c44-d52e-4bf0-b649-5d23efe2f366 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:51.582194 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e0c44-d52e-4bf0-b649-5d23efe2f366 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:51.582827 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e0c44-d52e-4bf0-b649-5d23efe2f366 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:51.594451 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e0c44-d52e-4bf0-b649-5d23efe2f366 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:51.596477 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e0c44-d52e-4bf0-b649-5d23efe2f366 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:51.612852 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-a83e0c44-d52e-4bf0-b649-5d23efe2f366 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 12 02:51:51.614496 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 440/901] 10.222.0.32 () {56 vars in 1117 bytes} [Tue Apr 12 02:51:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:51.615931 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a403a-1edb-4a05-8fa8-90f4109aa68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:51.616945 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a403a-1edb-4a05-8fa8-90f4109aa68e None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:51.617426 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a403a-1edb-4a05-8fa8-90f4109aa68e None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:51.618145 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a403a-1edb-4a05-8fa8-90f4109aa68e None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:51.619085 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a403a-1edb-4a05-8fa8-90f4109aa68e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:51.619764 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a403a-1edb-4a05-8fa8-90f4109aa68e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:51.620921 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e0c44-d52e-4bf0-b649-5d23efe2f366 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:51.622796 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a403a-1edb-4a05-8fa8-90f4109aa68e None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:51.634610 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 462/902] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 02:51:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:51.637817 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a403a-1edb-4a05-8fa8-90f4109aa68e None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:51.744140 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e0c44-d52e-4bf0-b649-5d23efe2f366 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:51.757763 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a403a-1edb-4a05-8fa8-90f4109aa68e None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:51.777243 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb8141-71ad-449c-9154-e19e77b2831a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:51.777910 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb8141-71ad-449c-9154-e19e77b2831a None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:51.778179 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb8141-71ad-449c-9154-e19e77b2831a None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:51.778443 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb8141-71ad-449c-9154-e19e77b2831a None admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:51.779368 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb8141-71ad-449c-9154-e19e77b2831a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:51.779546 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb8141-71ad-449c-9154-e19e77b2831a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:51.781012 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb8141-71ad-449c-9154-e19e77b2831a None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:51.793470 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6b7d3-f323-4170-9dba-ad18771fb73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:51.794340 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6b7d3-f323-4170-9dba-ad18771fb73e None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:51.794759 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6b7d3-f323-4170-9dba-ad18771fb73e None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:51.795166 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6b7d3-f323-4170-9dba-ad18771fb73e None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:51.796064 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da6b7d3-f323-4170-9dba-ad18771fb73e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:51.796505 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da6b7d3-f323-4170-9dba-ad18771fb73e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:51.798010 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da6b7d3-f323-4170-9dba-ad18771fb73e None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:51.803313 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 441/903] 10.222.0.32 () {56 vars in 1149 bytes} [Tue Apr 12 02:51:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:51.805267 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb8141-71ad-449c-9154-e19e77b2831a None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:51.810306 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 463/904] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 02:51:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:51.817343 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6b7d3-f323-4170-9dba-ad18771fb73e None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:51.917499 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6b7d3-f323-4170-9dba-ad18771fb73e None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:51.927560 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb8141-71ad-449c-9154-e19e77b2831a None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:51.953375 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a43ac-230b-4b5a-8c0c-8a139271cc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:51.953835 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a43ac-230b-4b5a-8c0c-8a139271cc33 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:51.954107 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a43ac-230b-4b5a-8c0c-8a139271cc33 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:51.954376 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a43ac-230b-4b5a-8c0c-8a139271cc33 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:51.955164 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a43ac-230b-4b5a-8c0c-8a139271cc33 None admin] RBAC: Adding query filter params (interface=public, service_id=9cd99f007e03466985ee9cc8d4618ab5, region_id=RegionOne) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:51.955493 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a43ac-230b-4b5a-8c0c-8a139271cc33 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:51.956856 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a43ac-230b-4b5a-8c0c-8a139271cc33 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:51.967565 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 464/905] 10.222.0.32 () {56 vars in 1251 bytes} [Tue Apr 12 02:51:51 2022] GET /identity/v3/endpoints?service_id=9cd99f007e03466985ee9cc8d4618ab5&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:51:51.968517 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a43ac-230b-4b5a-8c0c-8a139271cc33 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:51.969880 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17399f9-dcbb-4fb5-932a-671378957d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:51.970689 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17399f9-dcbb-4fb5-932a-671378957d0a None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:51.971296 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17399f9-dcbb-4fb5-932a-671378957d0a None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:51.972559 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17399f9-dcbb-4fb5-932a-671378957d0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:52.048645 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17399f9-dcbb-4fb5-932a-671378957d0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:52.050086 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17399f9-dcbb-4fb5-932a-671378957d0a None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:52.081766 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a43ac-230b-4b5a-8c0c-8a139271cc33 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:52.123830 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3609665-2719-43fb-ae52-cc017a2f768c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:52.125159 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3609665-2719-43fb-ae52-cc017a2f768c None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:52.125682 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3609665-2719-43fb-ae52-cc017a2f768c None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:52.126101 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3609665-2719-43fb-ae52-cc017a2f768c None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:52.127114 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3609665-2719-43fb-ae52-cc017a2f768c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:52.129276 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3609665-2719-43fb-ae52-cc017a2f768c None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:52.137261 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 465/906] 10.222.0.32 () {56 vars in 1087 bytes} [Tue Apr 12 02:51:51 2022] GET /identity/v3/services => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 02:51:52.158656 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 442/907] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:51:51 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 02:51:52.160559 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3609665-2719-43fb-ae52-cc017a2f768c None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:52.269350 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3609665-2719-43fb-ae52-cc017a2f768c None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:52.307545 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f2c14-5a93-4f72-8ed8-fc7eef19eea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:52.309275 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f2c14-5a93-4f72-8ed8-fc7eef19eea6 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:52.309703 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f2c14-5a93-4f72-8ed8-fc7eef19eea6 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:52.310126 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f2c14-5a93-4f72-8ed8-fc7eef19eea6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:52.322858 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f2c14-5a93-4f72-8ed8-fc7eef19eea6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:52.324783 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f2c14-5a93-4f72-8ed8-fc7eef19eea6 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:52.344125 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-3c8f2c14-5a93-4f72-8ed8-fc7eef19eea6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:52.350333 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 466/908] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:52.351881 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17399f9-dcbb-4fb5-932a-671378957d0a None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:52.454475 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17399f9-dcbb-4fb5-932a-671378957d0a None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:52.487160 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e92b4-4ca9-410e-93f3-9d37d0137da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:52.487951 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e92b4-4ca9-410e-93f3-9d37d0137da5 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:52.488233 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e92b4-4ca9-410e-93f3-9d37d0137da5 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:52.488500 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e92b4-4ca9-410e-93f3-9d37d0137da5 None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:52.489254 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e92b4-4ca9-410e-93f3-9d37d0137da5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:52.489556 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e92b4-4ca9-410e-93f3-9d37d0137da5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:52.491048 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e92b4-4ca9-410e-93f3-9d37d0137da5 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:52.507087 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 443/909] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:52.513259 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f2c14-5a93-4f72-8ed8-fc7eef19eea6 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:52.619024 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f2c14-5a93-4f72-8ed8-fc7eef19eea6 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:52.651986 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52a7f4-8802-4ee1-ad40-d61487575b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:52.652777 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52a7f4-8802-4ee1-ad40-d61487575b7f None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:52.653049 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52a7f4-8802-4ee1-ad40-d61487575b7f None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:52.653315 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52a7f4-8802-4ee1-ad40-d61487575b7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:52.660684 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52a7f4-8802-4ee1-ad40-d61487575b7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:52.662137 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52a7f4-8802-4ee1-ad40-d61487575b7f None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:52.676288 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-1a52a7f4-8802-4ee1-ad40-d61487575b7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:51:52.677840 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 467/910] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:51:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:52.684002 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e92b4-4ca9-410e-93f3-9d37d0137da5 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:52.782013 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e92b4-4ca9-410e-93f3-9d37d0137da5 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:52.815090 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34e73b-e661-4e5f-a670-4f0c5b9120f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:52.816121 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34e73b-e661-4e5f-a670-4f0c5b9120f2 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:52.816597 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34e73b-e661-4e5f-a670-4f0c5b9120f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:52.817062 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34e73b-e661-4e5f-a670-4f0c5b9120f2 None admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:52.818139 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34e73b-e661-4e5f-a670-4f0c5b9120f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:52.818637 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34e73b-e661-4e5f-a670-4f0c5b9120f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:52.820408 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34e73b-e661-4e5f-a670-4f0c5b9120f2 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:52.838793 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 444/911] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 02:51:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:52.840434 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52a7f4-8802-4ee1-ad40-d61487575b7f None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:52.936700 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52a7f4-8802-4ee1-ad40-d61487575b7f None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:52.973925 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31f0ab-976d-4ae0-acc1-0014b362a7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:52.974572 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31f0ab-976d-4ae0-acc1-0014b362a7d6 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:52.974842 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31f0ab-976d-4ae0-acc1-0014b362a7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:52.975107 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31f0ab-976d-4ae0-acc1-0014b362a7d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:52.975952 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31f0ab-976d-4ae0-acc1-0014b362a7d6 None admin] RBAC: Adding query filter params (role.id=94f6d87df94e495d8f9a139ab8a39ef5, scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed, user.id=83115653901749f6ade6638593fb54e9) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:52.976253 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31f0ab-976d-4ae0-acc1-0014b362a7d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:52.977768 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31f0ab-976d-4ae0-acc1-0014b362a7d6 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:52.983819 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 468/912] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:51:52 2022] GET /identity/v3/role_assignments?user.id=83115653901749f6ade6638593fb54e9&scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed&role.id=94f6d87df94e495d8f9a139ab8a39ef5 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:53.516524 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613564b-82de-4f29-876c-11fdb51abff6 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:53.517087 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613564b-82de-4f29-876c-11fdb51abff6 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:53.517087 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613564b-82de-4f29-876c-11fdb51abff6 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:53.518676 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 445/913] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:53.524656 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3619889-c882-48e4-8c3c-7a85628496fa None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:53.525163 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3619889-c882-48e4-8c3c-7a85628496fa None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:53.525163 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3619889-c882-48e4-8c3c-7a85628496fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:53.546146 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-c3619889-c882-48e4-8c3c-7a85628496fa None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:53.547312 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-c3619889-c882-48e4-8c3c-7a85628496fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:53.613798 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 469/914] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:51:53.637877 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613564b-82de-4f29-876c-11fdb51abff6 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:53.737153 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613564b-82de-4f29-876c-11fdb51abff6 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:53.774881 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56baae16-bfdb-4062-a65f-620a7b28b2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:53.776273 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56baae16-bfdb-4062-a65f-620a7b28b2de None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:53.776756 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56baae16-bfdb-4062-a65f-620a7b28b2de None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:53.777247 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56baae16-bfdb-4062-a65f-620a7b28b2de None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:53.778093 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56baae16-bfdb-4062-a65f-620a7b28b2de None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:53.779659 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56baae16-bfdb-4062-a65f-620a7b28b2de None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:53.791375 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-56baae16-bfdb-4062-a65f-620a7b28b2de None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 12 02:51:53.793349 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 446/915] 10.222.0.32 () {56 vars in 1132 bytes} [Tue Apr 12 02:51:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:53.799190 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3619889-c882-48e4-8c3c-7a85628496fa None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:53.895168 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3619889-c882-48e4-8c3c-7a85628496fa None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:53.928125 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26211a26-dd5a-4ee7-910c-d6ae3991301d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:53.928796 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26211a26-dd5a-4ee7-910c-d6ae3991301d None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:53.929070 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26211a26-dd5a-4ee7-910c-d6ae3991301d None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:53.929337 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26211a26-dd5a-4ee7-910c-d6ae3991301d None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:53.930040 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26211a26-dd5a-4ee7-910c-d6ae3991301d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:53.930340 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26211a26-dd5a-4ee7-910c-d6ae3991301d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:53.931888 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26211a26-dd5a-4ee7-910c-d6ae3991301d None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:53.933146 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380c737-a455-474a-917b-c252bf20e474 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:53.933425 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380c737-a455-474a-917b-c252bf20e474 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:53.933694 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380c737-a455-474a-917b-c252bf20e474 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:53.935061 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 447/916] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:53.939672 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 470/917] 10.222.0.32 () {56 vars in 1126 bytes} [Tue Apr 12 02:51:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:53.940483 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51599307-0e16-4507-a67d-7cf5b49372e6 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:53.943764 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51599307-0e16-4507-a67d-7cf5b49372e6 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:53.943764 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51599307-0e16-4507-a67d-7cf5b49372e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:53.944897 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26211a26-dd5a-4ee7-910c-d6ae3991301d None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:53.958145 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-51599307-0e16-4507-a67d-7cf5b49372e6 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:53.959318 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-51599307-0e16-4507-a67d-7cf5b49372e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:54.045354 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 448/918] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 02:51:54.054973 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26211a26-dd5a-4ee7-910c-d6ae3991301d None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:54.070666 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51599307-0e16-4507-a67d-7cf5b49372e6 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:54.090692 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6f72b-c446-4606-bd43-8bc064a5bb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:54.091360 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6f72b-c446-4606-bd43-8bc064a5bb40 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:54.091638 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6f72b-c446-4606-bd43-8bc064a5bb40 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:54.091942 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6f72b-c446-4606-bd43-8bc064a5bb40 None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:54.092647 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6f72b-c446-4606-bd43-8bc064a5bb40 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:54.092947 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6f72b-c446-4606-bd43-8bc064a5bb40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:54.094307 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6f72b-c446-4606-bd43-8bc064a5bb40 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:54.103659 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 471/919] 10.222.0.32 () {56 vars in 1126 bytes} [Tue Apr 12 02:51:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:54.105096 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6f72b-c446-4606-bd43-8bc064a5bb40 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:54.192607 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51599307-0e16-4507-a67d-7cf5b49372e6 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:54.231654 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6f72b-c446-4606-bd43-8bc064a5bb40 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:54.234253 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61440a7-afde-4f0d-9116-c92ba814a731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:54.235320 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61440a7-afde-4f0d-9116-c92ba814a731 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:54.235845 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61440a7-afde-4f0d-9116-c92ba814a731 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:54.236323 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61440a7-afde-4f0d-9116-c92ba814a731 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:54.237189 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61440a7-afde-4f0d-9116-c92ba814a731 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:54.238764 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61440a7-afde-4f0d-9116-c92ba814a731 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:54.250522 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-b61440a7-afde-4f0d-9116-c92ba814a731 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 12 02:51:54.252318 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 449/920] 10.222.0.32 () {56 vars in 1126 bytes} [Tue Apr 12 02:51:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:51:54.258592 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61440a7-afde-4f0d-9116-c92ba814a731 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:54.278852 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb7820-530a-47b7-b3f1-dc74ab827d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:54.279532 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb7820-530a-47b7-b3f1-dc74ab827d81 None admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:54.279846 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb7820-530a-47b7-b3f1-dc74ab827d81 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:54.280122 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb7820-530a-47b7-b3f1-dc74ab827d81 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:54.280876 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb7820-530a-47b7-b3f1-dc74ab827d81 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:54.282247 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb7820-530a-47b7-b3f1-dc74ab827d81 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:54.307830 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 472/921] 10.222.0.32 () {60 vars in 1144 bytes} [Tue Apr 12 02:51:54 2022] POST /identity/v3/endpoints => generated 347 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 02:51:54.381824 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61440a7-afde-4f0d-9116-c92ba814a731 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:54.427065 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd0df1-da50-4c4e-ac20-ce0a8a80479c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:54.428075 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd0df1-da50-4c4e-ac20-ce0a8a80479c None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:54.428546 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd0df1-da50-4c4e-ac20-ce0a8a80479c None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:54.429025 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd0df1-da50-4c4e-ac20-ce0a8a80479c None admin] PATH_INFO: `/v3/services` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:54.429893 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd0df1-da50-4c4e-ac20-ce0a8a80479c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:54.430346 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd0df1-da50-4c4e-ac20-ce0a8a80479c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:54.432224 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd0df1-da50-4c4e-ac20-ce0a8a80479c None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:54.442772 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 450/922] 10.222.0.32 () {56 vars in 1122 bytes} [Tue Apr 12 02:51:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:51:54.444747 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb7820-530a-47b7-b3f1-dc74ab827d81 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:54.550569 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb7820-530a-47b7-b3f1-dc74ab827d81 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:54.585683 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296feb75-71db-4fc7-b984-847ce2044870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:54.586268 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296feb75-71db-4fc7-b984-847ce2044870 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:54.586539 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296feb75-71db-4fc7-b984-847ce2044870 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:54.586800 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296feb75-71db-4fc7-b984-847ce2044870 None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:54.587503 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296feb75-71db-4fc7-b984-847ce2044870 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:54.587826 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296feb75-71db-4fc7-b984-847ce2044870 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:54.589076 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c44c18-daf2-496f-802f-965c14afe4a8 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:54.589515 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296feb75-71db-4fc7-b984-847ce2044870 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:54.589982 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c44c18-daf2-496f-802f-965c14afe4a8 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:54.590472 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c44c18-daf2-496f-802f-965c14afe4a8 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:54.592272 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 451/923] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:51:54.595508 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 473/924] 10.222.0.32 () {56 vars in 1122 bytes} [Tue Apr 12 02:51:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:51:54.600659 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a051a7-58c1-4acc-a661-921e111feb99 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:54.601273 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a051a7-58c1-4acc-a661-921e111feb99 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:54.601550 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a051a7-58c1-4acc-a661-921e111feb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:54.604843 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296feb75-71db-4fc7-b984-847ce2044870 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:54.621763 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-a9a051a7-58c1-4acc-a661-921e111feb99 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:54.623815 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-a9a051a7-58c1-4acc-a661-921e111feb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:54.704908 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296feb75-71db-4fc7-b984-847ce2044870 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:54.714562 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 452/925] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:51:54.738368 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a051a7-58c1-4acc-a661-921e111feb99 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:54.743534 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bbd65-e7dc-442e-8ca2-88b3d78d3da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:54.744423 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bbd65-e7dc-442e-8ca2-88b3d78d3da0 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:54.744841 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bbd65-e7dc-442e-8ca2-88b3d78d3da0 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:54.745120 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bbd65-e7dc-442e-8ca2-88b3d78d3da0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:54.745914 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22bbd65-e7dc-442e-8ca2-88b3d78d3da0 None admin] RBAC: Adding query filter params (interface=public, service_id=9c68128ed7e04f6da80fbb0a0e99c65f, region_id=RegionOne) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:54.746224 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22bbd65-e7dc-442e-8ca2-88b3d78d3da0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:54.747608 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22bbd65-e7dc-442e-8ca2-88b3d78d3da0 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:54.755799 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 474/926] 10.222.0.32 () {56 vars in 1251 bytes} [Tue Apr 12 02:51:54 2022] GET /identity/v3/endpoints?service_id=9c68128ed7e04f6da80fbb0a0e99c65f&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:54.760794 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bbd65-e7dc-442e-8ca2-88b3d78d3da0 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:54.843244 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a051a7-58c1-4acc-a661-921e111feb99 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:54.879336 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254969e-f4d2-45f9-bbce-47f86c50a8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:54.880478 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254969e-f4d2-45f9-bbce-47f86c50a8b4 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:54.880935 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254969e-f4d2-45f9-bbce-47f86c50a8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:54.881349 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254969e-f4d2-45f9-bbce-47f86c50a8b4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:54.882182 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254969e-f4d2-45f9-bbce-47f86c50a8b4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:54.883806 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254969e-f4d2-45f9-bbce-47f86c50a8b4 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:54.887887 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bbd65-e7dc-442e-8ca2-88b3d78d3da0 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:54.895348 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-2254969e-f4d2-45f9-bbce-47f86c50a8b4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 12 02:51:54.897195 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 453/927] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 02:51:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:51:54.902995 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254969e-f4d2-45f9-bbce-47f86c50a8b4 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:54.924087 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f707c8c-ae74-4130-af1d-9b8a0060142c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:54.925091 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f707c8c-ae74-4130-af1d-9b8a0060142c None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:54.925585 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f707c8c-ae74-4130-af1d-9b8a0060142c None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:54.926053 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f707c8c-ae74-4130-af1d-9b8a0060142c None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:54.926916 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f707c8c-ae74-4130-af1d-9b8a0060142c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:54.928475 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f707c8c-ae74-4130-af1d-9b8a0060142c None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:54.938919 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 475/928] 10.222.0.32 () {56 vars in 1087 bytes} [Tue Apr 12 02:51:54 2022] GET /identity/v3/services => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 02:51:55.020436 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254969e-f4d2-45f9-bbce-47f86c50a8b4 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:55.070982 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16ae71-7ee2-4147-baf0-0924ac7dba6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:55.071660 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16ae71-7ee2-4147-baf0-0924ac7dba6e None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:55.071979 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16ae71-7ee2-4147-baf0-0924ac7dba6e None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:55.072279 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16ae71-7ee2-4147-baf0-0924ac7dba6e None admin] PATH_INFO: `/v3/services` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:55.073081 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd16ae71-7ee2-4147-baf0-0924ac7dba6e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:55.073520 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd16ae71-7ee2-4147-baf0-0924ac7dba6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:55.074940 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd16ae71-7ee2-4147-baf0-0924ac7dba6e None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:55.081142 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 454/929] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 02:51:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:55.086827 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f707c8c-ae74-4130-af1d-9b8a0060142c None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:55.192780 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f707c8c-ae74-4130-af1d-9b8a0060142c None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:55.225467 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b6d2b-c7a4-495e-8b0b-a6637e0b133a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:55.226133 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b6d2b-c7a4-495e-8b0b-a6637e0b133a None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:55.226409 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b6d2b-c7a4-495e-8b0b-a6637e0b133a None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:55.226675 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b6d2b-c7a4-495e-8b0b-a6637e0b133a None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:55.227374 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b6d2b-c7a4-495e-8b0b-a6637e0b133a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:55.227672 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b6d2b-c7a4-495e-8b0b-a6637e0b133a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:55.229144 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b6d2b-c7a4-495e-8b0b-a6637e0b133a None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:55.234160 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 476/930] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 02:51:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:55.239668 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16ae71-7ee2-4147-baf0-0924ac7dba6e None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:55.340796 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16ae71-7ee2-4147-baf0-0924ac7dba6e None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:55.374744 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c5b9d-0bf0-41a3-b917-542b452e5c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:55.375453 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c5b9d-0bf0-41a3-b917-542b452e5c13 None admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:55.375757 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c5b9d-0bf0-41a3-b917-542b452e5c13 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:55.376023 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c5b9d-0bf0-41a3-b917-542b452e5c13 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:55.376771 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c5b9d-0bf0-41a3-b917-542b452e5c13 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:55.378206 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c5b9d-0bf0-41a3-b917-542b452e5c13 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:55.398616 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f61fd-ddf8-4ca2-8920-fb96d0cd032e None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:55.398942 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f61fd-ddf8-4ca2-8920-fb96d0cd032e None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:55.399559 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f61fd-ddf8-4ca2-8920-fb96d0cd032e None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:55.401925 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 477/931] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:55.409218 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b664ed-8129-4dc8-82bf-7295fb016bbc None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:55.409765 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b664ed-8129-4dc8-82bf-7295fb016bbc None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:55.410280 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b664ed-8129-4dc8-82bf-7295fb016bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:55.421627 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 455/932] 10.222.0.32 () {60 vars in 1144 bytes} [Tue Apr 12 02:51:55 2022] POST /identity/v3/endpoints => generated 346 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 02:51:55.436388 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-93b664ed-8129-4dc8-82bf-7295fb016bbc None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:55.437921 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-93b664ed-8129-4dc8-82bf-7295fb016bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:55.529447 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 478/933] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:51:55.551693 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c5b9d-0bf0-41a3-b917-542b452e5c13 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:55.658972 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c5b9d-0bf0-41a3-b917-542b452e5c13 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:55.692732 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab7d12-fb25-4866-a740-a2e3c400397a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:55.693547 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab7d12-fb25-4866-a740-a2e3c400397a None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:55.693819 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab7d12-fb25-4866-a740-a2e3c400397a None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:55.694084 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab7d12-fb25-4866-a740-a2e3c400397a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:55.706348 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab7d12-fb25-4866-a740-a2e3c400397a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:51:55.716013 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-d3ab7d12-fb25-4866-a740-a2e3c400397a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 12 02:51:55.717587 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 456/934] 10.222.0.32 () {56 vars in 1120 bytes} [Tue Apr 12 02:51:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:55.723478 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b664ed-8129-4dc8-82bf-7295fb016bbc None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:55.824714 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b664ed-8129-4dc8-82bf-7295fb016bbc None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:55.859952 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89852825-7c70-4be2-92bb-cf95a8352a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:55.860974 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89852825-7c70-4be2-92bb-cf95a8352a1c None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:55.861421 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89852825-7c70-4be2-92bb-cf95a8352a1c None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:55.861858 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89852825-7c70-4be2-92bb-cf95a8352a1c None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:55.862778 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89852825-7c70-4be2-92bb-cf95a8352a1c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:55.863261 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89852825-7c70-4be2-92bb-cf95a8352a1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:55.864878 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89852825-7c70-4be2-92bb-cf95a8352a1c None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:55.874379 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 479/935] 10.222.0.32 () {56 vars in 1115 bytes} [Tue Apr 12 02:51:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:51:55.881049 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab7d12-fb25-4866-a740-a2e3c400397a None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:55.982654 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab7d12-fb25-4866-a740-a2e3c400397a None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:56.015129 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e53180-b008-4d91-858a-f74a8b251a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:56.016255 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e53180-b008-4d91-858a-f74a8b251a66 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:56.016673 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e53180-b008-4d91-858a-f74a8b251a66 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:56.017102 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e53180-b008-4d91-858a-f74a8b251a66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:56.027871 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e53180-b008-4d91-858a-f74a8b251a66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:56.029615 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e53180-b008-4d91-858a-f74a8b251a66 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:56.047236 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-85e53180-b008-4d91-858a-f74a8b251a66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:56.049043 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 457/936] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:56.054829 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89852825-7c70-4be2-92bb-cf95a8352a1c None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:56.160632 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89852825-7c70-4be2-92bb-cf95a8352a1c None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:56.194861 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f475add-9247-461d-b5fe-e4ba0434fe26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:56.195523 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f475add-9247-461d-b5fe-e4ba0434fe26 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:56.195824 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f475add-9247-461d-b5fe-e4ba0434fe26 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:56.196092 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f475add-9247-461d-b5fe-e4ba0434fe26 None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:56.196812 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f475add-9247-461d-b5fe-e4ba0434fe26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:56.197107 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f475add-9247-461d-b5fe-e4ba0434fe26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:56.198980 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f475add-9247-461d-b5fe-e4ba0434fe26 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:56.212336 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 480/937] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:56.218281 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e53180-b008-4d91-858a-f74a8b251a66 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:56.318548 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e53180-b008-4d91-858a-f74a8b251a66 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:56.351440 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb4463-3a11-4751-b320-645cf8f5fdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:56.352273 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb4463-3a11-4751-b320-645cf8f5fdf3 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:56.352544 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb4463-3a11-4751-b320-645cf8f5fdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:56.352806 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb4463-3a11-4751-b320-645cf8f5fdf3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:56.361911 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb4463-3a11-4751-b320-645cf8f5fdf3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:56.363405 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb4463-3a11-4751-b320-645cf8f5fdf3 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:56.378466 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-d6fb4463-3a11-4751-b320-645cf8f5fdf3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 12 02:51:56.380102 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 458/938] 10.222.0.32 () {56 vars in 1117 bytes} [Tue Apr 12 02:51:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:56.386210 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f475add-9247-461d-b5fe-e4ba0434fe26 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:56.488803 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f475add-9247-461d-b5fe-e4ba0434fe26 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:56.524455 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411cace-d19d-4b3e-b07c-a880f08642d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:56.525134 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411cace-d19d-4b3e-b07c-a880f08642d1 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:56.525435 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411cace-d19d-4b3e-b07c-a880f08642d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:56.525713 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411cace-d19d-4b3e-b07c-a880f08642d1 None admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:56.526683 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411cace-d19d-4b3e-b07c-a880f08642d1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:56.527017 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411cace-d19d-4b3e-b07c-a880f08642d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:56.528514 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411cace-d19d-4b3e-b07c-a880f08642d1 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:56.546855 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 481/939] 10.222.0.32 () {56 vars in 1149 bytes} [Tue Apr 12 02:51:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:56.552397 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb4463-3a11-4751-b320-645cf8f5fdf3 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:56.656317 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb4463-3a11-4751-b320-645cf8f5fdf3 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:56.691259 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e645b-c218-453d-a680-246dc962ced9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:56.692109 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e645b-c218-453d-a680-246dc962ced9 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:56.692381 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e645b-c218-453d-a680-246dc962ced9 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:56.692648 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e645b-c218-453d-a680-246dc962ced9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:56.705188 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e645b-c218-453d-a680-246dc962ced9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:56.706706 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e645b-c218-453d-a680-246dc962ced9 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:56.723986 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-009e645b-c218-453d-a680-246dc962ced9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:51:56.725563 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 459/940] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:51:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:56.733030 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411cace-d19d-4b3e-b07c-a880f08642d1 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:56.761644 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c9739-9500-4169-9e73-a56826d91e15 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:56.761922 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c9739-9500-4169-9e73-a56826d91e15 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:56.762107 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c9739-9500-4169-9e73-a56826d91e15 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:56.763784 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 460/941] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:51:56.768766 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e41ea-22cf-4eb0-9d71-64b229a6e3e0 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:56.769056 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e41ea-22cf-4eb0-9d71-64b229a6e3e0 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:56.769317 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e41ea-22cf-4eb0-9d71-64b229a6e3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:56.785987 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-c52e41ea-22cf-4eb0-9d71-64b229a6e3e0 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:56.787155 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-c52e41ea-22cf-4eb0-9d71-64b229a6e3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:56.848856 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411cace-d19d-4b3e-b07c-a880f08642d1 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:56.856040 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 461/942] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 02:51:56.875319 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e41ea-22cf-4eb0-9d71-64b229a6e3e0 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:56.884306 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90483170-9366-4a8d-a731-4654a1e3b574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:56.885136 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90483170-9366-4a8d-a731-4654a1e3b574 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:56.885989 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90483170-9366-4a8d-a731-4654a1e3b574 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:56.886268 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90483170-9366-4a8d-a731-4654a1e3b574 None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:56.887297 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90483170-9366-4a8d-a731-4654a1e3b574 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:56.887604 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90483170-9366-4a8d-a731-4654a1e3b574 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:56.889286 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90483170-9366-4a8d-a731-4654a1e3b574 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:56.903566 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 482/943] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:56.910359 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90483170-9366-4a8d-a731-4654a1e3b574 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:56.984155 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e41ea-22cf-4eb0-9d71-64b229a6e3e0 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:57.017863 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df64fa5-1af3-4be2-919c-419be2f15882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:57.018618 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df64fa5-1af3-4be2-919c-419be2f15882 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:57.018849 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df64fa5-1af3-4be2-919c-419be2f15882 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:57.019183 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df64fa5-1af3-4be2-919c-419be2f15882 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:57.022155 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df64fa5-1af3-4be2-919c-419be2f15882 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:57.022155 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df64fa5-1af3-4be2-919c-419be2f15882 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:57.032641 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-9df64fa5-1af3-4be2-919c-419be2f15882 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 12 02:51:57.038857 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90483170-9366-4a8d-a731-4654a1e3b574 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:57.039831 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 462/944] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:51:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:51:57.041401 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df64fa5-1af3-4be2-919c-419be2f15882 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:57.091116 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8225b7d-d06a-4d0b-b600-9ed6f6445d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:57.092886 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8225b7d-d06a-4d0b-b600-9ed6f6445d25 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:57.093629 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8225b7d-d06a-4d0b-b600-9ed6f6445d25 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:57.094149 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8225b7d-d06a-4d0b-b600-9ed6f6445d25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:57.103866 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8225b7d-d06a-4d0b-b600-9ed6f6445d25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:57.106329 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8225b7d-d06a-4d0b-b600-9ed6f6445d25 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:57.124402 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-f8225b7d-d06a-4d0b-b600-9ed6f6445d25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:51:57.130883 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 483/945] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:51:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:51:57.131970 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8225b7d-d06a-4d0b-b600-9ed6f6445d25 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:57.154921 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df64fa5-1af3-4be2-919c-419be2f15882 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:57.198315 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7b053-7a44-48d3-9992-c0ad4b4f003e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:57.200139 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7b053-7a44-48d3-9992-c0ad4b4f003e None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:57.200251 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7b053-7a44-48d3-9992-c0ad4b4f003e None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:57.200483 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7b053-7a44-48d3-9992-c0ad4b4f003e None admin] PATH_INFO: `/v3/services` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:57.201195 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb7b053-7a44-48d3-9992-c0ad4b4f003e None admin] RBAC: Adding query filter params (name=compute) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:57.201499 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb7b053-7a44-48d3-9992-c0ad4b4f003e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:57.203263 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb7b053-7a44-48d3-9992-c0ad4b4f003e None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:57.208523 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 463/946] 10.222.0.32 () {56 vars in 1112 bytes} [Tue Apr 12 02:51:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:51:57.214051 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7b053-7a44-48d3-9992-c0ad4b4f003e None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:57.239080 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8225b7d-d06a-4d0b-b600-9ed6f6445d25 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:57.285861 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d06e9-d6cb-4908-a22f-81792adaf717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:57.287052 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d06e9-d6cb-4908-a22f-81792adaf717 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:57.287703 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d06e9-d6cb-4908-a22f-81792adaf717 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:57.288181 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d06e9-d6cb-4908-a22f-81792adaf717 None admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:57.289113 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d06e9-d6cb-4908-a22f-81792adaf717 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:57.289553 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d06e9-d6cb-4908-a22f-81792adaf717 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:57.292175 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d06e9-d6cb-4908-a22f-81792adaf717 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:57.305680 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 484/947] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 02:51:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:57.307045 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a719a4-dc64-4595-a25c-577f36250aa4 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:57.307350 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a719a4-dc64-4595-a25c-577f36250aa4 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:57.307596 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a719a4-dc64-4595-a25c-577f36250aa4 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:57.309051 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 485/948] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:57.313170 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a719a4-dc64-4595-a25c-577f36250aa4 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:57.335279 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7b053-7a44-48d3-9992-c0ad4b4f003e None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:57.370042 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b255a0c-819e-408c-a1a2-5f13b6e5b320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:57.370804 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b255a0c-819e-408c-a1a2-5f13b6e5b320 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:57.371247 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b255a0c-819e-408c-a1a2-5f13b6e5b320 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:57.371703 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b255a0c-819e-408c-a1a2-5f13b6e5b320 None admin] PATH_INFO: `/v3/services` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:57.372498 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b255a0c-819e-408c-a1a2-5f13b6e5b320 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:57.372815 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b255a0c-819e-408c-a1a2-5f13b6e5b320 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:57.374628 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b255a0c-819e-408c-a1a2-5f13b6e5b320 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:57.387762 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 464/949] 10.222.0.32 () {56 vars in 1112 bytes} [Tue Apr 12 02:51:57 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:51:57.387762 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1254262-7303-4db5-8f7f-7d5d1fe20367 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:57.387762 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1254262-7303-4db5-8f7f-7d5d1fe20367 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:57.387762 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1254262-7303-4db5-8f7f-7d5d1fe20367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:57.402304 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-c1254262-7303-4db5-8f7f-7d5d1fe20367 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:57.403524 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-c1254262-7303-4db5-8f7f-7d5d1fe20367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:57.433040 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a719a4-dc64-4595-a25c-577f36250aa4 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:57.477559 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5997efd9-3afd-4c76-8ef1-e0ebf565156b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:57.478715 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997efd9-3afd-4c76-8ef1-e0ebf565156b None admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:57.479162 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997efd9-3afd-4c76-8ef1-e0ebf565156b None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:57.479438 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997efd9-3afd-4c76-8ef1-e0ebf565156b None admin] PATH_INFO: `/v3/projects/82cb5f6cfa0e46b28a37565fc2b560ed/users/83115653901749f6ade6638593fb54e9/roles/94f6d87df94e495d8f9a139ab8a39ef5` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:57.481881 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5997efd9-3afd-4c76-8ef1-e0ebf565156b None admin] RBAC: Authorizing `identity:create_grant(project_id=82cb5f6cfa0e46b28a37565fc2b560ed, user_id=83115653901749f6ade6638593fb54e9, role_id=94f6d87df94e495d8f9a139ab8a39ef5)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:57.483358 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5997efd9-3afd-4c76-8ef1-e0ebf565156b None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:57.487917 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 465/950] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:51:57.504926 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1254262-7303-4db5-8f7f-7d5d1fe20367 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:57.511979 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 486/951] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 02:51:57 2022] PUT /identity/v3/projects/82cb5f6cfa0e46b28a37565fc2b560ed/users/83115653901749f6ade6638593fb54e9/roles/94f6d87df94e495d8f9a139ab8a39ef5 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 02:51:57.623837 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1254262-7303-4db5-8f7f-7d5d1fe20367 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:57.660474 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503723ad-85b4-46cc-8123-1b4de99783a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:57.661684 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503723ad-85b4-46cc-8123-1b4de99783a5 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:57.662158 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503723ad-85b4-46cc-8123-1b4de99783a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:57.662620 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503723ad-85b4-46cc-8123-1b4de99783a5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:57.663516 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503723ad-85b4-46cc-8123-1b4de99783a5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:57.665243 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503723ad-85b4-46cc-8123-1b4de99783a5 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:57.677868 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-503723ad-85b4-46cc-8123-1b4de99783a5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 12 02:51:57.679924 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 466/952] 10.222.0.32 () {56 vars in 1126 bytes} [Tue Apr 12 02:51:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:57.686491 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5997efd9-3afd-4c76-8ef1-e0ebf565156b None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:57.801175 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5997efd9-3afd-4c76-8ef1-e0ebf565156b None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:57.834165 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece7ac2-9cf3-44b2-bf89-3978696f050f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:57.834841 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece7ac2-9cf3-44b2-bf89-3978696f050f None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:57.835119 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece7ac2-9cf3-44b2-bf89-3978696f050f None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:57.835386 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece7ac2-9cf3-44b2-bf89-3978696f050f None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:57.836134 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece7ac2-9cf3-44b2-bf89-3978696f050f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:57.836433 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece7ac2-9cf3-44b2-bf89-3978696f050f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:57.837823 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece7ac2-9cf3-44b2-bf89-3978696f050f None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:57.843042 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 487/953] 10.222.0.32 () {56 vars in 1122 bytes} [Tue Apr 12 02:51:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:57.848676 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503723ad-85b4-46cc-8123-1b4de99783a5 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:57.922219 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2fc59b-f723-42bf-9211-a7d88b7c3dbb None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:57.922475 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2fc59b-f723-42bf-9211-a7d88b7c3dbb None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:57.922961 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2fc59b-f723-42bf-9211-a7d88b7c3dbb None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:57.924748 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 488/954] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:51:57.930096 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeedc939-a102-4cbc-a9cb-fcfc489b3278 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:57.930546 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeedc939-a102-4cbc-a9cb-fcfc489b3278 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:57.930984 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeedc939-a102-4cbc-a9cb-fcfc489b3278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:57.948180 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-eeedc939-a102-4cbc-a9cb-fcfc489b3278 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:57.949566 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-eeedc939-a102-4cbc-a9cb-fcfc489b3278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:57.953801 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503723ad-85b4-46cc-8123-1b4de99783a5 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:57.997825 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f529ca-54a8-4b84-a5f2-31e5d3421d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:57.998502 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f529ca-54a8-4b84-a5f2-31e5d3421d4c None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:57.998772 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f529ca-54a8-4b84-a5f2-31e5d3421d4c None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:57.999041 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f529ca-54a8-4b84-a5f2-31e5d3421d4c None admin] PATH_INFO: `/v3/services` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:58.000064 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f529ca-54a8-4b84-a5f2-31e5d3421d4c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:58.000366 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f529ca-54a8-4b84-a5f2-31e5d3421d4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:58.001755 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f529ca-54a8-4b84-a5f2-31e5d3421d4c None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:58.008399 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 467/955] 10.222.0.32 () {56 vars in 1122 bytes} [Tue Apr 12 02:51:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:51:58.013921 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f529ca-54a8-4b84-a5f2-31e5d3421d4c None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:58.019510 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 489/956] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:51:58.044083 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeedc939-a102-4cbc-a9cb-fcfc489b3278 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:58.111620 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f529ca-54a8-4b84-a5f2-31e5d3421d4c None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:58.141784 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeedc939-a102-4cbc-a9cb-fcfc489b3278 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:58.145566 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641d289-1bce-4691-a9f0-3154cb565f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:58.146419 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641d289-1bce-4691-a9f0-3154cb565f91 None admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:58.146880 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641d289-1bce-4691-a9f0-3154cb565f91 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:58.147313 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641d289-1bce-4691-a9f0-3154cb565f91 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:58.148230 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641d289-1bce-4691-a9f0-3154cb565f91 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:58.149785 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641d289-1bce-4691-a9f0-3154cb565f91 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:58.179836 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 468/957] 10.222.0.32 () {60 vars in 1144 bytes} [Tue Apr 12 02:51:58 2022] POST /identity/v3/endpoints => generated 349 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 02:51:58.192526 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6913a-5d78-4164-84f9-8664692847dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:58.193204 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6913a-5d78-4164-84f9-8664692847dc None admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:58.193484 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6913a-5d78-4164-84f9-8664692847dc None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:58.193857 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6913a-5d78-4164-84f9-8664692847dc None admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:58.194583 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6913a-5d78-4164-84f9-8664692847dc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:58.196091 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6913a-5d78-4164-84f9-8664692847dc None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:58.197630 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.common [None req-00b6913a-5d78-4164-84f9-8664692847dc None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 12 02:51:58.220628 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.sql.core [None req-00b6913a-5d78-4164-84f9-8664692847dc None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Apr 12 02:51:58.220628 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 12 02:51:58.220628 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [parameters: {'id': '5bd4e9d310734cf98eae55c0e0b36e22', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Apr 12 02:51:58.220628 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79724) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 12 02:51:58.227162 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-00b6913a-5d78-4164-84f9-8664692847dc None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5bd4e9d310734cf98eae55c0e0b36e22.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5bd4e9d310734cf98eae55c0e0b36e22. Apr 12 02:51:58.228994 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 490/958] 10.222.0.32 () {60 vars in 1140 bytes} [Tue Apr 12 02:51:58 2022] POST /identity/v3/projects => generated 262 bytes in 185 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:58.234961 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641d289-1bce-4691-a9f0-3154cb565f91 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:58.348142 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641d289-1bce-4691-a9f0-3154cb565f91 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:58.387214 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bdda39-49b6-4cfc-8b24-3b30b0b9b8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:58.388105 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdda39-49b6-4cfc-8b24-3b30b0b9b8ac None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:58.388383 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdda39-49b6-4cfc-8b24-3b30b0b9b8ac None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:58.388653 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdda39-49b6-4cfc-8b24-3b30b0b9b8ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:58.395845 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bdda39-49b6-4cfc-8b24-3b30b0b9b8ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:58.397332 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bdda39-49b6-4cfc-8b24-3b30b0b9b8ac None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:58.411636 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-24bdda39-49b6-4cfc-8b24-3b30b0b9b8ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:51:58.413240 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 469/959] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:51:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:51:58.419669 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6913a-5d78-4164-84f9-8664692847dc None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:58.524883 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6913a-5d78-4164-84f9-8664692847dc None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:51:58.558100 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6887fbd-4563-48a6-ac6c-5423bdbe15eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:51:58.558778 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6887fbd-4563-48a6-ac6c-5423bdbe15eb None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:58.559048 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6887fbd-4563-48a6-ac6c-5423bdbe15eb None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:58.559312 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6887fbd-4563-48a6-ac6c-5423bdbe15eb None admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:58.560096 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6887fbd-4563-48a6-ac6c-5423bdbe15eb None admin] RBAC: Adding query filter params (name=service) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:51:58.560391 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6887fbd-4563-48a6-ac6c-5423bdbe15eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:51:58.562020 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6887fbd-4563-48a6-ac6c-5423bdbe15eb None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:51:58.583356 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 491/960] 10.222.0.32 () {56 vars in 1112 bytes} [Tue Apr 12 02:51:58 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:51:59.815231 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444e465-cf36-4f4d-942d-9e269a7e8bd4 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:59.815802 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444e465-cf36-4f4d-942d-9e269a7e8bd4 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:59.815802 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444e465-cf36-4f4d-942d-9e269a7e8bd4 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:59.817428 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 470/961] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:59.823187 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d616f-769f-4562-8afd-0f9d26870d2b None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:59.823610 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d616f-769f-4562-8afd-0f9d26870d2b None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:59.823819 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d616f-769f-4562-8afd-0f9d26870d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:59.841178 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-2f1d616f-769f-4562-8afd-0f9d26870d2b None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:59.842683 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-2f1d616f-769f-4562-8afd-0f9d26870d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:51:59.909421 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 492/962] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:51:59.913344 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b601a-1ad1-4686-8726-d70768dd708a None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:59.913620 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b601a-1ad1-4686-8726-d70768dd708a None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:59.913883 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b601a-1ad1-4686-8726-d70768dd708a None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:59.915444 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 471/963] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:51:59.920733 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4596fff-4c89-4066-b221-a892e49b8294 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:51:59.921015 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4596fff-4c89-4066-b221-a892e49b8294 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:51:59.921284 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4596fff-4c89-4066-b221-a892e49b8294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:51:59.931990 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b601a-1ad1-4686-8726-d70768dd708a None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:51:59.939246 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-b4596fff-4c89-4066-b221-a892e49b8294 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:51:59.940434 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-b4596fff-4c89-4066-b221-a892e49b8294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:52:00.004566 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 493/964] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:51:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 02:52:00.031977 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4596fff-4c89-4066-b221-a892e49b8294 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:00.032471 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b601a-1ad1-4686-8726-d70768dd708a None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:00.074148 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002fd7c-8613-4ed5-b547-3e6643f37e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:00.074814 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002fd7c-8613-4ed5-b547-3e6643f37e62 None admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:00.075082 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002fd7c-8613-4ed5-b547-3e6643f37e62 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:00.075345 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002fd7c-8613-4ed5-b547-3e6643f37e62 None admin] PATH_INFO: `/v3/services` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:00.076072 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002fd7c-8613-4ed5-b547-3e6643f37e62 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:00.077453 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002fd7c-8613-4ed5-b547-3e6643f37e62 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:00.097630 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 472/965] 10.222.0.32 () {60 vars in 1141 bytes} [Tue Apr 12 02:51:59 2022] POST /identity/v3/services => generated 242 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 02:52:00.149164 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4596fff-4c89-4066-b221-a892e49b8294 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:00.196858 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ffa31-eabb-43b7-b75b-5edb411fa18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:00.197712 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ffa31-eabb-43b7-b75b-5edb411fa18c None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:00.197987 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ffa31-eabb-43b7-b75b-5edb411fa18c None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:00.198326 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ffa31-eabb-43b7-b75b-5edb411fa18c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:00.211335 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ffa31-eabb-43b7-b75b-5edb411fa18c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:52:00.219069 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-b40ffa31-eabb-43b7-b75b-5edb411fa18c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 12 02:52:00.220820 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 494/966] 10.222.0.32 () {56 vars in 1120 bytes} [Tue Apr 12 02:52:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:52:00.226679 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002fd7c-8613-4ed5-b547-3e6643f37e62 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:00.335768 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002fd7c-8613-4ed5-b547-3e6643f37e62 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:00.368335 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb1379-90f6-497e-a105-b8f42528cb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:00.369024 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb1379-90f6-497e-a105-b8f42528cb29 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:00.369295 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb1379-90f6-497e-a105-b8f42528cb29 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:00.369562 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb1379-90f6-497e-a105-b8f42528cb29 None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:00.370293 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb1379-90f6-497e-a105-b8f42528cb29 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:00.370589 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb1379-90f6-497e-a105-b8f42528cb29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:00.371979 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb1379-90f6-497e-a105-b8f42528cb29 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:00.380324 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 473/967] 10.222.0.32 () {56 vars in 1115 bytes} [Tue Apr 12 02:52:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:00.385889 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ffa31-eabb-43b7-b75b-5edb411fa18c None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:00.482762 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ffa31-eabb-43b7-b75b-5edb411fa18c None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:00.525655 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae91f4-9f15-4383-b6db-995d5df47ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:00.526841 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae91f4-9f15-4383-b6db-995d5df47ace None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:00.527345 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae91f4-9f15-4383-b6db-995d5df47ace None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:00.527843 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae91f4-9f15-4383-b6db-995d5df47ace None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:00.538988 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae91f4-9f15-4383-b6db-995d5df47ace None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:00.540717 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae91f4-9f15-4383-b6db-995d5df47ace None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:00.557270 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-ddae91f4-9f15-4383-b6db-995d5df47ace None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:52:00.559156 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 495/968] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:52:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:52:00.564599 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb1379-90f6-497e-a105-b8f42528cb29 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:00.580314 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3ca8c-358f-45a6-91f1-176b80eab17c None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:00.580616 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3ca8c-358f-45a6-91f1-176b80eab17c None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:00.580857 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3ca8c-358f-45a6-91f1-176b80eab17c None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:00.582473 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 496/969] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:52:00.587251 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bee61-8b40-4ca2-9743-9860401683b8 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:00.587522 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bee61-8b40-4ca2-9743-9860401683b8 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:00.587903 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bee61-8b40-4ca2-9743-9860401683b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:00.604705 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-790bee61-8b40-4ca2-9743-9860401683b8 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:52:00.605876 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-790bee61-8b40-4ca2-9743-9860401683b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:52:00.678848 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb1379-90f6-497e-a105-b8f42528cb29 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:00.683331 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 497/970] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:52:00 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 02:52:00.702598 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790bee61-8b40-4ca2-9743-9860401683b8 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:00.715187 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b87f9-b60c-4ebc-9c19-03aced7ddc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:00.716107 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b87f9-b60c-4ebc-9c19-03aced7ddc21 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:00.716528 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b87f9-b60c-4ebc-9c19-03aced7ddc21 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:00.716996 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b87f9-b60c-4ebc-9c19-03aced7ddc21 None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:00.717874 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b87f9-b60c-4ebc-9c19-03aced7ddc21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:00.718393 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b87f9-b60c-4ebc-9c19-03aced7ddc21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:00.720034 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b87f9-b60c-4ebc-9c19-03aced7ddc21 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:00.732535 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 474/971] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:00.738238 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b87f9-b60c-4ebc-9c19-03aced7ddc21 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:00.822306 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790bee61-8b40-4ca2-9743-9860401683b8 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:00.851809 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b87f9-b60c-4ebc-9c19-03aced7ddc21 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:00.855672 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874dd9a-7460-4faf-a6a2-3b5c80ac8401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:00.856154 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874dd9a-7460-4faf-a6a2-3b5c80ac8401 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:00.856154 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874dd9a-7460-4faf-a6a2-3b5c80ac8401 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:00.856399 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874dd9a-7460-4faf-a6a2-3b5c80ac8401 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:00.856982 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b874dd9a-7460-4faf-a6a2-3b5c80ac8401 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:00.858357 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b874dd9a-7460-4faf-a6a2-3b5c80ac8401 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:00.869731 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-b874dd9a-7460-4faf-a6a2-3b5c80ac8401 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 12 02:52:00.876102 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 498/972] 10.222.0.32 () {56 vars in 1126 bytes} [Tue Apr 12 02:52:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:52:00.876930 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874dd9a-7460-4faf-a6a2-3b5c80ac8401 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:00.889130 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43527a4c-cfa1-4eff-9b03-f6b13f6e79f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:00.890266 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43527a4c-cfa1-4eff-9b03-f6b13f6e79f9 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:00.890728 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43527a4c-cfa1-4eff-9b03-f6b13f6e79f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:00.891209 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43527a4c-cfa1-4eff-9b03-f6b13f6e79f9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:00.898831 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43527a4c-cfa1-4eff-9b03-f6b13f6e79f9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:00.900635 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43527a4c-cfa1-4eff-9b03-f6b13f6e79f9 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:00.915316 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-43527a4c-cfa1-4eff-9b03-f6b13f6e79f9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 12 02:52:00.922303 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 475/973] 10.222.0.32 () {56 vars in 1117 bytes} [Tue Apr 12 02:52:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:52:00.923418 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43527a4c-cfa1-4eff-9b03-f6b13f6e79f9 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:00.974982 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874dd9a-7460-4faf-a6a2-3b5c80ac8401 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:01.014313 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862d250-5bc7-4dbe-8412-157adb006edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:01.015086 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862d250-5bc7-4dbe-8412-157adb006edc None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:01.015365 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862d250-5bc7-4dbe-8412-157adb006edc None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:01.016006 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862d250-5bc7-4dbe-8412-157adb006edc None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:01.017000 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862d250-5bc7-4dbe-8412-157adb006edc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:01.017309 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862d250-5bc7-4dbe-8412-157adb006edc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:01.019145 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862d250-5bc7-4dbe-8412-157adb006edc None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:01.025779 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 499/974] 10.222.0.32 () {56 vars in 1122 bytes} [Tue Apr 12 02:52:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:01.031093 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b555f-0109-4066-9540-19439eff9842 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:01.031376 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b555f-0109-4066-9540-19439eff9842 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:01.031646 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b555f-0109-4066-9540-19439eff9842 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:01.032986 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 500/975] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:52:01.034934 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b555f-0109-4066-9540-19439eff9842 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:01.040689 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43527a4c-cfa1-4eff-9b03-f6b13f6e79f9 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:01.074973 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4987df4-eb10-43b0-80b8-e85c239d7539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:01.075648 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4987df4-eb10-43b0-80b8-e85c239d7539 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:01.075948 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4987df4-eb10-43b0-80b8-e85c239d7539 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:01.076211 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4987df4-eb10-43b0-80b8-e85c239d7539 None admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:01.077034 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4987df4-eb10-43b0-80b8-e85c239d7539 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:01.077336 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4987df4-eb10-43b0-80b8-e85c239d7539 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:01.079146 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4987df4-eb10-43b0-80b8-e85c239d7539 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:01.101341 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 476/976] 10.222.0.32 () {56 vars in 1149 bytes} [Tue Apr 12 02:52:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:01.101341 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9dc2d-1a94-405a-8a8f-1ffb860b0b0b None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:01.101341 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9dc2d-1a94-405a-8a8f-1ffb860b0b0b None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:01.101341 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9dc2d-1a94-405a-8a8f-1ffb860b0b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:01.118529 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-4da9dc2d-1a94-405a-8a8f-1ffb860b0b0b None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:52:01.120197 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-4da9dc2d-1a94-405a-8a8f-1ffb860b0b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:52:01.154249 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b555f-0109-4066-9540-19439eff9842 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:01.184608 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 477/977] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:52:01 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:52:01.185372 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9dc2d-1a94-405a-8a8f-1ffb860b0b0b None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:01.191120 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df19b52-7b00-4b40-862b-439618b5e946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:01.192140 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df19b52-7b00-4b40-862b-439618b5e946 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:01.192607 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df19b52-7b00-4b40-862b-439618b5e946 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:01.193492 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df19b52-7b00-4b40-862b-439618b5e946 None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:01.194411 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df19b52-7b00-4b40-862b-439618b5e946 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:01.195251 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df19b52-7b00-4b40-862b-439618b5e946 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:01.197338 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df19b52-7b00-4b40-862b-439618b5e946 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:01.204168 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 501/978] 10.222.0.32 () {56 vars in 1122 bytes} [Tue Apr 12 02:52:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:01.211851 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df19b52-7b00-4b40-862b-439618b5e946 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:01.289222 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9dc2d-1a94-405a-8a8f-1ffb860b0b0b None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:01.316015 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df19b52-7b00-4b40-862b-439618b5e946 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:01.324337 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0bbbb0-b5f5-4b0c-9a87-5ba2ed09f9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:01.325008 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bbbb0-b5f5-4b0c-9a87-5ba2ed09f9b0 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:01.325286 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bbbb0-b5f5-4b0c-9a87-5ba2ed09f9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:01.325553 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bbbb0-b5f5-4b0c-9a87-5ba2ed09f9b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:01.351744 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a92dd-551c-4cc7-8752-34d4e3731880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:01.352478 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a92dd-551c-4cc7-8752-34d4e3731880 None admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:01.352759 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a92dd-551c-4cc7-8752-34d4e3731880 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:01.353021 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a92dd-551c-4cc7-8752-34d4e3731880 None admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:01.354108 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a92dd-551c-4cc7-8752-34d4e3731880 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:01.355569 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a92dd-551c-4cc7-8752-34d4e3731880 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:01.369569 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.sql.core [None req-4a7a92dd-551c-4cc7-8752-34d4e3731880 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Apr 12 02:52:01.369569 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Apr 12 02:52:01.369569 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [parameters: {'user_id': '5f484d7a82eb439b9eec5066a7606f4e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Apr 12 02:52:01.369569 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79724) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 12 02:52:01.375790 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-4a7a92dd-551c-4cc7-8752-34d4e3731880 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Apr 12 02:52:01.379755 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 502/979] 10.222.0.32 () {60 vars in 1131 bytes} [Tue Apr 12 02:52:01 2022] POST /identity/v3/users => generated 160 bytes in 166 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:52:01.379755 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a92dd-551c-4cc7-8752-34d4e3731880 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:01.397250 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0bbbb0-b5f5-4b0c-9a87-5ba2ed09f9b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:01.398940 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0bbbb0-b5f5-4b0c-9a87-5ba2ed09f9b0 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:01.480862 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a92dd-551c-4cc7-8752-34d4e3731880 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:01.514225 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 478/980] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:52:01 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 02:52:01.514894 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0bbbb0-b5f5-4b0c-9a87-5ba2ed09f9b0 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:01.523631 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebd834-496b-4f66-abc9-90bcfb3ccc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:01.524361 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebd834-496b-4f66-abc9-90bcfb3ccc6e None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:01.524596 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebd834-496b-4f66-abc9-90bcfb3ccc6e None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:01.524864 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebd834-496b-4f66-abc9-90bcfb3ccc6e None admin] PATH_INFO: `/v3/endpoints` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:01.526111 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebd834-496b-4f66-abc9-90bcfb3ccc6e None admin] RBAC: Adding query filter params (interface=admin, service_id=9c68128ed7e04f6da80fbb0a0e99c65f, region_id=RegionOne) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:01.526619 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebd834-496b-4f66-abc9-90bcfb3ccc6e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:01.528253 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebd834-496b-4f66-abc9-90bcfb3ccc6e None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:01.536346 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 503/981] 10.222.0.32 () {56 vars in 1249 bytes} [Tue Apr 12 02:52:01 2022] GET /identity/v3/endpoints?service_id=9c68128ed7e04f6da80fbb0a0e99c65f&interface=admin®ion_id=RegionOne => generated 193 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:01.537122 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebd834-496b-4f66-abc9-90bcfb3ccc6e None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:01.621366 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0bbbb0-b5f5-4b0c-9a87-5ba2ed09f9b0 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:01.636870 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebd834-496b-4f66-abc9-90bcfb3ccc6e None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:01.655602 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fcdf9-283b-4cd2-877d-12a9ebc1adc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:01.656472 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fcdf9-283b-4cd2-877d-12a9ebc1adc3 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:01.656751 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fcdf9-283b-4cd2-877d-12a9ebc1adc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:01.657010 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fcdf9-283b-4cd2-877d-12a9ebc1adc3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:01.664209 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7fcdf9-283b-4cd2-877d-12a9ebc1adc3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:01.665670 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7fcdf9-283b-4cd2-877d-12a9ebc1adc3 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:01.671571 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3aec9-5c7a-4daf-9e8d-d5405887371c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:01.672656 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3aec9-5c7a-4daf-9e8d-d5405887371c None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:01.672941 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3aec9-5c7a-4daf-9e8d-d5405887371c None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:01.673303 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3aec9-5c7a-4daf-9e8d-d5405887371c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:01.680587 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-7d7fcdf9-283b-4cd2-877d-12a9ebc1adc3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 12 02:52:01.681845 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 479/982] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:52:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:52:01.687096 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fcdf9-283b-4cd2-877d-12a9ebc1adc3 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:01.687191 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3aec9-5c7a-4daf-9e8d-d5405887371c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:01.687191 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3aec9-5c7a-4daf-9e8d-d5405887371c None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:01.703826 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-f0f3aec9-5c7a-4daf-9e8d-d5405887371c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:52:01.705593 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 504/983] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:52:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:52:01.706553 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3aec9-5c7a-4daf-9e8d-d5405887371c None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:01.782560 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fcdf9-283b-4cd2-877d-12a9ebc1adc3 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:01.810709 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3aec9-5c7a-4daf-9e8d-d5405887371c None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:01.814775 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf589d8-0dbc-4a32-9775-3c7affba22c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:01.815441 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf589d8-0dbc-4a32-9775-3c7affba22c3 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:01.815714 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf589d8-0dbc-4a32-9775-3c7affba22c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:01.816006 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf589d8-0dbc-4a32-9775-3c7affba22c3 None admin] PATH_INFO: `/v3/services` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:01.816671 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf589d8-0dbc-4a32-9775-3c7affba22c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:01.818180 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf589d8-0dbc-4a32-9775-3c7affba22c3 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:01.825499 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 480/984] 10.222.0.32 () {56 vars in 1087 bytes} [Tue Apr 12 02:52:01 2022] GET /identity/v3/services => generated 1727 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 02:52:01.826214 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf589d8-0dbc-4a32-9775-3c7affba22c3 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:01.853828 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d3d82-b001-4b64-bb65-b353faf98dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:01.855224 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d3d82-b001-4b64-bb65-b353faf98dab None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:01.855815 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d3d82-b001-4b64-bb65-b353faf98dab None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:01.856837 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d3d82-b001-4b64-bb65-b353faf98dab None admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:01.857955 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d3d82-b001-4b64-bb65-b353faf98dab None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:01.858460 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d3d82-b001-4b64-bb65-b353faf98dab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:01.860199 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d3d82-b001-4b64-bb65-b353faf98dab None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:01.899507 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 505/985] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 02:52:01 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:01.938453 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf589d8-0dbc-4a32-9775-3c7affba22c3 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:01.978591 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11378e0-490b-4c71-ab9b-d2eccb03c6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:01.979287 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11378e0-490b-4c71-ab9b-d2eccb03c6b1 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:01.979556 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11378e0-490b-4c71-ab9b-d2eccb03c6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:01.979926 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11378e0-490b-4c71-ab9b-d2eccb03c6b1 None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:01.980659 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11378e0-490b-4c71-ab9b-d2eccb03c6b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:01.980958 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11378e0-490b-4c71-ab9b-d2eccb03c6b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:01.982405 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11378e0-490b-4c71-ab9b-d2eccb03c6b1 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:01.997091 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 481/986] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:02.002928 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d3d82-b001-4b64-bb65-b353faf98dab None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:02.114589 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d3d82-b001-4b64-bb65-b353faf98dab None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:02.150113 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03e6ef-02e4-4cb3-882a-e4e05dbe64a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:02.151503 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03e6ef-02e4-4cb3-882a-e4e05dbe64a4 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:02.152088 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03e6ef-02e4-4cb3-882a-e4e05dbe64a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:02.152594 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03e6ef-02e4-4cb3-882a-e4e05dbe64a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:02.160765 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a03e6ef-02e4-4cb3-882a-e4e05dbe64a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:02.162596 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a03e6ef-02e4-4cb3-882a-e4e05dbe64a4 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:02.177503 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-5a03e6ef-02e4-4cb3-882a-e4e05dbe64a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:52:02.179489 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 506/987] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:52:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:52:02.186982 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11378e0-490b-4c71-ab9b-d2eccb03c6b1 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:02.288230 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11378e0-490b-4c71-ab9b-d2eccb03c6b1 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:02.322918 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55afd3e-121b-4597-8417-3b248c0b1c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:02.323648 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55afd3e-121b-4597-8417-3b248c0b1c99 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:02.323947 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55afd3e-121b-4597-8417-3b248c0b1c99 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:02.324218 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55afd3e-121b-4597-8417-3b248c0b1c99 None admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:02.324990 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55afd3e-121b-4597-8417-3b248c0b1c99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:02.325293 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55afd3e-121b-4597-8417-3b248c0b1c99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:02.326733 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55afd3e-121b-4597-8417-3b248c0b1c99 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:02.338766 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 482/988] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 02:52:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:02.344822 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03e6ef-02e4-4cb3-882a-e4e05dbe64a4 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:02.445311 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03e6ef-02e4-4cb3-882a-e4e05dbe64a4 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:02.479043 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca859a6-1b94-4ef1-acd8-7a43c075d309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:02.479757 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca859a6-1b94-4ef1-acd8-7a43c075d309 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:02.480001 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca859a6-1b94-4ef1-acd8-7a43c075d309 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:02.480276 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca859a6-1b94-4ef1-acd8-7a43c075d309 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:02.481095 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca859a6-1b94-4ef1-acd8-7a43c075d309 None admin] RBAC: Adding query filter params (role.id=94f6d87df94e495d8f9a139ab8a39ef5, scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed, user.id=83115653901749f6ade6638593fb54e9) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:02.481455 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca859a6-1b94-4ef1-acd8-7a43c075d309 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:02.482945 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca859a6-1b94-4ef1-acd8-7a43c075d309 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:02.489162 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 507/989] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:52:02 2022] GET /identity/v3/role_assignments?user.id=83115653901749f6ade6638593fb54e9&scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed&role.id=94f6d87df94e495d8f9a139ab8a39ef5 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:02.532648 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a726be-7de8-4d60-b729-ca3139b10320 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:02.532929 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a726be-7de8-4d60-b729-ca3139b10320 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:02.533214 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a726be-7de8-4d60-b729-ca3139b10320 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:02.534635 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 483/990] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:52:02.540635 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c4e3a-023c-4c52-94f2-9a14721c40dc None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:02.541075 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c4e3a-023c-4c52-94f2-9a14721c40dc None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:02.541357 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c4e3a-023c-4c52-94f2-9a14721c40dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:02.559379 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-090c4e3a-023c-4c52-94f2-9a14721c40dc None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:52:02.561109 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-090c4e3a-023c-4c52-94f2-9a14721c40dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:52:02.644015 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 508/991] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:52:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:52:02.668943 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a726be-7de8-4d60-b729-ca3139b10320 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:02.769596 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a726be-7de8-4d60-b729-ca3139b10320 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:02.803526 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bea58b-c5e3-4076-8bdc-6d6230daf368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:02.804380 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bea58b-c5e3-4076-8bdc-6d6230daf368 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:02.804657 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bea58b-c5e3-4076-8bdc-6d6230daf368 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:02.804924 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bea58b-c5e3-4076-8bdc-6d6230daf368 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:02.805573 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bea58b-c5e3-4076-8bdc-6d6230daf368 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:02.807014 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bea58b-c5e3-4076-8bdc-6d6230daf368 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:02.818210 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-61bea58b-c5e3-4076-8bdc-6d6230daf368 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 12 02:52:02.819692 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 484/992] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:52:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:52:02.825806 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c4e3a-023c-4c52-94f2-9a14721c40dc None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:02.941481 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c4e3a-023c-4c52-94f2-9a14721c40dc None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:02.975632 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe7298-87e4-4c53-9031-7927fa5d60a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:02.976336 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe7298-87e4-4c53-9031-7927fa5d60a8 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:02.976611 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe7298-87e4-4c53-9031-7927fa5d60a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:02.976875 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe7298-87e4-4c53-9031-7927fa5d60a8 None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:02.977577 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe7298-87e4-4c53-9031-7927fa5d60a8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:02.977875 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe7298-87e4-4c53-9031-7927fa5d60a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:02.979308 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe7298-87e4-4c53-9031-7927fa5d60a8 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:02.984289 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 509/993] 10.222.0.32 () {56 vars in 1112 bytes} [Tue Apr 12 02:52:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:02.989995 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bea58b-c5e3-4076-8bdc-6d6230daf368 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:03.088939 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bea58b-c5e3-4076-8bdc-6d6230daf368 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:03.123170 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47324657-2c36-4d7f-9163-25293b614331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:03.123862 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47324657-2c36-4d7f-9163-25293b614331 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:03.124141 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47324657-2c36-4d7f-9163-25293b614331 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:03.124407 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47324657-2c36-4d7f-9163-25293b614331 None admin] PATH_INFO: `/v3/services` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:03.125095 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47324657-2c36-4d7f-9163-25293b614331 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:03.125392 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47324657-2c36-4d7f-9163-25293b614331 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:03.126791 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47324657-2c36-4d7f-9163-25293b614331 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:03.136826 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 485/994] 10.222.0.32 () {56 vars in 1112 bytes} [Tue Apr 12 02:52:02 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:03.138554 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe7298-87e4-4c53-9031-7927fa5d60a8 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:03.249113 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe7298-87e4-4c53-9031-7927fa5d60a8 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:03.281786 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91b1f5-ca8d-4537-b269-f0e8a2f1dba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:03.282442 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91b1f5-ca8d-4537-b269-f0e8a2f1dba8 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:03.282719 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91b1f5-ca8d-4537-b269-f0e8a2f1dba8 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:03.282983 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91b1f5-ca8d-4537-b269-f0e8a2f1dba8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:03.283786 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91b1f5-ca8d-4537-b269-f0e8a2f1dba8 None admin] RBAC: Adding query filter params (interface=public, service_id=e79c87ede98c4a55b22c145d020fa22c, region_id=RegionOne) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:03.284087 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91b1f5-ca8d-4537-b269-f0e8a2f1dba8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:03.285454 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91b1f5-ca8d-4537-b269-f0e8a2f1dba8 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:03.290577 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 510/995] 10.222.0.32 () {56 vars in 1251 bytes} [Tue Apr 12 02:52:03 2022] GET /identity/v3/endpoints?service_id=e79c87ede98c4a55b22c145d020fa22c&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:03.296150 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47324657-2c36-4d7f-9163-25293b614331 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:03.392786 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47324657-2c36-4d7f-9163-25293b614331 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:03.425117 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db11d1-6c72-42b1-902a-3b1b708ca8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:03.425780 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db11d1-6c72-42b1-902a-3b1b708ca8a0 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:03.426047 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db11d1-6c72-42b1-902a-3b1b708ca8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:03.426306 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db11d1-6c72-42b1-902a-3b1b708ca8a0 None admin] PATH_INFO: `/v3/services` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:03.426972 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db11d1-6c72-42b1-902a-3b1b708ca8a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:03.428376 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db11d1-6c72-42b1-902a-3b1b708ca8a0 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:03.434969 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 486/996] 10.222.0.32 () {56 vars in 1087 bytes} [Tue Apr 12 02:52:03 2022] GET /identity/v3/services => generated 1727 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 02:52:04.192863 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613f497-8b9a-4a2a-b57a-ca79a0b1fc7d None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:04.193413 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613f497-8b9a-4a2a-b57a-ca79a0b1fc7d None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:04.193413 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613f497-8b9a-4a2a-b57a-ca79a0b1fc7d None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:04.194763 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 511/997] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:52:04.200846 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a4c93-221b-4ebd-bc28-76b2a7cf0dd3 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:04.201277 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a4c93-221b-4ebd-bc28-76b2a7cf0dd3 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:04.201351 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a4c93-221b-4ebd-bc28-76b2a7cf0dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:04.219946 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-c68a4c93-221b-4ebd-bc28-76b2a7cf0dd3 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:52:04.221135 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-c68a4c93-221b-4ebd-bc28-76b2a7cf0dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:52:04.288541 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 487/998] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:52:04 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:52:04.312928 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3613f497-8b9a-4a2a-b57a-ca79a0b1fc7d None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:04.413235 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3613f497-8b9a-4a2a-b57a-ca79a0b1fc7d None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:04.447881 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bffec2d-6830-44f2-b503-4652cda8addd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:04.448631 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffec2d-6830-44f2-b503-4652cda8addd None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:04.448896 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffec2d-6830-44f2-b503-4652cda8addd None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:04.449159 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffec2d-6830-44f2-b503-4652cda8addd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:04.449807 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bffec2d-6830-44f2-b503-4652cda8addd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:04.451177 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bffec2d-6830-44f2-b503-4652cda8addd None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:04.463312 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-3bffec2d-6830-44f2-b503-4652cda8addd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 12 02:52:04.465000 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 512/999] 10.222.0.32 () {56 vars in 1126 bytes} [Tue Apr 12 02:52:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:52:04.471384 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a4c93-221b-4ebd-bc28-76b2a7cf0dd3 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:04.578098 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a4c93-221b-4ebd-bc28-76b2a7cf0dd3 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:04.616722 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29fc6a-dae4-4083-bc6b-a4ed3db3fa22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:04.617386 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29fc6a-dae4-4083-bc6b-a4ed3db3fa22 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:04.617657 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29fc6a-dae4-4083-bc6b-a4ed3db3fa22 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:04.617920 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29fc6a-dae4-4083-bc6b-a4ed3db3fa22 None admin] PATH_INFO: `/v3/services` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:04.618617 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29fc6a-dae4-4083-bc6b-a4ed3db3fa22 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:04.618915 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29fc6a-dae4-4083-bc6b-a4ed3db3fa22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:04.620711 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29fc6a-dae4-4083-bc6b-a4ed3db3fa22 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:04.625643 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 488/1000] 10.222.0.32 () {56 vars in 1122 bytes} [Tue Apr 12 02:52:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:04.631214 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bffec2d-6830-44f2-b503-4652cda8addd None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:04.732453 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bffec2d-6830-44f2-b503-4652cda8addd None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:04.765627 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53427507-843e-45be-81e9-2531b9c08e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:04.766290 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53427507-843e-45be-81e9-2531b9c08e6b None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:04.766568 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53427507-843e-45be-81e9-2531b9c08e6b None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:04.766837 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53427507-843e-45be-81e9-2531b9c08e6b None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:04.767538 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53427507-843e-45be-81e9-2531b9c08e6b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:04.767870 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53427507-843e-45be-81e9-2531b9c08e6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:04.769227 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53427507-843e-45be-81e9-2531b9c08e6b None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:04.774134 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 513/1001] 10.222.0.32 () {56 vars in 1122 bytes} [Tue Apr 12 02:52:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:04.779753 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29fc6a-dae4-4083-bc6b-a4ed3db3fa22 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:04.845137 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e58fae-1c96-41c1-8206-5837c64a2662 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:04.845468 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e58fae-1c96-41c1-8206-5837c64a2662 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:04.845651 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e58fae-1c96-41c1-8206-5837c64a2662 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:04.847020 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 514/1002] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:52:04.851878 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59d1ee-4478-418c-88af-fe50ecd7bfaf None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:04.852117 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59d1ee-4478-418c-88af-fe50ecd7bfaf None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:04.852417 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59d1ee-4478-418c-88af-fe50ecd7bfaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:04.868703 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-0c59d1ee-4478-418c-88af-fe50ecd7bfaf None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:52:04.869886 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-0c59d1ee-4478-418c-88af-fe50ecd7bfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:52:04.879210 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29fc6a-dae4-4083-bc6b-a4ed3db3fa22 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:04.911946 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ebba86-4cb6-4ffd-ba29-7976c6b47a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:04.912622 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebba86-4cb6-4ffd-ba29-7976c6b47a99 None admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:04.912895 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebba86-4cb6-4ffd-ba29-7976c6b47a99 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:04.913151 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebba86-4cb6-4ffd-ba29-7976c6b47a99 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:04.913909 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ebba86-4cb6-4ffd-ba29-7976c6b47a99 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:04.915266 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ebba86-4cb6-4ffd-ba29-7976c6b47a99 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:04.930934 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 489/1003] 10.222.0.32 () {60 vars in 1144 bytes} [Tue Apr 12 02:52:04 2022] POST /identity/v3/endpoints => generated 325 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 02:52:04.943768 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 515/1004] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:52:04 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 02:52:04.962461 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ebba86-4cb6-4ffd-ba29-7976c6b47a99 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:05.073303 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ebba86-4cb6-4ffd-ba29-7976c6b47a99 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:05.111311 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8264c8-e8a5-412a-bfb3-560131e6288c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:05.112167 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8264c8-e8a5-412a-bfb3-560131e6288c None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:05.112416 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8264c8-e8a5-412a-bfb3-560131e6288c None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:05.112707 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8264c8-e8a5-412a-bfb3-560131e6288c None admin] PATH_INFO: `/v3/services/image` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:05.113404 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8264c8-e8a5-412a-bfb3-560131e6288c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:05.114794 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8264c8-e8a5-412a-bfb3-560131e6288c None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:05.126702 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-6a8264c8-e8a5-412a-bfb3-560131e6288c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 12 02:52:05.127986 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 490/1005] 10.222.0.32 () {56 vars in 1105 bytes} [Tue Apr 12 02:52:04 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:52:05.135486 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59d1ee-4478-418c-88af-fe50ecd7bfaf None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:05.231574 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59d1ee-4478-418c-88af-fe50ecd7bfaf None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:05.265179 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c7c3b-37e1-434a-89b1-06c256425010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:05.265853 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c7c3b-37e1-434a-89b1-06c256425010 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:05.266133 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c7c3b-37e1-434a-89b1-06c256425010 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:05.266403 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c7c3b-37e1-434a-89b1-06c256425010 None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:05.267107 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c7c3b-37e1-434a-89b1-06c256425010 None admin] RBAC: Adding query filter params (name=image) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:05.267407 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c7c3b-37e1-434a-89b1-06c256425010 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:05.268814 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c7c3b-37e1-434a-89b1-06c256425010 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:05.278316 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 516/1006] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:52:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:05.279563 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8264c8-e8a5-412a-bfb3-560131e6288c None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:05.379519 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8264c8-e8a5-412a-bfb3-560131e6288c None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:05.415280 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc678861-3618-4238-901c-72c9b553fcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:05.416222 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc678861-3618-4238-901c-72c9b553fcf7 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:05.416663 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc678861-3618-4238-901c-72c9b553fcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:05.417142 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc678861-3618-4238-901c-72c9b553fcf7 None admin] PATH_INFO: `/v3/services` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:05.418149 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc678861-3618-4238-901c-72c9b553fcf7 None admin] RBAC: Adding query filter params (type=image) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:05.418440 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc678861-3618-4238-901c-72c9b553fcf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:05.419890 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc678861-3618-4238-901c-72c9b553fcf7 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:05.425080 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 491/1007] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:52:05 2022] GET /identity/v3/services?type=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:05.779620 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0babb2-7e9b-4a77-9e38-320bb16f7ed7 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:05.780050 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0babb2-7e9b-4a77-9e38-320bb16f7ed7 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:05.780192 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0babb2-7e9b-4a77-9e38-320bb16f7ed7 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:05.781607 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 517/1008] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:52:05.787064 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcf395-4bef-4553-ac33-9ffcd3a99cb7 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:05.787356 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcf395-4bef-4553-ac33-9ffcd3a99cb7 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:05.787632 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcf395-4bef-4553-ac33-9ffcd3a99cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:05.804955 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-d5fcf395-4bef-4553-ac33-9ffcd3a99cb7 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:52:05.806123 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-d5fcf395-4bef-4553-ac33-9ffcd3a99cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:52:05.872950 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 492/1009] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:52:05 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:52:05.896884 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0babb2-7e9b-4a77-9e38-320bb16f7ed7 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:05.999528 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0babb2-7e9b-4a77-9e38-320bb16f7ed7 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:06.033297 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a3b08-cbb7-4323-9821-4e484d468c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:06.034000 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a3b08-cbb7-4323-9821-4e484d468c2b None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:06.034286 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a3b08-cbb7-4323-9821-4e484d468c2b None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:06.034544 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a3b08-cbb7-4323-9821-4e484d468c2b None admin] PATH_INFO: `/v3/services/compute` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:06.035177 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a3b08-cbb7-4323-9821-4e484d468c2b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:06.036562 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a3b08-cbb7-4323-9821-4e484d468c2b None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:06.048026 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-d86a3b08-cbb7-4323-9821-4e484d468c2b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 12 02:52:06.049435 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 518/1010] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:52:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:52:06.055288 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcf395-4bef-4553-ac33-9ffcd3a99cb7 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:06.159213 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcf395-4bef-4553-ac33-9ffcd3a99cb7 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:06.192522 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af32e1e-809c-4506-ac01-ad5cb09fcc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:06.193223 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af32e1e-809c-4506-ac01-ad5cb09fcc7a None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:06.193524 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af32e1e-809c-4506-ac01-ad5cb09fcc7a None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:06.193766 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af32e1e-809c-4506-ac01-ad5cb09fcc7a None admin] PATH_INFO: `/v3/services` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:06.194507 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af32e1e-809c-4506-ac01-ad5cb09fcc7a None admin] RBAC: Adding query filter params (name=compute) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:06.194797 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af32e1e-809c-4506-ac01-ad5cb09fcc7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:06.196209 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af32e1e-809c-4506-ac01-ad5cb09fcc7a None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:06.206243 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 493/1011] 10.222.0.32 () {56 vars in 1112 bytes} [Tue Apr 12 02:52:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:06.207472 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a3b08-cbb7-4323-9821-4e484d468c2b None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:06.306168 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a3b08-cbb7-4323-9821-4e484d468c2b None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:06.339484 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ef2e4-326b-44df-af30-77a804d85e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:06.340174 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ef2e4-326b-44df-af30-77a804d85e6b None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:06.340449 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ef2e4-326b-44df-af30-77a804d85e6b None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:06.340718 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ef2e4-326b-44df-af30-77a804d85e6b None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:06.341415 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ef2e4-326b-44df-af30-77a804d85e6b None admin] RBAC: Adding query filter params (type=compute) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:06.341830 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ef2e4-326b-44df-af30-77a804d85e6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:06.343093 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ef2e4-326b-44df-af30-77a804d85e6b None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:06.348023 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 519/1012] 10.222.0.32 () {56 vars in 1112 bytes} [Tue Apr 12 02:52:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:06.353767 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af32e1e-809c-4506-ac01-ad5cb09fcc7a None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:06.448348 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af32e1e-809c-4506-ac01-ad5cb09fcc7a None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:06.480953 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd210ff-45d3-444e-9bcd-c15b90b2fc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:06.481615 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd210ff-45d3-444e-9bcd-c15b90b2fc59 None admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:06.481887 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd210ff-45d3-444e-9bcd-c15b90b2fc59 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:06.482151 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd210ff-45d3-444e-9bcd-c15b90b2fc59 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:06.482892 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd210ff-45d3-444e-9bcd-c15b90b2fc59 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:06.484307 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd210ff-45d3-444e-9bcd-c15b90b2fc59 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:06.507769 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 494/1013] 10.222.0.32 () {60 vars in 1144 bytes} [Tue Apr 12 02:52:06 2022] POST /identity/v3/endpoints => generated 334 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 02:52:07.285522 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d681e32-e01e-4612-acf0-db47e2e3d85a None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:07.285798 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d681e32-e01e-4612-acf0-db47e2e3d85a None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:07.286055 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d681e32-e01e-4612-acf0-db47e2e3d85a None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:07.287576 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 520/1014] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:52:07.293000 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9d9b9-565b-439a-b505-93f8e4ec3fb3 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:07.293287 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9d9b9-565b-439a-b505-93f8e4ec3fb3 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:07.293552 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9d9b9-565b-439a-b505-93f8e4ec3fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:07.310782 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-d2d9d9b9-565b-439a-b505-93f8e4ec3fb3 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:52:07.311989 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-d2d9d9b9-565b-439a-b505-93f8e4ec3fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:52:07.387170 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 495/1015] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:52:07 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:52:07.411501 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d681e32-e01e-4612-acf0-db47e2e3d85a None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:07.513038 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d681e32-e01e-4612-acf0-db47e2e3d85a None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:07.547562 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5b8e4-1bdc-466c-938f-43f7e35aaf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:07.548282 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5b8e4-1bdc-466c-938f-43f7e35aaf3e None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:07.548560 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5b8e4-1bdc-466c-938f-43f7e35aaf3e None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:07.548821 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5b8e4-1bdc-466c-938f-43f7e35aaf3e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:07.549972 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b5b8e4-1bdc-466c-938f-43f7e35aaf3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:07.551388 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b5b8e4-1bdc-466c-938f-43f7e35aaf3e None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:07.553204 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 521/1016] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:52:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:52:07.559206 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9d9b9-565b-439a-b505-93f8e4ec3fb3 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:07.654169 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9d9b9-565b-439a-b505-93f8e4ec3fb3 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:07.688094 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834efdbb-9081-4821-8d39-ca89ae7a07c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:07.688850 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834efdbb-9081-4821-8d39-ca89ae7a07c5 None admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:07.689130 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834efdbb-9081-4821-8d39-ca89ae7a07c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:07.689399 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834efdbb-9081-4821-8d39-ca89ae7a07c5 None admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:07.690108 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834efdbb-9081-4821-8d39-ca89ae7a07c5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:07.691566 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834efdbb-9081-4821-8d39-ca89ae7a07c5 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:07.718055 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 496/1017] 10.222.0.32 () {60 vars in 1141 bytes} [Tue Apr 12 02:52:07 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 02:52:07.774127 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f382e2-1364-4096-ad3d-9d2f333a445d None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:07.774464 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f382e2-1364-4096-ad3d-9d2f333a445d None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:07.774685 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f382e2-1364-4096-ad3d-9d2f333a445d None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:07.776200 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 522/1018] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:52:07.782263 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bc4cd-ee2d-4a02-8995-9f3d16ac9c1c None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:07.782605 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bc4cd-ee2d-4a02-8995-9f3d16ac9c1c None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:07.782787 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bc4cd-ee2d-4a02-8995-9f3d16ac9c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:07.801530 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-de0bc4cd-ee2d-4a02-8995-9f3d16ac9c1c None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:52:07.802654 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-de0bc4cd-ee2d-4a02-8995-9f3d16ac9c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:52:07.878625 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 497/1019] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:52:07 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:52:07.903462 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f382e2-1364-4096-ad3d-9d2f333a445d None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:08.003668 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f382e2-1364-4096-ad3d-9d2f333a445d None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:08.038095 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b01f7d-64d7-416a-a939-88ff93e07bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:08.038767 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b01f7d-64d7-416a-a939-88ff93e07bde None admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:08.039049 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b01f7d-64d7-416a-a939-88ff93e07bde None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:08.039311 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b01f7d-64d7-416a-a939-88ff93e07bde None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:08.040076 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b01f7d-64d7-416a-a939-88ff93e07bde None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:08.041485 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b01f7d-64d7-416a-a939-88ff93e07bde None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:08.056371 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 523/1020] 10.222.0.32 () {60 vars in 1141 bytes} [Tue Apr 12 02:52:07 2022] POST /identity/v3/services => generated 242 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 02:52:08.897186 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211fa12-ba5c-4c65-9074-9bd7db9395c1 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:08.897758 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211fa12-ba5c-4c65-9074-9bd7db9395c1 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:08.897758 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211fa12-ba5c-4c65-9074-9bd7db9395c1 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:08.898969 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 498/1021] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:52:08.904976 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981f055-fbd2-45e1-a3f6-abad8611c57a None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:08.905459 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981f055-fbd2-45e1-a3f6-abad8611c57a None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:08.905459 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981f055-fbd2-45e1-a3f6-abad8611c57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:08.922192 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-7981f055-fbd2-45e1-a3f6-abad8611c57a None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:52:08.923352 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-7981f055-fbd2-45e1-a3f6-abad8611c57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:52:08.992078 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 524/1022] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:52:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:52:09.016561 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211fa12-ba5c-4c65-9074-9bd7db9395c1 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:09.120466 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211fa12-ba5c-4c65-9074-9bd7db9395c1 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:09.154522 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f62dd9-a427-41cf-be5f-aa20a456480c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:09.155270 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f62dd9-a427-41cf-be5f-aa20a456480c None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:09.155541 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f62dd9-a427-41cf-be5f-aa20a456480c None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:09.155837 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f62dd9-a427-41cf-be5f-aa20a456480c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:09.165474 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f62dd9-a427-41cf-be5f-aa20a456480c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:52:09.173373 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-b3f62dd9-a427-41cf-be5f-aa20a456480c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 12 02:52:09.174769 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 499/1023] 10.222.0.32 () {56 vars in 1120 bytes} [Tue Apr 12 02:52:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:52:09.180719 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981f055-fbd2-45e1-a3f6-abad8611c57a None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:09.277757 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981f055-fbd2-45e1-a3f6-abad8611c57a None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:09.310707 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53319029-5dc7-4418-a6d7-8e2680eaaeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:09.311370 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53319029-5dc7-4418-a6d7-8e2680eaaeda None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:09.311641 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53319029-5dc7-4418-a6d7-8e2680eaaeda None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:09.311917 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53319029-5dc7-4418-a6d7-8e2680eaaeda None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:09.312658 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53319029-5dc7-4418-a6d7-8e2680eaaeda None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:09.312956 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53319029-5dc7-4418-a6d7-8e2680eaaeda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:09.314321 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53319029-5dc7-4418-a6d7-8e2680eaaeda None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:09.322706 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 525/1024] 10.222.0.32 () {56 vars in 1115 bytes} [Tue Apr 12 02:52:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:09.328625 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f62dd9-a427-41cf-be5f-aa20a456480c None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:09.429010 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f62dd9-a427-41cf-be5f-aa20a456480c None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:09.461067 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6435cc5-a362-4254-884d-deac17f7a8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:09.461859 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6435cc5-a362-4254-884d-deac17f7a8d3 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:09.462124 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6435cc5-a362-4254-884d-deac17f7a8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:09.462385 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6435cc5-a362-4254-884d-deac17f7a8d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:09.472535 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6435cc5-a362-4254-884d-deac17f7a8d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:09.473988 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6435cc5-a362-4254-884d-deac17f7a8d3 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:09.489577 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-b6435cc5-a362-4254-884d-deac17f7a8d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:52:09.490915 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 500/1025] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:52:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:52:09.496743 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53319029-5dc7-4418-a6d7-8e2680eaaeda None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:09.599667 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53319029-5dc7-4418-a6d7-8e2680eaaeda None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:09.634677 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519e62b-4da3-48a7-a89d-164ab2eda424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:09.635444 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519e62b-4da3-48a7-a89d-164ab2eda424 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:09.635797 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519e62b-4da3-48a7-a89d-164ab2eda424 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:09.636085 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519e62b-4da3-48a7-a89d-164ab2eda424 None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:09.636800 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519e62b-4da3-48a7-a89d-164ab2eda424 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:09.637091 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519e62b-4da3-48a7-a89d-164ab2eda424 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:09.638515 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519e62b-4da3-48a7-a89d-164ab2eda424 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:09.654378 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 526/1026] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:09.655538 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6435cc5-a362-4254-884d-deac17f7a8d3 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:09.756204 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6435cc5-a362-4254-884d-deac17f7a8d3 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:09.789648 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc03e0e-dcc7-43c6-8555-ebf652812f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:09.790427 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc03e0e-dcc7-43c6-8555-ebf652812f77 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:09.790739 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc03e0e-dcc7-43c6-8555-ebf652812f77 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:09.791000 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc03e0e-dcc7-43c6-8555-ebf652812f77 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:09.798400 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc03e0e-dcc7-43c6-8555-ebf652812f77 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:09.799870 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc03e0e-dcc7-43c6-8555-ebf652812f77 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:09.812693 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-ccc03e0e-dcc7-43c6-8555-ebf652812f77 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 12 02:52:09.814048 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 501/1027] 10.222.0.32 () {56 vars in 1093 bytes} [Tue Apr 12 02:52:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:52:09.819693 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519e62b-4da3-48a7-a89d-164ab2eda424 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:09.917773 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519e62b-4da3-48a7-a89d-164ab2eda424 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:09.949517 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c399600-f7c3-4e95-8607-1be872c38966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:09.950573 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c399600-f7c3-4e95-8607-1be872c38966 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:09.951063 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c399600-f7c3-4e95-8607-1be872c38966 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:09.951537 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c399600-f7c3-4e95-8607-1be872c38966 None admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:09.952603 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c399600-f7c3-4e95-8607-1be872c38966 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:09.953445 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c399600-f7c3-4e95-8607-1be872c38966 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:09.955037 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c399600-f7c3-4e95-8607-1be872c38966 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:09.972190 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 527/1028] 10.222.0.32 () {56 vars in 1133 bytes} [Tue Apr 12 02:52:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:09.978112 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc03e0e-dcc7-43c6-8555-ebf652812f77 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:10.079012 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc03e0e-dcc7-43c6-8555-ebf652812f77 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:10.083749 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89afc0-3d6a-4fd7-b185-56e86c2c32d5 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:10.084038 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89afc0-3d6a-4fd7-b185-56e86c2c32d5 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:10.084376 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89afc0-3d6a-4fd7-b185-56e86c2c32d5 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:10.086010 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 528/1029] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:52:10.091364 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfad1b0-b968-4d8f-820d-296fdccc5c6a None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:10.091680 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfad1b0-b968-4d8f-820d-296fdccc5c6a None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:10.092030 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfad1b0-b968-4d8f-820d-296fdccc5c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:10.108842 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-7bfad1b0-b968-4d8f-820d-296fdccc5c6a None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:52:10.110014 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-7bfad1b0-b968-4d8f-820d-296fdccc5c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:52:10.115349 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16098758-d97e-4162-bbdc-104d259f07c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:10.116247 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16098758-d97e-4162-bbdc-104d259f07c2 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:10.116702 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16098758-d97e-4162-bbdc-104d259f07c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:10.117178 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16098758-d97e-4162-bbdc-104d259f07c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:10.175588 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 529/1030] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:52:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 02:52:10.183062 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16098758-d97e-4162-bbdc-104d259f07c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:10.184713 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16098758-d97e-4162-bbdc-104d259f07c2 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:10.201723 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfad1b0-b968-4d8f-820d-296fdccc5c6a None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:10.280833 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 502/1031] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:52:09 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 02:52:10.287133 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16098758-d97e-4162-bbdc-104d259f07c2 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:10.296542 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfad1b0-b968-4d8f-820d-296fdccc5c6a None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:10.329815 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859e629-b5a3-44c1-86c5-c6f95266fba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:10.330528 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859e629-b5a3-44c1-86c5-c6f95266fba2 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:10.330801 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859e629-b5a3-44c1-86c5-c6f95266fba2 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:10.331060 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859e629-b5a3-44c1-86c5-c6f95266fba2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:10.332237 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859e629-b5a3-44c1-86c5-c6f95266fba2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:10.333650 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859e629-b5a3-44c1-86c5-c6f95266fba2 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:10.340473 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 530/1032] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:52:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:52:10.341814 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859e629-b5a3-44c1-86c5-c6f95266fba2 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:10.385904 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16098758-d97e-4162-bbdc-104d259f07c2 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:10.420753 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd3812-2223-44f2-b9bd-a96366e7d67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:10.421549 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd3812-2223-44f2-b9bd-a96366e7d67a None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:10.421816 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd3812-2223-44f2-b9bd-a96366e7d67a None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:10.422097 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd3812-2223-44f2-b9bd-a96366e7d67a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:10.432192 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd3812-2223-44f2-b9bd-a96366e7d67a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:10.432867 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859e629-b5a3-44c1-86c5-c6f95266fba2 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:10.433685 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd3812-2223-44f2-b9bd-a96366e7d67a None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:10.450479 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-abfd3812-2223-44f2-b9bd-a96366e7d67a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:52:10.451687 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 503/1033] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:52:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:52:10.453268 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d915ff-d74b-46d5-ab05-663ba1fa68ed None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:10.453542 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d915ff-d74b-46d5-ab05-663ba1fa68ed None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:10.453815 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d915ff-d74b-46d5-ab05-663ba1fa68ed None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:10.455751 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 504/1034] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:52:10.457957 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d915ff-d74b-46d5-ab05-663ba1fa68ed None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:10.466040 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef43b2-aaee-4dba-b00b-bd31d7d13777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:10.466705 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef43b2-aaee-4dba-b00b-bd31d7d13777 None admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:10.466976 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef43b2-aaee-4dba-b00b-bd31d7d13777 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:10.467237 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef43b2-aaee-4dba-b00b-bd31d7d13777 None admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:10.467952 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef43b2-aaee-4dba-b00b-bd31d7d13777 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:10.469369 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef43b2-aaee-4dba-b00b-bd31d7d13777 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:10.489723 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 531/1035] 10.222.0.32 () {60 vars in 1132 bytes} [Tue Apr 12 02:52:10 2022] POST /identity/v3/users => generated 285 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 02:52:10.490958 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db9ee3-401e-4878-946d-b0a13157b70d None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:10.491239 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db9ee3-401e-4878-946d-b0a13157b70d None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:10.491503 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db9ee3-401e-4878-946d-b0a13157b70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:10.510428 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-19db9ee3-401e-4878-946d-b0a13157b70d None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:52:10.511888 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-19db9ee3-401e-4878-946d-b0a13157b70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:52:10.568549 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d915ff-d74b-46d5-ab05-663ba1fa68ed None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:10.586659 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 532/1036] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:52:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:52:10.610838 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd013eb9-0e0b-4583-ae08-79894540ab88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:10.611529 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd013eb9-0e0b-4583-ae08-79894540ab88 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:10.611839 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd013eb9-0e0b-4583-ae08-79894540ab88 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:10.612116 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd013eb9-0e0b-4583-ae08-79894540ab88 None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:10.612848 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd013eb9-0e0b-4583-ae08-79894540ab88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:10.613154 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd013eb9-0e0b-4583-ae08-79894540ab88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:10.614675 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd013eb9-0e0b-4583-ae08-79894540ab88 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:10.615672 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db9ee3-401e-4878-946d-b0a13157b70d None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:10.627028 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 505/1037] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:52:10.633387 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd013eb9-0e0b-4583-ae08-79894540ab88 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:10.720788 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db9ee3-401e-4878-946d-b0a13157b70d None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:10.749139 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd013eb9-0e0b-4583-ae08-79894540ab88 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:10.755573 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece3d0c-f180-4b18-a229-8b77632ff586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:10.756606 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece3d0c-f180-4b18-a229-8b77632ff586 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:10.756893 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece3d0c-f180-4b18-a229-8b77632ff586 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:10.757490 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece3d0c-f180-4b18-a229-8b77632ff586 None admin] PATH_INFO: `/v3/services/image` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:10.757922 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece3d0c-f180-4b18-a229-8b77632ff586 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:10.759674 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece3d0c-f180-4b18-a229-8b77632ff586 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:10.771067 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-0ece3d0c-f180-4b18-a229-8b77632ff586 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 12 02:52:10.772628 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 533/1038] 10.222.0.32 () {56 vars in 1105 bytes} [Tue Apr 12 02:52:10 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:52:10.778476 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece3d0c-f180-4b18-a229-8b77632ff586 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:10.783419 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e852bdb-6ce0-4705-a1c3-ee6dc4730b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:10.784247 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e852bdb-6ce0-4705-a1c3-ee6dc4730b75 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:10.784515 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e852bdb-6ce0-4705-a1c3-ee6dc4730b75 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:10.784775 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e852bdb-6ce0-4705-a1c3-ee6dc4730b75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:10.791897 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e852bdb-6ce0-4705-a1c3-ee6dc4730b75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:10.793359 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e852bdb-6ce0-4705-a1c3-ee6dc4730b75 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:10.807113 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-7e852bdb-6ce0-4705-a1c3-ee6dc4730b75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:52:10.808451 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 506/1039] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:52:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:52:10.814684 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e852bdb-6ce0-4705-a1c3-ee6dc4730b75 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:10.877090 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece3d0c-f180-4b18-a229-8b77632ff586 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:10.908370 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f53ad-488e-46e1-8e05-377affd156f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:10.909053 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f53ad-488e-46e1-8e05-377affd156f3 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:10.909321 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f53ad-488e-46e1-8e05-377affd156f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:10.909588 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f53ad-488e-46e1-8e05-377affd156f3 None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:10.910284 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f53ad-488e-46e1-8e05-377affd156f3 None admin] RBAC: Adding query filter params (name=image) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:10.910579 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f53ad-488e-46e1-8e05-377affd156f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:10.911975 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f53ad-488e-46e1-8e05-377affd156f3 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:10.912712 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e852bdb-6ce0-4705-a1c3-ee6dc4730b75 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:10.917126 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 534/1040] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:52:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:52:10.922566 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f53ad-488e-46e1-8e05-377affd156f3 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:10.952398 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b384f-1e51-4db5-b70d-317136c29bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:10.953745 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b384f-1e51-4db5-b70d-317136c29bd5 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:10.954179 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b384f-1e51-4db5-b70d-317136c29bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:10.954449 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b384f-1e51-4db5-b70d-317136c29bd5 None admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:10.955277 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b384f-1e51-4db5-b70d-317136c29bd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:10.955636 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b384f-1e51-4db5-b70d-317136c29bd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:10.957229 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b384f-1e51-4db5-b70d-317136c29bd5 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:10.971884 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 507/1041] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 02:52:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:10.975214 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b384f-1e51-4db5-b70d-317136c29bd5 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:11.024855 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f53ad-488e-46e1-8e05-377affd156f3 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:11.057465 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09610b-46f3-4258-b77d-b536ce3c9327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:11.058584 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09610b-46f3-4258-b77d-b536ce3c9327 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:11.059066 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09610b-46f3-4258-b77d-b536ce3c9327 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:11.059540 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09610b-46f3-4258-b77d-b536ce3c9327 None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:11.060912 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad09610b-46f3-4258-b77d-b536ce3c9327 None admin] RBAC: Adding query filter params (type=image) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:11.061468 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad09610b-46f3-4258-b77d-b536ce3c9327 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:11.063294 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad09610b-46f3-4258-b77d-b536ce3c9327 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:11.073183 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 535/1042] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:52:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:52:11.074546 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09610b-46f3-4258-b77d-b536ce3c9327 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:11.082714 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b384f-1e51-4db5-b70d-317136c29bd5 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:11.114234 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836858ab-a83b-40af-946e-910147816fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:11.114879 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836858ab-a83b-40af-946e-910147816fb7 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:11.115148 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836858ab-a83b-40af-946e-910147816fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:11.115410 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836858ab-a83b-40af-946e-910147816fb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:11.116248 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836858ab-a83b-40af-946e-910147816fb7 None admin] RBAC: Adding query filter params (role.id=94f6d87df94e495d8f9a139ab8a39ef5, scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed, user.id=43ee5cb310fd4538910e40ea7082708c) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:11.116551 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836858ab-a83b-40af-946e-910147816fb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:11.118028 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836858ab-a83b-40af-946e-910147816fb7 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:11.131852 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 508/1043] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:52:10 2022] GET /identity/v3/role_assignments?user.id=43ee5cb310fd4538910e40ea7082708c&scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed&role.id=94f6d87df94e495d8f9a139ab8a39ef5 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:11.174073 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09610b-46f3-4258-b77d-b536ce3c9327 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:11.209191 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d570858-0d79-4532-b221-452a81171c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:11.209855 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d570858-0d79-4532-b221-452a81171c8a None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:11.210126 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d570858-0d79-4532-b221-452a81171c8a None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:11.210389 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d570858-0d79-4532-b221-452a81171c8a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:11.211182 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d570858-0d79-4532-b221-452a81171c8a None admin] RBAC: Adding query filter params (interface=public, service_id=fcb8b01f6adb4cab9411ac27ba24a702, region_id=RegionOne) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:11.211482 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d570858-0d79-4532-b221-452a81171c8a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:11.213026 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d570858-0d79-4532-b221-452a81171c8a None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:11.223432 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 536/1044] 10.222.0.32 () {56 vars in 1251 bytes} [Tue Apr 12 02:52:11 2022] GET /identity/v3/endpoints?service_id=fcb8b01f6adb4cab9411ac27ba24a702&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:52:11.224958 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836858ab-a83b-40af-946e-910147816fb7 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:11.342116 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836858ab-a83b-40af-946e-910147816fb7 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:11.381388 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f5d3b-0674-435c-aca0-d9182199aa22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:11.382109 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f5d3b-0674-435c-aca0-d9182199aa22 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:11.382333 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f5d3b-0674-435c-aca0-d9182199aa22 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:11.382603 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f5d3b-0674-435c-aca0-d9182199aa22 None admin] PATH_INFO: `/v3/services` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:11.383279 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f5d3b-0674-435c-aca0-d9182199aa22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:11.384884 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f5d3b-0674-435c-aca0-d9182199aa22 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:11.391485 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 509/1045] 10.222.0.32 () {56 vars in 1087 bytes} [Tue Apr 12 02:52:11 2022] GET /identity/v3/services => generated 1957 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 02:52:12.898384 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15121b3e-d13c-45ac-9d31-22238ca3e773 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:12.898902 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15121b3e-d13c-45ac-9d31-22238ca3e773 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:12.898902 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15121b3e-d13c-45ac-9d31-22238ca3e773 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:12.900374 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 537/1046] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:52:12.906311 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd90c84-b974-4df0-8a9f-b37afb899bd0 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:12.906768 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd90c84-b974-4df0-8a9f-b37afb899bd0 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:12.906848 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd90c84-b974-4df0-8a9f-b37afb899bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:12.924535 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-dfd90c84-b974-4df0-8a9f-b37afb899bd0 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:52:12.925722 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-dfd90c84-b974-4df0-8a9f-b37afb899bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:52:12.994445 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 510/1047] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:52:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:52:13.019579 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15121b3e-d13c-45ac-9d31-22238ca3e773 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:13.135428 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15121b3e-d13c-45ac-9d31-22238ca3e773 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:13.170453 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e66ca-93c2-42de-aca7-5c8d2825412a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:13.171159 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e66ca-93c2-42de-aca7-5c8d2825412a None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:13.171431 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e66ca-93c2-42de-aca7-5c8d2825412a None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:13.171670 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e66ca-93c2-42de-aca7-5c8d2825412a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:13.182592 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e66ca-93c2-42de-aca7-5c8d2825412a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:52:13.189343 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-401e66ca-93c2-42de-aca7-5c8d2825412a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 02:52:13.190751 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 538/1048] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 02:52:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:52:13.196869 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd90c84-b974-4df0-8a9f-b37afb899bd0 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:13.298197 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd90c84-b974-4df0-8a9f-b37afb899bd0 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:13.336421 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb5501-d107-4978-ad78-0f27a1e00d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:13.337094 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb5501-d107-4978-ad78-0f27a1e00d06 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:13.337337 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb5501-d107-4978-ad78-0f27a1e00d06 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:13.337692 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb5501-d107-4978-ad78-0f27a1e00d06 None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:13.338436 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb5501-d107-4978-ad78-0f27a1e00d06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:13.338713 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb5501-d107-4978-ad78-0f27a1e00d06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:13.340144 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb5501-d107-4978-ad78-0f27a1e00d06 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:13.353886 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 511/1049] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:52:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:13.355711 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e66ca-93c2-42de-aca7-5c8d2825412a None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:13.417335 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b31b70-aeb3-4d4a-bd30-1a736bae04bb None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:13.417637 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b31b70-aeb3-4d4a-bd30-1a736bae04bb None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:13.417906 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b31b70-aeb3-4d4a-bd30-1a736bae04bb None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:13.419595 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 512/1050] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:52:13.425434 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c3962-efd4-439f-a454-be92515958b1 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:13.425804 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c3962-efd4-439f-a454-be92515958b1 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:13.426060 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c3962-efd4-439f-a454-be92515958b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:13.444738 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-796c3962-efd4-439f-a454-be92515958b1 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:52:13.445897 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-796c3962-efd4-439f-a454-be92515958b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:52:13.457241 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e66ca-93c2-42de-aca7-5c8d2825412a None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:13.490887 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854a11b-c479-4bcd-8778-82b09aeeeb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:13.491810 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854a11b-c479-4bcd-8778-82b09aeeeb05 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:13.492094 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854a11b-c479-4bcd-8778-82b09aeeeb05 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:13.492358 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854a11b-c479-4bcd-8778-82b09aeeeb05 None admin] PATH_INFO: `/v3/users/c365cffb751642d58097441468683a4f` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:13.505924 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854a11b-c479-4bcd-8778-82b09aeeeb05 None admin] RBAC: Authorizing `identity:get_user(user_id=c365cffb751642d58097441468683a4f)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:13.507372 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854a11b-c479-4bcd-8778-82b09aeeeb05 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:13.514039 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 539/1051] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:52:13 2022] GET /identity/v3/users/c365cffb751642d58097441468683a4f => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:52:13.514177 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 513/1052] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:52:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 02:52:13.514860 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854a11b-c479-4bcd-8778-82b09aeeeb05 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:13.534047 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c3962-efd4-439f-a454-be92515958b1 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:13.621808 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854a11b-c479-4bcd-8778-82b09aeeeb05 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:13.635120 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c3962-efd4-439f-a454-be92515958b1 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:13.656317 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104595c6-5491-4db5-a619-954436a9f7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:13.656965 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104595c6-5491-4db5-a619-954436a9f7eb None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:13.657234 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104595c6-5491-4db5-a619-954436a9f7eb None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:13.657491 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104595c6-5491-4db5-a619-954436a9f7eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:13.670171 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034953c-cd65-4e82-aba8-ddd244f6b255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:13.670979 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034953c-cd65-4e82-aba8-ddd244f6b255 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:13.671253 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034953c-cd65-4e82-aba8-ddd244f6b255 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:13.671510 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034953c-cd65-4e82-aba8-ddd244f6b255 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:13.681568 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9034953c-cd65-4e82-aba8-ddd244f6b255 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:52:13.689308 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-9034953c-cd65-4e82-aba8-ddd244f6b255 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 12 02:52:13.690689 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 514/1053] 10.222.0.32 () {56 vars in 1120 bytes} [Tue Apr 12 02:52:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:52:13.698469 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034953c-cd65-4e82-aba8-ddd244f6b255 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:13.724739 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104595c6-5491-4db5-a619-954436a9f7eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:13.726186 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104595c6-5491-4db5-a619-954436a9f7eb None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:13.795545 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034953c-cd65-4e82-aba8-ddd244f6b255 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:13.819758 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 540/1054] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:52:13 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 02:52:13.821119 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b19410-0eab-459f-81dc-327d4291c152 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:13.821398 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b19410-0eab-459f-81dc-327d4291c152 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:13.821640 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b19410-0eab-459f-81dc-327d4291c152 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:13.826397 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 541/1055] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:52:13.826397 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b19410-0eab-459f-81dc-327d4291c152 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:13.829650 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce73df-bf10-42c2-b8e5-f70c5a601e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:13.830354 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce73df-bf10-42c2-b8e5-f70c5a601e43 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:13.830632 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce73df-bf10-42c2-b8e5-f70c5a601e43 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:13.830895 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce73df-bf10-42c2-b8e5-f70c5a601e43 None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:13.831641 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce73df-bf10-42c2-b8e5-f70c5a601e43 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:13.831968 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce73df-bf10-42c2-b8e5-f70c5a601e43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:13.833346 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce73df-bf10-42c2-b8e5-f70c5a601e43 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:13.841550 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 515/1056] 10.222.0.32 () {56 vars in 1115 bytes} [Tue Apr 12 02:52:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:13.842815 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f4d0d-052f-4226-8b3a-27a19f543d19 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:13.843104 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f4d0d-052f-4226-8b3a-27a19f543d19 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:13.843387 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f4d0d-052f-4226-8b3a-27a19f543d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:13.859535 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-4a6f4d0d-052f-4226-8b3a-27a19f543d19 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:52:13.860744 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-4a6f4d0d-052f-4226-8b3a-27a19f543d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:52:13.922599 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b19410-0eab-459f-81dc-327d4291c152 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:13.926023 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 516/1057] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:52:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:52:13.926827 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f4d0d-052f-4226-8b3a-27a19f543d19 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:13.957379 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053377e7-ab94-49b5-942a-63314a942370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:13.958243 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053377e7-ab94-49b5-942a-63314a942370 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:13.958514 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053377e7-ab94-49b5-942a-63314a942370 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:13.958813 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053377e7-ab94-49b5-942a-63314a942370 None admin] PATH_INFO: `/v3/projects/d3cf9deeb1a84d45b43b156e7014da13` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:13.960002 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053377e7-ab94-49b5-942a-63314a942370 None admin] RBAC: Authorizing `identity:get_project(project_id=d3cf9deeb1a84d45b43b156e7014da13)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:13.961424 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053377e7-ab94-49b5-942a-63314a942370 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:13.963453 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 542/1058] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:52:13 2022] GET /identity/v3/projects/d3cf9deeb1a84d45b43b156e7014da13 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:52:13.964242 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053377e7-ab94-49b5-942a-63314a942370 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:14.027657 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f4d0d-052f-4226-8b3a-27a19f543d19 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:14.058997 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053377e7-ab94-49b5-942a-63314a942370 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:14.061396 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0eb8a-0564-4389-ac55-08d3c4707937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:14.062198 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0eb8a-0564-4389-ac55-08d3c4707937 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:14.062470 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0eb8a-0564-4389-ac55-08d3c4707937 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:14.062735 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0eb8a-0564-4389-ac55-08d3c4707937 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:14.073120 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0eb8a-0564-4389-ac55-08d3c4707937 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:14.074643 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0eb8a-0564-4389-ac55-08d3c4707937 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:14.094157 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-c5d0eb8a-0564-4389-ac55-08d3c4707937 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:52:14.094374 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d43819-18e2-4214-960d-3d1ff5198af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:14.095175 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d43819-18e2-4214-960d-3d1ff5198af3 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:14.095676 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d43819-18e2-4214-960d-3d1ff5198af3 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:14.095828 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 517/1059] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:52:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:52:14.095907 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d43819-18e2-4214-960d-3d1ff5198af3 None admin] PATH_INFO: `/v3/services/image` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:14.096333 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0eb8a-0564-4389-ac55-08d3c4707937 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:14.096431 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d43819-18e2-4214-960d-3d1ff5198af3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:14.097798 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d43819-18e2-4214-960d-3d1ff5198af3 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:14.111230 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-17d43819-18e2-4214-960d-3d1ff5198af3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 12 02:52:14.112471 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 543/1060] 10.222.0.32 () {56 vars in 1105 bytes} [Tue Apr 12 02:52:13 2022] GET /identity/v3/services/image => generated 86 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:52:14.113256 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d43819-18e2-4214-960d-3d1ff5198af3 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:14.205822 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0eb8a-0564-4389-ac55-08d3c4707937 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:14.242918 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585b3c1-0b4b-4e14-a7d1-649607613871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:14.243484 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585b3c1-0b4b-4e14-a7d1-649607613871 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:14.243815 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585b3c1-0b4b-4e14-a7d1-649607613871 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:14.244100 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585b3c1-0b4b-4e14-a7d1-649607613871 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:14.244943 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7585b3c1-0b4b-4e14-a7d1-649607613871 None admin] RBAC: Adding query filter params (role.id=c0f19d3800f44637822d5162ffe4b497, scope.project.id=d3cf9deeb1a84d45b43b156e7014da13, user.id=c365cffb751642d58097441468683a4f) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:14.245240 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7585b3c1-0b4b-4e14-a7d1-649607613871 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:14.246728 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7585b3c1-0b4b-4e14-a7d1-649607613871 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:14.253348 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 518/1061] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:52:14 2022] GET /identity/v3/role_assignments?user.id=c365cffb751642d58097441468683a4f&scope.project.id=d3cf9deeb1a84d45b43b156e7014da13&role.id=c0f19d3800f44637822d5162ffe4b497 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:14.254218 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585b3c1-0b4b-4e14-a7d1-649607613871 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:14.351872 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d43819-18e2-4214-960d-3d1ff5198af3 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:14.371235 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585b3c1-0b4b-4e14-a7d1-649607613871 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:14.395733 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211638d-3161-4053-aef5-b476545225a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:14.396435 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211638d-3161-4053-aef5-b476545225a4 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:14.396707 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211638d-3161-4053-aef5-b476545225a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:14.396973 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211638d-3161-4053-aef5-b476545225a4 None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:14.397693 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211638d-3161-4053-aef5-b476545225a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:14.397990 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211638d-3161-4053-aef5-b476545225a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:14.399388 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211638d-3161-4053-aef5-b476545225a4 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:14.407132 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286eac0-fa7f-4ea6-b55f-821f6af23b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:14.407832 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286eac0-fa7f-4ea6-b55f-821f6af23b36 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:14.408112 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286eac0-fa7f-4ea6-b55f-821f6af23b36 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:14.408381 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286eac0-fa7f-4ea6-b55f-821f6af23b36 None admin] PATH_INFO: `/v3/services` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:14.409093 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286eac0-fa7f-4ea6-b55f-821f6af23b36 None admin] RBAC: Adding query filter params (name=image) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:14.409385 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286eac0-fa7f-4ea6-b55f-821f6af23b36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:14.410791 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286eac0-fa7f-4ea6-b55f-821f6af23b36 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:14.411899 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 544/1062] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:14.421999 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 519/1063] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:52:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:14.422207 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211638d-3161-4053-aef5-b476545225a4 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:14.423683 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286eac0-fa7f-4ea6-b55f-821f6af23b36 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:14.517326 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211638d-3161-4053-aef5-b476545225a4 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:14.530798 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286eac0-fa7f-4ea6-b55f-821f6af23b36 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:14.552524 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15762a13-b5d6-4dfd-bb9b-da20f79fec6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:14.553311 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15762a13-b5d6-4dfd-bb9b-da20f79fec6d None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:14.553603 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15762a13-b5d6-4dfd-bb9b-da20f79fec6d None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:14.553837 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15762a13-b5d6-4dfd-bb9b-da20f79fec6d None admin] PATH_INFO: `/v3/users/nova` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:14.561781 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15762a13-b5d6-4dfd-bb9b-da20f79fec6d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:14.563261 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15762a13-b5d6-4dfd-bb9b-da20f79fec6d None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:14.566465 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc220df6-b6ea-47e0-90f2-da89efdc3700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:14.567124 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc220df6-b6ea-47e0-90f2-da89efdc3700 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:14.567396 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc220df6-b6ea-47e0-90f2-da89efdc3700 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:14.567661 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc220df6-b6ea-47e0-90f2-da89efdc3700 None admin] PATH_INFO: `/v3/services` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:14.568380 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc220df6-b6ea-47e0-90f2-da89efdc3700 None admin] RBAC: Adding query filter params (type=image) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:14.568675 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc220df6-b6ea-47e0-90f2-da89efdc3700 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:14.570048 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc220df6-b6ea-47e0-90f2-da89efdc3700 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:14.575040 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 520/1064] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:52:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:14.577032 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-15762a13-b5d6-4dfd-bb9b-da20f79fec6d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 12 02:52:14.583153 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 545/1065] 10.222.0.32 () {56 vars in 1093 bytes} [Tue Apr 12 02:52:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:52:14.583279 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc220df6-b6ea-47e0-90f2-da89efdc3700 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:14.584001 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15762a13-b5d6-4dfd-bb9b-da20f79fec6d None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:14.678439 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc220df6-b6ea-47e0-90f2-da89efdc3700 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:14.679837 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15762a13-b5d6-4dfd-bb9b-da20f79fec6d None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:14.711082 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd70589-23c5-41c1-a284-101d9df960f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:14.711742 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd70589-23c5-41c1-a284-101d9df960f2 None admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:14.712033 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd70589-23c5-41c1-a284-101d9df960f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:14.712148 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498e204-e056-4da4-af59-09b8f87bafc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:14.712331 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd70589-23c5-41c1-a284-101d9df960f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:14.712782 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498e204-e056-4da4-af59-09b8f87bafc8 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:14.713017 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd70589-23c5-41c1-a284-101d9df960f2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:14.713174 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498e204-e056-4da4-af59-09b8f87bafc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:14.713310 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498e204-e056-4da4-af59-09b8f87bafc8 None admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:14.714117 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6498e204-e056-4da4-af59-09b8f87bafc8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:14.714409 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6498e204-e056-4da4-af59-09b8f87bafc8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:14.714632 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd70589-23c5-41c1-a284-101d9df960f2 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:14.715817 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6498e204-e056-4da4-af59-09b8f87bafc8 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:14.739753 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 546/1066] 10.222.0.32 () {56 vars in 1133 bytes} [Tue Apr 12 02:52:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:14.739997 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 521/1067] 10.222.0.32 () {60 vars in 1144 bytes} [Tue Apr 12 02:52:14 2022] POST /identity/v3/endpoints => generated 327 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 02:52:14.740095 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498e204-e056-4da4-af59-09b8f87bafc8 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:14.844122 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498e204-e056-4da4-af59-09b8f87bafc8 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:14.885905 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a08b3d-8f3e-4612-8f91-1c80e8179bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:14.886732 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a08b3d-8f3e-4612-8f91-1c80e8179bb5 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:14.887052 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a08b3d-8f3e-4612-8f91-1c80e8179bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:14.887316 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a08b3d-8f3e-4612-8f91-1c80e8179bb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:14.898107 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a08b3d-8f3e-4612-8f91-1c80e8179bb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:14.899558 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a08b3d-8f3e-4612-8f91-1c80e8179bb5 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:14.917751 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-97a08b3d-8f3e-4612-8f91-1c80e8179bb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:52:14.920598 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 547/1068] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:52:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:52:14.924722 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd70589-23c5-41c1-a284-101d9df960f2 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:15.026905 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd70589-23c5-41c1-a284-101d9df960f2 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:15.071628 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ddb220-5b79-408a-a444-0fa8118d73a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:15.072364 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddb220-5b79-408a-a444-0fa8118d73a3 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:15.072637 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddb220-5b79-408a-a444-0fa8118d73a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:15.072906 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddb220-5b79-408a-a444-0fa8118d73a3 None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:15.073618 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ddb220-5b79-408a-a444-0fa8118d73a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:15.073917 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ddb220-5b79-408a-a444-0fa8118d73a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:15.075310 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ddb220-5b79-408a-a444-0fa8118d73a3 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:15.087893 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 522/1069] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:15.093648 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a08b3d-8f3e-4612-8f91-1c80e8179bb5 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:15.191766 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a08b3d-8f3e-4612-8f91-1c80e8179bb5 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:15.224322 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb55b56-c600-4521-ad1a-4e4b84e68673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:15.225105 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb55b56-c600-4521-ad1a-4e4b84e68673 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:15.225370 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb55b56-c600-4521-ad1a-4e4b84e68673 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:15.225633 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb55b56-c600-4521-ad1a-4e4b84e68673 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:15.232170 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb55b56-c600-4521-ad1a-4e4b84e68673 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:15.233584 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb55b56-c600-4521-ad1a-4e4b84e68673 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:15.246498 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-dcb55b56-c600-4521-ad1a-4e4b84e68673 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:52:15.247894 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 548/1070] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:52:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:52:15.253477 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ddb220-5b79-408a-a444-0fa8118d73a3 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:15.346370 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ddb220-5b79-408a-a444-0fa8118d73a3 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:15.379807 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133fa6d-a8be-46a5-8aa4-f7cc95353af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:15.380454 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133fa6d-a8be-46a5-8aa4-f7cc95353af6 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:15.380719 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133fa6d-a8be-46a5-8aa4-f7cc95353af6 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:15.380982 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133fa6d-a8be-46a5-8aa4-f7cc95353af6 None admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:15.381750 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133fa6d-a8be-46a5-8aa4-f7cc95353af6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:15.382043 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133fa6d-a8be-46a5-8aa4-f7cc95353af6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:15.383466 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133fa6d-a8be-46a5-8aa4-f7cc95353af6 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:15.402558 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 523/1071] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 02:52:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:15.402792 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb55b56-c600-4521-ad1a-4e4b84e68673 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:15.500887 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb55b56-c600-4521-ad1a-4e4b84e68673 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:15.537943 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323d95f-45b5-4784-8c9c-81a2d3c7f4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:15.538821 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323d95f-45b5-4784-8c9c-81a2d3c7f4b2 None admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:15.539096 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323d95f-45b5-4784-8c9c-81a2d3c7f4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:15.539356 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323d95f-45b5-4784-8c9c-81a2d3c7f4b2 None admin] PATH_INFO: `/v3/projects/82cb5f6cfa0e46b28a37565fc2b560ed/users/43ee5cb310fd4538910e40ea7082708c/roles/94f6d87df94e495d8f9a139ab8a39ef5` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:15.541600 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323d95f-45b5-4784-8c9c-81a2d3c7f4b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=82cb5f6cfa0e46b28a37565fc2b560ed, user_id=43ee5cb310fd4538910e40ea7082708c, role_id=94f6d87df94e495d8f9a139ab8a39ef5)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:15.543079 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323d95f-45b5-4784-8c9c-81a2d3c7f4b2 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:15.564544 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 549/1072] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 02:52:15 2022] PUT /identity/v3/projects/82cb5f6cfa0e46b28a37565fc2b560ed/users/43ee5cb310fd4538910e40ea7082708c/roles/94f6d87df94e495d8f9a139ab8a39ef5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 02:52:16.582778 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afc935-613f-496a-9f35-7d36b3effb9a None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:16.583438 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afc935-613f-496a-9f35-7d36b3effb9a None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:16.583438 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afc935-613f-496a-9f35-7d36b3effb9a None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:16.584853 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 524/1073] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:52:16.590540 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecfa7f-b482-482e-97ab-aefcda0e880b None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:16.591054 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecfa7f-b482-482e-97ab-aefcda0e880b None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:16.591054 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecfa7f-b482-482e-97ab-aefcda0e880b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:16.608263 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-54ecfa7f-b482-482e-97ab-aefcda0e880b None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:52:16.609418 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-54ecfa7f-b482-482e-97ab-aefcda0e880b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:52:16.675976 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 550/1074] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:52:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:52:16.698608 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afc935-613f-496a-9f35-7d36b3effb9a None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:16.807804 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afc935-613f-496a-9f35-7d36b3effb9a None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:16.841514 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2dde8-3ac7-4ed0-b0e4-ff87da4c9e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:16.842225 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2dde8-3ac7-4ed0-b0e4-ff87da4c9e28 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:16.842493 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2dde8-3ac7-4ed0-b0e4-ff87da4c9e28 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:16.842757 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2dde8-3ac7-4ed0-b0e4-ff87da4c9e28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:16.852718 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2dde8-3ac7-4ed0-b0e4-ff87da4c9e28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:52:16.859524 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-cdb2dde8-3ac7-4ed0-b0e4-ff87da4c9e28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 02:52:16.860731 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 525/1075] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 02:52:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:52:16.868532 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ecfa7f-b482-482e-97ab-aefcda0e880b None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:16.964404 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ecfa7f-b482-482e-97ab-aefcda0e880b None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:16.997392 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f7f55-698a-48eb-aae0-e57a5fba40ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:16.998048 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f7f55-698a-48eb-aae0-e57a5fba40ba None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:16.998286 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f7f55-698a-48eb-aae0-e57a5fba40ba None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:16.998578 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f7f55-698a-48eb-aae0-e57a5fba40ba None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:16.999310 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f7f55-698a-48eb-aae0-e57a5fba40ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:16.999601 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f7f55-698a-48eb-aae0-e57a5fba40ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:17.000969 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f7f55-698a-48eb-aae0-e57a5fba40ba None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:17.009305 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 551/1076] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:52:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:52:17.015296 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2dde8-3ac7-4ed0-b0e4-ff87da4c9e28 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:17.123264 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2dde8-3ac7-4ed0-b0e4-ff87da4c9e28 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:17.129950 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f4dc4-92c4-486d-9bbd-9d40951aaebf None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:17.130227 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f4dc4-92c4-486d-9bbd-9d40951aaebf None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:17.130499 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f4dc4-92c4-486d-9bbd-9d40951aaebf None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:17.132043 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 552/1077] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:52:17.136753 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc25a1-182e-4f8f-9d06-e54a0ecadd5c None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:17.137069 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc25a1-182e-4f8f-9d06-e54a0ecadd5c None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:17.137306 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc25a1-182e-4f8f-9d06-e54a0ecadd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:17.154249 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-86fc25a1-182e-4f8f-9d06-e54a0ecadd5c None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:52:17.155479 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-86fc25a1-182e-4f8f-9d06-e54a0ecadd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:52:17.159087 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19088016-964a-4291-a0e7-c8a8eda0c8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:17.159996 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19088016-964a-4291-a0e7-c8a8eda0c8f4 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:17.160270 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19088016-964a-4291-a0e7-c8a8eda0c8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:17.160543 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19088016-964a-4291-a0e7-c8a8eda0c8f4 None admin] PATH_INFO: `/v3/users/c365cffb751642d58097441468683a4f` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:17.161752 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19088016-964a-4291-a0e7-c8a8eda0c8f4 None admin] RBAC: Authorizing `identity:get_user(user_id=c365cffb751642d58097441468683a4f)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:17.163200 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19088016-964a-4291-a0e7-c8a8eda0c8f4 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:17.164875 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 526/1078] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:52:17 2022] GET /identity/v3/users/c365cffb751642d58097441468683a4f => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:17.171019 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19088016-964a-4291-a0e7-c8a8eda0c8f4 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:17.224203 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 553/1079] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:52:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 02:52:17.246549 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc25a1-182e-4f8f-9d06-e54a0ecadd5c None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:17.273281 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19088016-964a-4291-a0e7-c8a8eda0c8f4 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:17.308902 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493281f-77b9-4408-afd8-e3c6ec552528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:17.309756 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493281f-77b9-4408-afd8-e3c6ec552528 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:17.310027 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493281f-77b9-4408-afd8-e3c6ec552528 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:17.310290 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493281f-77b9-4408-afd8-e3c6ec552528 None admin] PATH_INFO: `/v3/projects/d3cf9deeb1a84d45b43b156e7014da13` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:17.311425 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493281f-77b9-4408-afd8-e3c6ec552528 None admin] RBAC: Authorizing `identity:get_project(project_id=d3cf9deeb1a84d45b43b156e7014da13)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:17.312960 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493281f-77b9-4408-afd8-e3c6ec552528 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:17.314935 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 527/1080] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:52:17 2022] GET /identity/v3/projects/d3cf9deeb1a84d45b43b156e7014da13 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:17.320924 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493281f-77b9-4408-afd8-e3c6ec552528 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:17.341440 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc25a1-182e-4f8f-9d06-e54a0ecadd5c None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:17.374258 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49a20a-ca8d-4a83-9f79-0051144b53e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:17.374822 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49a20a-ca8d-4a83-9f79-0051144b53e1 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:17.375094 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49a20a-ca8d-4a83-9f79-0051144b53e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:17.375359 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49a20a-ca8d-4a83-9f79-0051144b53e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:17.420098 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493281f-77b9-4408-afd8-e3c6ec552528 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:17.441206 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49a20a-ca8d-4a83-9f79-0051144b53e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:17.442671 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49a20a-ca8d-4a83-9f79-0051144b53e1 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:17.454022 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0bef2-1d27-48b6-acde-8cbdef273c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:17.454903 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0bef2-1d27-48b6-acde-8cbdef273c04 None admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:17.455172 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0bef2-1d27-48b6-acde-8cbdef273c04 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:17.455435 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0bef2-1d27-48b6-acde-8cbdef273c04 None admin] PATH_INFO: `/v3/projects/d3cf9deeb1a84d45b43b156e7014da13/users/c365cffb751642d58097441468683a4f/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:17.457438 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c0bef2-1d27-48b6-acde-8cbdef273c04 None admin] RBAC: Authorizing `identity:create_grant(project_id=d3cf9deeb1a84d45b43b156e7014da13, user_id=c365cffb751642d58097441468683a4f, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:17.458885 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c0bef2-1d27-48b6-acde-8cbdef273c04 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:17.479748 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 528/1081] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 02:52:17 2022] PUT /identity/v3/projects/d3cf9deeb1a84d45b43b156e7014da13/users/c365cffb751642d58097441468683a4f/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 02:52:17.558439 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 554/1082] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:52:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 02:52:17.559798 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0bef2-1d27-48b6-acde-8cbdef273c04 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:17.662324 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0bef2-1d27-48b6-acde-8cbdef273c04 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:17.696185 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f664758-e12c-4bf4-86c0-799c5e9cce97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:17.697410 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f664758-e12c-4bf4-86c0-799c5e9cce97 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:17.697686 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f664758-e12c-4bf4-86c0-799c5e9cce97 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:17.697946 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f664758-e12c-4bf4-86c0-799c5e9cce97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:17.708706 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f664758-e12c-4bf4-86c0-799c5e9cce97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:17.710144 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f664758-e12c-4bf4-86c0-799c5e9cce97 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:17.725999 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-3f664758-e12c-4bf4-86c0-799c5e9cce97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:52:17.727355 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 529/1083] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:52:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:52:17.733322 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49a20a-ca8d-4a83-9f79-0051144b53e1 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:17.828439 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49a20a-ca8d-4a83-9f79-0051144b53e1 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:17.857771 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a622cc4-ec0d-4de9-b495-48a2ed316e55 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:17.858007 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a622cc4-ec0d-4de9-b495-48a2ed316e55 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:17.858279 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a622cc4-ec0d-4de9-b495-48a2ed316e55 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:17.859892 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 530/1084] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:52:17.864639 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06c60e-0d3c-4343-b0b5-5dd8491e7b0c None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:17.864918 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06c60e-0d3c-4343-b0b5-5dd8491e7b0c None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:17.865182 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06c60e-0d3c-4343-b0b5-5dd8491e7b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:17.865752 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99955a25-922d-4307-a2a1-adfcd1898905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:17.866409 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99955a25-922d-4307-a2a1-adfcd1898905 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:17.866676 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99955a25-922d-4307-a2a1-adfcd1898905 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:17.866934 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99955a25-922d-4307-a2a1-adfcd1898905 None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:17.867641 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99955a25-922d-4307-a2a1-adfcd1898905 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:17.867965 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99955a25-922d-4307-a2a1-adfcd1898905 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:17.869453 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99955a25-922d-4307-a2a1-adfcd1898905 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:17.887759 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 555/1085] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:17.888004 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-2a06c60e-0d3c-4343-b0b5-5dd8491e7b0c None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:52:17.888004 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-2a06c60e-0d3c-4343-b0b5-5dd8491e7b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:52:17.954707 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 531/1086] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:52:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:52:17.979849 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99955a25-922d-4307-a2a1-adfcd1898905 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:18.086774 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99955a25-922d-4307-a2a1-adfcd1898905 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:18.119899 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb795865-c73c-40ab-8942-541c11b81ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:18.120699 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb795865-c73c-40ab-8942-541c11b81ada None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:18.120988 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb795865-c73c-40ab-8942-541c11b81ada None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:18.121262 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb795865-c73c-40ab-8942-541c11b81ada None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:18.131441 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb795865-c73c-40ab-8942-541c11b81ada None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:52:18.139352 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-fb795865-c73c-40ab-8942-541c11b81ada None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 12 02:52:18.140662 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 556/1087] 10.222.0.32 () {56 vars in 1120 bytes} [Tue Apr 12 02:52:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:52:18.146634 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06c60e-0d3c-4343-b0b5-5dd8491e7b0c None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:18.244474 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06c60e-0d3c-4343-b0b5-5dd8491e7b0c None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:18.278368 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e156f-8c89-4fbc-aef4-e92aa811b35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:18.279027 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e156f-8c89-4fbc-aef4-e92aa811b35e None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:18.279296 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e156f-8c89-4fbc-aef4-e92aa811b35e None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:18.279560 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e156f-8c89-4fbc-aef4-e92aa811b35e None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:18.280328 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e156f-8c89-4fbc-aef4-e92aa811b35e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:18.280622 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e156f-8c89-4fbc-aef4-e92aa811b35e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:18.281990 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e156f-8c89-4fbc-aef4-e92aa811b35e None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:18.289911 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 532/1088] 10.222.0.32 () {56 vars in 1115 bytes} [Tue Apr 12 02:52:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:18.295692 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb795865-c73c-40ab-8942-541c11b81ada None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:18.397268 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb795865-c73c-40ab-8942-541c11b81ada None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:18.430675 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128035a5-4a77-40b6-86a8-d7355a8da7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:18.431581 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128035a5-4a77-40b6-86a8-d7355a8da7d8 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:18.432050 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128035a5-4a77-40b6-86a8-d7355a8da7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:18.432324 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128035a5-4a77-40b6-86a8-d7355a8da7d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:18.442365 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128035a5-4a77-40b6-86a8-d7355a8da7d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:18.443805 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128035a5-4a77-40b6-86a8-d7355a8da7d8 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:18.460172 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-128035a5-4a77-40b6-86a8-d7355a8da7d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:52:18.461360 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 557/1089] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:52:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:52:18.467826 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e156f-8c89-4fbc-aef4-e92aa811b35e None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:18.568386 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e156f-8c89-4fbc-aef4-e92aa811b35e None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:18.602764 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1b41a-d3b5-4935-b4de-a8abadf7a62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:18.603581 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1b41a-d3b5-4935-b4de-a8abadf7a62d None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:18.604063 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1b41a-d3b5-4935-b4de-a8abadf7a62d None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:18.604338 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1b41a-d3b5-4935-b4de-a8abadf7a62d None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:18.605052 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e1b41a-d3b5-4935-b4de-a8abadf7a62d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:18.605352 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e1b41a-d3b5-4935-b4de-a8abadf7a62d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:18.606707 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e1b41a-d3b5-4935-b4de-a8abadf7a62d None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:18.619642 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 533/1090] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:18.625534 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128035a5-4a77-40b6-86a8-d7355a8da7d8 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:18.724207 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128035a5-4a77-40b6-86a8-d7355a8da7d8 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:18.764967 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3079aa-fcb1-457b-bc7b-2e9a800aece9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:18.765805 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3079aa-fcb1-457b-bc7b-2e9a800aece9 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:18.766080 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3079aa-fcb1-457b-bc7b-2e9a800aece9 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:18.766339 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3079aa-fcb1-457b-bc7b-2e9a800aece9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:18.774114 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3079aa-fcb1-457b-bc7b-2e9a800aece9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:18.776003 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3079aa-fcb1-457b-bc7b-2e9a800aece9 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:18.788971 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-fc3079aa-fcb1-457b-bc7b-2e9a800aece9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 12 02:52:18.790128 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 558/1091] 10.222.0.32 () {56 vars in 1093 bytes} [Tue Apr 12 02:52:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:52:18.796672 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1b41a-d3b5-4935-b4de-a8abadf7a62d None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:18.895319 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1b41a-d3b5-4935-b4de-a8abadf7a62d None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:18.928966 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f6c53-5c37-42c9-8ad7-15645720e467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:18.929630 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f6c53-5c37-42c9-8ad7-15645720e467 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:18.929903 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f6c53-5c37-42c9-8ad7-15645720e467 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:18.930165 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f6c53-5c37-42c9-8ad7-15645720e467 None admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:18.930980 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f6c53-5c37-42c9-8ad7-15645720e467 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:18.931364 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f6c53-5c37-42c9-8ad7-15645720e467 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:18.933129 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f6c53-5c37-42c9-8ad7-15645720e467 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:18.950546 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 534/1092] 10.222.0.32 () {56 vars in 1133 bytes} [Tue Apr 12 02:52:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:18.956582 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3079aa-fcb1-457b-bc7b-2e9a800aece9 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:19.063095 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3079aa-fcb1-457b-bc7b-2e9a800aece9 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:19.097572 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c876be-28f8-4f88-82af-7f223d429b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:19.098187 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c876be-28f8-4f88-82af-7f223d429b18 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:19.098455 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c876be-28f8-4f88-82af-7f223d429b18 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:19.098717 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c876be-28f8-4f88-82af-7f223d429b18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:19.175490 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c876be-28f8-4f88-82af-7f223d429b18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:19.176872 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c876be-28f8-4f88-82af-7f223d429b18 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:19.279974 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 559/1093] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:52:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 02:52:19.287816 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f6c53-5c37-42c9-8ad7-15645720e467 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:19.388147 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f6c53-5c37-42c9-8ad7-15645720e467 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:19.426972 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ddec89-3037-40cb-846a-68a190f7f9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:19.427696 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddec89-3037-40cb-846a-68a190f7f9f7 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:19.427999 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddec89-3037-40cb-846a-68a190f7f9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:19.428260 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddec89-3037-40cb-846a-68a190f7f9f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:19.440285 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ddec89-3037-40cb-846a-68a190f7f9f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:19.441750 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ddec89-3037-40cb-846a-68a190f7f9f7 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:19.463772 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-12ddec89-3037-40cb-846a-68a190f7f9f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:52:19.465014 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 535/1094] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:52:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:52:19.471085 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c876be-28f8-4f88-82af-7f223d429b18 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:19.567525 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c876be-28f8-4f88-82af-7f223d429b18 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:19.602567 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f61775-46d7-4684-b021-5dd7af383f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:19.603323 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f61775-46d7-4684-b021-5dd7af383f53 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:19.603596 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f61775-46d7-4684-b021-5dd7af383f53 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:19.603902 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f61775-46d7-4684-b021-5dd7af383f53 None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:19.604621 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f61775-46d7-4684-b021-5dd7af383f53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:19.604925 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f61775-46d7-4684-b021-5dd7af383f53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:19.606290 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f61775-46d7-4684-b021-5dd7af383f53 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:19.618270 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 560/1095] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:19.624504 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ddec89-3037-40cb-846a-68a190f7f9f7 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:19.727831 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ddec89-3037-40cb-846a-68a190f7f9f7 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:19.761597 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d218b-7729-44f3-b590-1275e206c297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:19.762385 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d218b-7729-44f3-b590-1275e206c297 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:19.762658 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d218b-7729-44f3-b590-1275e206c297 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:19.762925 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d218b-7729-44f3-b590-1275e206c297 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:19.769533 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d218b-7729-44f3-b590-1275e206c297 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:19.770978 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d218b-7729-44f3-b590-1275e206c297 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:19.783864 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-d41d218b-7729-44f3-b590-1275e206c297 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:52:19.785047 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 536/1096] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:52:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:52:19.789937 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8bece-d5d1-428b-ac59-390c1470cd4a None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:19.790431 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8bece-d5d1-428b-ac59-390c1470cd4a None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:19.790675 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8bece-d5d1-428b-ac59-390c1470cd4a None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:19.790767 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d218b-7729-44f3-b590-1275e206c297 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:19.792128 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 561/1097] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:52:19.797977 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fd58d-e8e9-466f-838f-6572d6d4d7b6 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:19.798258 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fd58d-e8e9-466f-838f-6572d6d4d7b6 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:19.798530 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fd58d-e8e9-466f-838f-6572d6d4d7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:19.816673 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-7e6fd58d-e8e9-466f-838f-6572d6d4d7b6 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:52:19.817818 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-7e6fd58d-e8e9-466f-838f-6572d6d4d7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:52:19.882169 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 562/1098] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:52:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:52:19.890664 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d218b-7729-44f3-b590-1275e206c297 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:19.906844 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6fd58d-e8e9-466f-838f-6572d6d4d7b6 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:19.925928 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020331a4-76fd-4927-9695-30946bfbbdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:19.926580 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020331a4-76fd-4927-9695-30946bfbbdab None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:19.926850 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020331a4-76fd-4927-9695-30946bfbbdab None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:19.927114 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020331a4-76fd-4927-9695-30946bfbbdab None admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:19.928076 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020331a4-76fd-4927-9695-30946bfbbdab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:19.928363 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020331a4-76fd-4927-9695-30946bfbbdab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:19.929797 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020331a4-76fd-4927-9695-30946bfbbdab None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:19.941347 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 537/1099] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 02:52:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:52:19.948473 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020331a4-76fd-4927-9695-30946bfbbdab None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:20.002119 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6fd58d-e8e9-466f-838f-6572d6d4d7b6 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:20.035711 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f5fe4-e107-41ea-987f-3741509aacbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:20.036520 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f5fe4-e107-41ea-987f-3741509aacbc None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:20.036791 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f5fe4-e107-41ea-987f-3741509aacbc None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:20.037048 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f5fe4-e107-41ea-987f-3741509aacbc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:20.041760 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020331a4-76fd-4927-9695-30946bfbbdab None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:20.047550 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f5fe4-e107-41ea-987f-3741509aacbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:52:20.054263 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-201f5fe4-e107-41ea-987f-3741509aacbc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 02:52:20.055490 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 563/1100] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 02:52:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:52:20.061575 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f5fe4-e107-41ea-987f-3741509aacbc None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:20.080685 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a700ebf-e62f-46cf-a1c8-50066b408add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:20.081322 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a700ebf-e62f-46cf-a1c8-50066b408add None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:20.081592 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a700ebf-e62f-46cf-a1c8-50066b408add None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:20.081856 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a700ebf-e62f-46cf-a1c8-50066b408add None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:20.082659 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a700ebf-e62f-46cf-a1c8-50066b408add None admin] RBAC: Adding query filter params (role.id=94f6d87df94e495d8f9a139ab8a39ef5, scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed, user.id=43ee5cb310fd4538910e40ea7082708c) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:20.082981 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a700ebf-e62f-46cf-a1c8-50066b408add None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:20.084441 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a700ebf-e62f-46cf-a1c8-50066b408add None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:20.090311 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 538/1101] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:52:19 2022] GET /identity/v3/role_assignments?user.id=43ee5cb310fd4538910e40ea7082708c&scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed&role.id=94f6d87df94e495d8f9a139ab8a39ef5 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:52:20.162431 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f5fe4-e107-41ea-987f-3741509aacbc None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:20.198969 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2364f30-2a14-4dc8-bf27-894458d569d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:20.199644 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2364f30-2a14-4dc8-bf27-894458d569d4 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:20.199964 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2364f30-2a14-4dc8-bf27-894458d569d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:20.200236 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2364f30-2a14-4dc8-bf27-894458d569d4 None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:20.200993 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2364f30-2a14-4dc8-bf27-894458d569d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:20.201292 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2364f30-2a14-4dc8-bf27-894458d569d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:20.202656 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2364f30-2a14-4dc8-bf27-894458d569d4 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:20.212077 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 564/1102] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:52:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:20.218253 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a700ebf-e62f-46cf-a1c8-50066b408add None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:20.441898 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a700ebf-e62f-46cf-a1c8-50066b408add None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:20.477708 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa6219-4c1f-430c-bedf-f32ca5b5d2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:20.478604 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa6219-4c1f-430c-bedf-f32ca5b5d2a8 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:20.478876 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa6219-4c1f-430c-bedf-f32ca5b5d2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:20.479140 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa6219-4c1f-430c-bedf-f32ca5b5d2a8 None admin] PATH_INFO: `/v3/users/c365cffb751642d58097441468683a4f` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:20.480369 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa6219-4c1f-430c-bedf-f32ca5b5d2a8 None admin] RBAC: Authorizing `identity:get_user(user_id=c365cffb751642d58097441468683a4f)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:20.481868 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa6219-4c1f-430c-bedf-f32ca5b5d2a8 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:20.483415 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 539/1103] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:52:20 2022] GET /identity/v3/users/c365cffb751642d58097441468683a4f => generated 285 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:20.489811 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2364f30-2a14-4dc8-bf27-894458d569d4 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:20.591671 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2364f30-2a14-4dc8-bf27-894458d569d4 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:20.626961 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26be71-c800-4210-b6d2-48ee4c7a4114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:20.627599 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26be71-c800-4210-b6d2-48ee4c7a4114 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:20.627917 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26be71-c800-4210-b6d2-48ee4c7a4114 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:20.628182 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26be71-c800-4210-b6d2-48ee4c7a4114 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:20.694542 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26be71-c800-4210-b6d2-48ee4c7a4114 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:20.695923 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26be71-c800-4210-b6d2-48ee4c7a4114 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:20.792750 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 565/1104] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:52:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 02:52:20.798790 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa6219-4c1f-430c-bedf-f32ca5b5d2a8 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:20.897232 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa6219-4c1f-430c-bedf-f32ca5b5d2a8 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:20.929738 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44da3f-e46a-4932-95d8-9d93c3c4d8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:20.930591 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44da3f-e46a-4932-95d8-9d93c3c4d8d5 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:20.930864 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44da3f-e46a-4932-95d8-9d93c3c4d8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:20.931192 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44da3f-e46a-4932-95d8-9d93c3c4d8d5 None admin] PATH_INFO: `/v3/projects/d3cf9deeb1a84d45b43b156e7014da13` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:20.932465 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44da3f-e46a-4932-95d8-9d93c3c4d8d5 None admin] RBAC: Authorizing `identity:get_project(project_id=d3cf9deeb1a84d45b43b156e7014da13)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:20.933912 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44da3f-e46a-4932-95d8-9d93c3c4d8d5 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:20.935926 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 540/1105] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:52:20 2022] GET /identity/v3/projects/d3cf9deeb1a84d45b43b156e7014da13 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:20.941908 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26be71-c800-4210-b6d2-48ee4c7a4114 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:21.036528 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26be71-c800-4210-b6d2-48ee4c7a4114 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:21.080591 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096cd47-11ad-46d0-9525-8ff6085180b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:21.081238 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096cd47-11ad-46d0-9525-8ff6085180b4 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:21.081517 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096cd47-11ad-46d0-9525-8ff6085180b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:21.081788 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096cd47-11ad-46d0-9525-8ff6085180b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:21.082609 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096cd47-11ad-46d0-9525-8ff6085180b4 None admin] RBAC: Adding query filter params (role.id=c0f19d3800f44637822d5162ffe4b497, scope.project.id=d3cf9deeb1a84d45b43b156e7014da13, user.id=c365cffb751642d58097441468683a4f) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:21.082917 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096cd47-11ad-46d0-9525-8ff6085180b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:21.084381 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096cd47-11ad-46d0-9525-8ff6085180b4 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:21.090290 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 566/1106] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:52:20 2022] GET /identity/v3/role_assignments?user.id=c365cffb751642d58097441468683a4f&scope.project.id=d3cf9deeb1a84d45b43b156e7014da13&role.id=c0f19d3800f44637822d5162ffe4b497 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:23.414023 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b71544-826e-43b0-920e-d8b109a5a793 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:23.414867 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b71544-826e-43b0-920e-d8b109a5a793 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:23.414867 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b71544-826e-43b0-920e-d8b109a5a793 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:23.416594 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 541/1107] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:52:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:52:23.422200 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e1bbf-6b26-4000-9fb4-f338be5d7d49 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:23.422652 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e1bbf-6b26-4000-9fb4-f338be5d7d49 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:23.422742 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e1bbf-6b26-4000-9fb4-f338be5d7d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:23.439857 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-995e1bbf-6b26-4000-9fb4-f338be5d7d49 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:52:23.441023 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-995e1bbf-6b26-4000-9fb4-f338be5d7d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:52:23.506363 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 567/1108] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:52:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 02:52:23.532997 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b71544-826e-43b0-920e-d8b109a5a793 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:23.637146 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b71544-826e-43b0-920e-d8b109a5a793 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:23.674194 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc0a22-e5b2-41c6-9eeb-75cfabba0922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:23.674904 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc0a22-e5b2-41c6-9eeb-75cfabba0922 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:23.675175 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc0a22-e5b2-41c6-9eeb-75cfabba0922 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:23.675446 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc0a22-e5b2-41c6-9eeb-75cfabba0922 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:23.676745 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc0a22-e5b2-41c6-9eeb-75cfabba0922 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:23.678182 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc0a22-e5b2-41c6-9eeb-75cfabba0922 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:23.679972 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 542/1109] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:52:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:23.686852 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e1bbf-6b26-4000-9fb4-f338be5d7d49 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:23.786025 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e1bbf-6b26-4000-9fb4-f338be5d7d49 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:23.821322 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d2685-2c1c-47a9-9318-193a11222e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:23.821982 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d2685-2c1c-47a9-9318-193a11222e77 None admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:23.822252 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d2685-2c1c-47a9-9318-193a11222e77 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:23.822516 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d2685-2c1c-47a9-9318-193a11222e77 None admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:23.823199 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d2685-2c1c-47a9-9318-193a11222e77 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:23.824636 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d2685-2c1c-47a9-9318-193a11222e77 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:23.849105 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 568/1110] 10.222.0.32 () {60 vars in 1132 bytes} [Tue Apr 12 02:52:23 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 02:52:26.178835 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5579bf-4aeb-40c8-9d0f-340a4a8c6091 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:26.179684 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5579bf-4aeb-40c8-9d0f-340a4a8c6091 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:26.179684 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5579bf-4aeb-40c8-9d0f-340a4a8c6091 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:26.181729 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 543/1111] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:52:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:52:26.187256 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84cc48-c731-4507-90e4-e80358f709f0 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:26.187733 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84cc48-c731-4507-90e4-e80358f709f0 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:26.187829 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84cc48-c731-4507-90e4-e80358f709f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:26.212819 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-0f84cc48-c731-4507-90e4-e80358f709f0 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:52:26.214004 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-0f84cc48-c731-4507-90e4-e80358f709f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:52:26.281940 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 569/1112] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:52:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 02:52:26.316972 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5579bf-4aeb-40c8-9d0f-340a4a8c6091 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:26.429874 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5579bf-4aeb-40c8-9d0f-340a4a8c6091 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:26.472484 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33aeaa2-6996-47e4-bf1e-febc0ed5d1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:26.473333 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33aeaa2-6996-47e4-bf1e-febc0ed5d1d7 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:26.473604 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33aeaa2-6996-47e4-bf1e-febc0ed5d1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:26.473871 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33aeaa2-6996-47e4-bf1e-febc0ed5d1d7 None admin] PATH_INFO: `/v3/roles/60b6ad9d4f6d40b4a37fb5045c7f4523` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:26.475445 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33aeaa2-6996-47e4-bf1e-febc0ed5d1d7 None admin] RBAC: Authorizing `identity:get_role(role_id=60b6ad9d4f6d40b4a37fb5045c7f4523)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:26.476865 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33aeaa2-6996-47e4-bf1e-febc0ed5d1d7 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:26.478338 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 544/1113] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:52:26 2022] GET /identity/v3/roles/60b6ad9d4f6d40b4a37fb5045c7f4523 => generated 223 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:26.484977 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84cc48-c731-4507-90e4-e80358f709f0 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:26.588540 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84cc48-c731-4507-90e4-e80358f709f0 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:26.625020 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc80e8c-4713-4f0d-aeaa-6a360d68d11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:26.625893 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc80e8c-4713-4f0d-aeaa-6a360d68d11b None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:26.626168 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc80e8c-4713-4f0d-aeaa-6a360d68d11b None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:26.626430 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc80e8c-4713-4f0d-aeaa-6a360d68d11b None admin] PATH_INFO: `/v3/users/f9a6477a88c640c1a468c2cf685c9169` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:26.639406 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc80e8c-4713-4f0d-aeaa-6a360d68d11b None admin] RBAC: Authorizing `identity:get_user(user_id=f9a6477a88c640c1a468c2cf685c9169)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:26.640872 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc80e8c-4713-4f0d-aeaa-6a360d68d11b None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:26.642524 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 570/1114] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:52:26 2022] GET /identity/v3/users/f9a6477a88c640c1a468c2cf685c9169 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:26.648689 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33aeaa2-6996-47e4-bf1e-febc0ed5d1d7 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:26.745868 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33aeaa2-6996-47e4-bf1e-febc0ed5d1d7 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:26.779209 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdb9f3-7bbd-4bf0-981b-ea0a3c0b5fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:26.779872 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdb9f3-7bbd-4bf0-981b-ea0a3c0b5fc8 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:26.780130 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdb9f3-7bbd-4bf0-981b-ea0a3c0b5fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:26.780398 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdb9f3-7bbd-4bf0-981b-ea0a3c0b5fc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:26.850248 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfdb9f3-7bbd-4bf0-981b-ea0a3c0b5fc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:26.851703 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfdb9f3-7bbd-4bf0-981b-ea0a3c0b5fc8 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:26.953204 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 545/1115] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:52:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 02:52:26.960163 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc80e8c-4713-4f0d-aeaa-6a360d68d11b None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:27.061055 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc80e8c-4713-4f0d-aeaa-6a360d68d11b None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:27.094755 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a63e1d-9d77-46d1-9e56-2ee5d13c31b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:27.095599 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a63e1d-9d77-46d1-9e56-2ee5d13c31b1 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:27.095901 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a63e1d-9d77-46d1-9e56-2ee5d13c31b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:27.096164 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a63e1d-9d77-46d1-9e56-2ee5d13c31b1 None admin] PATH_INFO: `/v3/projects/d3cf9deeb1a84d45b43b156e7014da13` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:27.097325 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a63e1d-9d77-46d1-9e56-2ee5d13c31b1 None admin] RBAC: Authorizing `identity:get_project(project_id=d3cf9deeb1a84d45b43b156e7014da13)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:27.098770 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a63e1d-9d77-46d1-9e56-2ee5d13c31b1 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:27.100481 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 571/1116] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:52:26 2022] GET /identity/v3/projects/d3cf9deeb1a84d45b43b156e7014da13 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:27.107384 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdb9f3-7bbd-4bf0-981b-ea0a3c0b5fc8 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:27.213221 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdb9f3-7bbd-4bf0-981b-ea0a3c0b5fc8 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:27.246496 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd7189-d286-42a5-90ad-c6b171e003db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:27.247140 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd7189-d286-42a5-90ad-c6b171e003db None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:27.247409 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd7189-d286-42a5-90ad-c6b171e003db None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:27.247674 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd7189-d286-42a5-90ad-c6b171e003db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:27.248514 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd7189-d286-42a5-90ad-c6b171e003db None admin] RBAC: Adding query filter params (role.id=60b6ad9d4f6d40b4a37fb5045c7f4523, scope.project.id=d3cf9deeb1a84d45b43b156e7014da13, user.id=f9a6477a88c640c1a468c2cf685c9169) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:27.248814 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd7189-d286-42a5-90ad-c6b171e003db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:27.250248 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd7189-d286-42a5-90ad-c6b171e003db None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:27.255474 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 546/1117] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:52:27 2022] GET /identity/v3/role_assignments?user.id=f9a6477a88c640c1a468c2cf685c9169&scope.project.id=d3cf9deeb1a84d45b43b156e7014da13&role.id=60b6ad9d4f6d40b4a37fb5045c7f4523 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:29.514516 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938fda2-2475-4d42-bbdb-777fc60401df None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:29.515362 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938fda2-2475-4d42-bbdb-777fc60401df None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:29.515362 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938fda2-2475-4d42-bbdb-777fc60401df None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:29.517223 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 572/1118] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:52:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:52:29.523258 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab774f-e630-4981-a50e-c51ecabc4afe None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:29.523975 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab774f-e630-4981-a50e-c51ecabc4afe None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:29.524081 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab774f-e630-4981-a50e-c51ecabc4afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:29.547673 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-f1ab774f-e630-4981-a50e-c51ecabc4afe None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:52:29.548862 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-f1ab774f-e630-4981-a50e-c51ecabc4afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:52:29.616061 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 547/1119] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:52:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:52:29.638627 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938fda2-2475-4d42-bbdb-777fc60401df None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:29.757147 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938fda2-2475-4d42-bbdb-777fc60401df None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:29.791215 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c221e-b853-44a2-8de7-791bda8c14de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:29.792027 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c221e-b853-44a2-8de7-791bda8c14de None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:29.792300 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c221e-b853-44a2-8de7-791bda8c14de None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:29.792563 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c221e-b853-44a2-8de7-791bda8c14de None admin] PATH_INFO: `/v3/roles/60b6ad9d4f6d40b4a37fb5045c7f4523` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:29.794117 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c221e-b853-44a2-8de7-791bda8c14de None admin] RBAC: Authorizing `identity:get_role(role_id=60b6ad9d4f6d40b4a37fb5045c7f4523)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:29.795472 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c221e-b853-44a2-8de7-791bda8c14de None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:29.796899 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 573/1120] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:52:29 2022] GET /identity/v3/roles/60b6ad9d4f6d40b4a37fb5045c7f4523 => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:29.806490 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab774f-e630-4981-a50e-c51ecabc4afe None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:29.908248 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab774f-e630-4981-a50e-c51ecabc4afe None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:29.946663 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95df8a8-d1d4-482c-9a8a-3ba8b0fe065f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:29.947810 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95df8a8-d1d4-482c-9a8a-3ba8b0fe065f None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:29.948085 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95df8a8-d1d4-482c-9a8a-3ba8b0fe065f None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:29.948352 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95df8a8-d1d4-482c-9a8a-3ba8b0fe065f None admin] PATH_INFO: `/v3/users/f9a6477a88c640c1a468c2cf685c9169` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:29.949649 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95df8a8-d1d4-482c-9a8a-3ba8b0fe065f None admin] RBAC: Authorizing `identity:get_user(user_id=f9a6477a88c640c1a468c2cf685c9169)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:29.951079 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95df8a8-d1d4-482c-9a8a-3ba8b0fe065f None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:29.952683 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 548/1121] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:52:29 2022] GET /identity/v3/users/f9a6477a88c640c1a468c2cf685c9169 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:29.961853 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c221e-b853-44a2-8de7-791bda8c14de None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:30.059642 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c221e-b853-44a2-8de7-791bda8c14de None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:30.093902 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1979e87-6a9d-4bb8-a0d3-394e1c89e88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:30.094739 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1979e87-6a9d-4bb8-a0d3-394e1c89e88e None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:30.095011 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1979e87-6a9d-4bb8-a0d3-394e1c89e88e None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:30.095279 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1979e87-6a9d-4bb8-a0d3-394e1c89e88e None admin] PATH_INFO: `/v3/projects/d3cf9deeb1a84d45b43b156e7014da13` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:30.096545 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1979e87-6a9d-4bb8-a0d3-394e1c89e88e None admin] RBAC: Authorizing `identity:get_project(project_id=d3cf9deeb1a84d45b43b156e7014da13)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:30.097957 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1979e87-6a9d-4bb8-a0d3-394e1c89e88e None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:30.099647 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 574/1122] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:52:29 2022] GET /identity/v3/projects/d3cf9deeb1a84d45b43b156e7014da13 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:30.107878 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95df8a8-d1d4-482c-9a8a-3ba8b0fe065f None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:30.217219 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95df8a8-d1d4-482c-9a8a-3ba8b0fe065f None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:30.250329 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0071467-10ff-4d18-a4aa-3b078f6dd9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:30.251186 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0071467-10ff-4d18-a4aa-3b078f6dd9fb None admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:30.251456 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0071467-10ff-4d18-a4aa-3b078f6dd9fb None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:30.251707 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0071467-10ff-4d18-a4aa-3b078f6dd9fb None admin] PATH_INFO: `/v3/projects/d3cf9deeb1a84d45b43b156e7014da13/users/f9a6477a88c640c1a468c2cf685c9169/roles/60b6ad9d4f6d40b4a37fb5045c7f4523` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:30.254290 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0071467-10ff-4d18-a4aa-3b078f6dd9fb None admin] RBAC: Authorizing `identity:create_grant(project_id=d3cf9deeb1a84d45b43b156e7014da13, user_id=f9a6477a88c640c1a468c2cf685c9169, role_id=60b6ad9d4f6d40b4a37fb5045c7f4523)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:30.255714 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0071467-10ff-4d18-a4aa-3b078f6dd9fb None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:30.272536 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 549/1123] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 02:52:30 2022] PUT /identity/v3/projects/d3cf9deeb1a84d45b43b156e7014da13/users/f9a6477a88c640c1a468c2cf685c9169/roles/60b6ad9d4f6d40b4a37fb5045c7f4523 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 02:52:32.575463 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ce88a-377b-494a-a994-f9e166aeaee8 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:32.575463 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ce88a-377b-494a-a994-f9e166aeaee8 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:32.576138 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ce88a-377b-494a-a994-f9e166aeaee8 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:32.577267 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 575/1124] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:52:32.583156 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c3c57-98fa-47a5-b4ce-4a6dbb22b0c8 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:32.583581 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c3c57-98fa-47a5-b4ce-4a6dbb22b0c8 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:32.583669 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c3c57-98fa-47a5-b4ce-4a6dbb22b0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:32.601618 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-7c7c3c57-98fa-47a5-b4ce-4a6dbb22b0c8 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:52:32.602928 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-7c7c3c57-98fa-47a5-b4ce-4a6dbb22b0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:52:32.687322 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 550/1125] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:52:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:52:32.714093 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ce88a-377b-494a-a994-f9e166aeaee8 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:32.838946 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ce88a-377b-494a-a994-f9e166aeaee8 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:32.880956 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be062f51-db37-440f-b5d8-abaf3c7fb046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:32.881888 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be062f51-db37-440f-b5d8-abaf3c7fb046 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:32.882156 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be062f51-db37-440f-b5d8-abaf3c7fb046 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:32.882507 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be062f51-db37-440f-b5d8-abaf3c7fb046 None admin] PATH_INFO: `/v3/roles/60b6ad9d4f6d40b4a37fb5045c7f4523` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:32.884189 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be062f51-db37-440f-b5d8-abaf3c7fb046 None admin] RBAC: Authorizing `identity:get_role(role_id=60b6ad9d4f6d40b4a37fb5045c7f4523)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:32.885648 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be062f51-db37-440f-b5d8-abaf3c7fb046 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:32.887034 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 576/1126] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:52:32 2022] GET /identity/v3/roles/60b6ad9d4f6d40b4a37fb5045c7f4523 => generated 223 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:32.895337 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c3c57-98fa-47a5-b4ce-4a6dbb22b0c8 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:33.015117 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c3c57-98fa-47a5-b4ce-4a6dbb22b0c8 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:33.058628 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a71581-aa11-422e-b94f-aa91dc05c6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:33.059492 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a71581-aa11-422e-b94f-aa91dc05c6d7 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:33.059756 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a71581-aa11-422e-b94f-aa91dc05c6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:33.060049 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a71581-aa11-422e-b94f-aa91dc05c6d7 None admin] PATH_INFO: `/v3/users/f9a6477a88c640c1a468c2cf685c9169` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:33.061349 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a71581-aa11-422e-b94f-aa91dc05c6d7 None admin] RBAC: Authorizing `identity:get_user(user_id=f9a6477a88c640c1a468c2cf685c9169)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:33.062801 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a71581-aa11-422e-b94f-aa91dc05c6d7 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:33.064457 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 551/1127] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:52:32 2022] GET /identity/v3/users/f9a6477a88c640c1a468c2cf685c9169 => generated 286 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:33.070776 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be062f51-db37-440f-b5d8-abaf3c7fb046 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:33.176231 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be062f51-db37-440f-b5d8-abaf3c7fb046 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:33.209983 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5165a-3d7a-4fa7-b356-ef08176c85a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:33.210613 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5165a-3d7a-4fa7-b356-ef08176c85a9 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:33.210890 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5165a-3d7a-4fa7-b356-ef08176c85a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:33.211154 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5165a-3d7a-4fa7-b356-ef08176c85a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:33.281432 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5165a-3d7a-4fa7-b356-ef08176c85a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:33.282866 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5165a-3d7a-4fa7-b356-ef08176c85a9 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:33.381339 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 577/1128] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:52:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 02:52:33.389561 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a71581-aa11-422e-b94f-aa91dc05c6d7 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:33.502148 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a71581-aa11-422e-b94f-aa91dc05c6d7 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:33.537284 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637b6fa-592e-4e88-90e7-27ee430bd182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:33.538146 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637b6fa-592e-4e88-90e7-27ee430bd182 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:33.538419 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637b6fa-592e-4e88-90e7-27ee430bd182 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:33.538687 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637b6fa-592e-4e88-90e7-27ee430bd182 None admin] PATH_INFO: `/v3/projects/d3cf9deeb1a84d45b43b156e7014da13` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:33.539921 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637b6fa-592e-4e88-90e7-27ee430bd182 None admin] RBAC: Authorizing `identity:get_project(project_id=d3cf9deeb1a84d45b43b156e7014da13)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:33.541395 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637b6fa-592e-4e88-90e7-27ee430bd182 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:33.543066 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 552/1129] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:52:33 2022] GET /identity/v3/projects/d3cf9deeb1a84d45b43b156e7014da13 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:33.549628 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5165a-3d7a-4fa7-b356-ef08176c85a9 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:33.649444 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5165a-3d7a-4fa7-b356-ef08176c85a9 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:33.683599 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6b2b2-f1be-4e9e-9549-3029886f8fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:33.684262 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6b2b2-f1be-4e9e-9549-3029886f8fc5 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:33.684533 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6b2b2-f1be-4e9e-9549-3029886f8fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:33.684795 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6b2b2-f1be-4e9e-9549-3029886f8fc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:33.685611 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c6b2b2-f1be-4e9e-9549-3029886f8fc5 None admin] RBAC: Adding query filter params (role.id=60b6ad9d4f6d40b4a37fb5045c7f4523, scope.project.id=d3cf9deeb1a84d45b43b156e7014da13, user.id=f9a6477a88c640c1a468c2cf685c9169) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:33.685916 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c6b2b2-f1be-4e9e-9549-3029886f8fc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:33.687355 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c6b2b2-f1be-4e9e-9549-3029886f8fc5 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:33.693152 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 578/1130] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:52:33 2022] GET /identity/v3/role_assignments?user.id=f9a6477a88c640c1a468c2cf685c9169&scope.project.id=d3cf9deeb1a84d45b43b156e7014da13&role.id=60b6ad9d4f6d40b4a37fb5045c7f4523 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:36.020624 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838364e4-1b66-4eb2-b61c-99fead71c477 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:36.021171 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838364e4-1b66-4eb2-b61c-99fead71c477 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:36.021171 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838364e4-1b66-4eb2-b61c-99fead71c477 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:36.022498 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 553/1131] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:52:36.029297 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d429389-b12f-454c-9818-a98342159085 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:36.030010 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d429389-b12f-454c-9818-a98342159085 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:36.030149 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d429389-b12f-454c-9818-a98342159085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:36.057731 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-0d429389-b12f-454c-9818-a98342159085 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:52:36.058892 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-0d429389-b12f-454c-9818-a98342159085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:52:36.131799 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 579/1132] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:52:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:52:36.169926 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838364e4-1b66-4eb2-b61c-99fead71c477 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:36.278354 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838364e4-1b66-4eb2-b61c-99fead71c477 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:36.311462 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9fe87-131d-4e48-95bd-b0f131c5a2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:36.312263 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9fe87-131d-4e48-95bd-b0f131c5a2d2 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:36.312532 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9fe87-131d-4e48-95bd-b0f131c5a2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:36.312795 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9fe87-131d-4e48-95bd-b0f131c5a2d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:36.313980 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e9fe87-131d-4e48-95bd-b0f131c5a2d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:36.315434 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e9fe87-131d-4e48-95bd-b0f131c5a2d2 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:36.317031 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 554/1133] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:52:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:36.323614 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d429389-b12f-454c-9818-a98342159085 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:36.435065 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d429389-b12f-454c-9818-a98342159085 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:36.469929 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0ea17-6d3b-462c-8f37-c1c7cc55b85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:36.470573 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0ea17-6d3b-462c-8f37-c1c7cc55b85d None admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:36.470846 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0ea17-6d3b-462c-8f37-c1c7cc55b85d None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:36.471112 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0ea17-6d3b-462c-8f37-c1c7cc55b85d None admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:36.471837 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0ea17-6d3b-462c-8f37-c1c7cc55b85d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:36.473262 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0ea17-6d3b-462c-8f37-c1c7cc55b85d None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:36.502530 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 580/1134] 10.222.0.32 () {60 vars in 1141 bytes} [Tue Apr 12 02:52:36 2022] POST /identity/v3/projects => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 02:52:38.860212 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ddafd-b2f6-4d4b-bfcc-f38f202c4558 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:38.860732 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ddafd-b2f6-4d4b-bfcc-f38f202c4558 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:38.860732 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ddafd-b2f6-4d4b-bfcc-f38f202c4558 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:38.862693 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 555/1135] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:52:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:52:38.870567 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b5b18-796e-451a-9a95-85bd31df90c3 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:38.870961 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b5b18-796e-451a-9a95-85bd31df90c3 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:38.871104 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b5b18-796e-451a-9a95-85bd31df90c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:38.890069 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-6c6b5b18-796e-451a-9a95-85bd31df90c3 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:52:38.891230 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-6c6b5b18-796e-451a-9a95-85bd31df90c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:52:38.959525 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 581/1136] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:52:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:52:38.985028 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ddafd-b2f6-4d4b-bfcc-f38f202c4558 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:39.088767 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ddafd-b2f6-4d4b-bfcc-f38f202c4558 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:39.121655 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f2ff7-286b-44f1-a82f-a8bf4f864a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:39.122362 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f2ff7-286b-44f1-a82f-a8bf4f864a3f None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:39.122632 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f2ff7-286b-44f1-a82f-a8bf4f864a3f None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:39.122886 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f2ff7-286b-44f1-a82f-a8bf4f864a3f None admin] PATH_INFO: `/v3/domains/default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:39.124085 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f2ff7-286b-44f1-a82f-a8bf4f864a3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:39.125519 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f2ff7-286b-44f1-a82f-a8bf4f864a3f None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:39.127106 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 556/1137] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:52:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:39.132927 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b5b18-796e-451a-9a95-85bd31df90c3 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:39.228469 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b5b18-796e-451a-9a95-85bd31df90c3 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:39.261506 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7464e3-c2b5-4b2d-9aac-bc5d2492aa1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:39.262149 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7464e3-c2b5-4b2d-9aac-bc5d2492aa1d None admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:39.262421 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7464e3-c2b5-4b2d-9aac-bc5d2492aa1d None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:39.262686 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7464e3-c2b5-4b2d-9aac-bc5d2492aa1d None admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:39.263387 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7464e3-c2b5-4b2d-9aac-bc5d2492aa1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:39.264831 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7464e3-c2b5-4b2d-9aac-bc5d2492aa1d None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:39.287335 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 582/1138] 10.222.0.32 () {60 vars in 1132 bytes} [Tue Apr 12 02:52:39 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 02:52:41.635903 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7598c88-accb-46b2-9000-b8c204b8167b None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:41.636639 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7598c88-accb-46b2-9000-b8c204b8167b None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:41.636807 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7598c88-accb-46b2-9000-b8c204b8167b None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:41.638920 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 557/1139] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:52:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:52:41.644290 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbc081-d558-4edf-a15d-5204590a3a52 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:41.644725 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbc081-d558-4edf-a15d-5204590a3a52 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:41.644826 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbc081-d558-4edf-a15d-5204590a3a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:41.663096 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-03bbc081-d558-4edf-a15d-5204590a3a52 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:52:41.664274 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-03bbc081-d558-4edf-a15d-5204590a3a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:52:41.737019 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 583/1140] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:52:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:52:41.761992 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7598c88-accb-46b2-9000-b8c204b8167b None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:41.870453 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7598c88-accb-46b2-9000-b8c204b8167b None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:41.904312 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f0aff-ec31-46c1-bd09-6195298388e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:41.905087 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f0aff-ec31-46c1-bd09-6195298388e2 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:41.905350 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f0aff-ec31-46c1-bd09-6195298388e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:41.905616 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f0aff-ec31-46c1-bd09-6195298388e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:41.916200 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f0aff-ec31-46c1-bd09-6195298388e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:52:41.922850 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-ba8f0aff-ec31-46c1-bd09-6195298388e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 02:52:41.924044 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 558/1141] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 02:52:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:52:41.932885 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbc081-d558-4edf-a15d-5204590a3a52 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:42.032465 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbc081-d558-4edf-a15d-5204590a3a52 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:42.065743 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9814fc-164c-4a4d-bc8c-3c6df616153c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:42.066391 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9814fc-164c-4a4d-bc8c-3c6df616153c None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:42.066657 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9814fc-164c-4a4d-bc8c-3c6df616153c None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:42.066920 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9814fc-164c-4a4d-bc8c-3c6df616153c None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:42.067652 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9814fc-164c-4a4d-bc8c-3c6df616153c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:42.067976 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9814fc-164c-4a4d-bc8c-3c6df616153c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:42.069310 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9814fc-164c-4a4d-bc8c-3c6df616153c None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:42.077308 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 584/1142] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:52:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:42.087072 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f0aff-ec31-46c1-bd09-6195298388e2 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:42.197290 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f0aff-ec31-46c1-bd09-6195298388e2 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:42.231557 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520083ff-b93d-4564-80d3-fe8bd6ee31c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:42.232455 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520083ff-b93d-4564-80d3-fe8bd6ee31c1 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:42.232731 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520083ff-b93d-4564-80d3-fe8bd6ee31c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:42.232994 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520083ff-b93d-4564-80d3-fe8bd6ee31c1 None admin] PATH_INFO: `/v3/users/a9dc14dd208b4a489cad917064efd6d2` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:42.246532 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520083ff-b93d-4564-80d3-fe8bd6ee31c1 None admin] RBAC: Authorizing `identity:get_user(user_id=a9dc14dd208b4a489cad917064efd6d2)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:42.248011 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520083ff-b93d-4564-80d3-fe8bd6ee31c1 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:42.249627 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 559/1143] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:52:42 2022] GET /identity/v3/users/a9dc14dd208b4a489cad917064efd6d2 => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:42.255778 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9814fc-164c-4a4d-bc8c-3c6df616153c None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:42.353007 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9814fc-164c-4a4d-bc8c-3c6df616153c None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:42.384500 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d93ef-35ae-4a9d-aa4f-35b4cbd54a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:42.385131 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d93ef-35ae-4a9d-aa4f-35b4cbd54a22 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:42.385406 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d93ef-35ae-4a9d-aa4f-35b4cbd54a22 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:42.385678 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d93ef-35ae-4a9d-aa4f-35b4cbd54a22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:42.453969 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d93ef-35ae-4a9d-aa4f-35b4cbd54a22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:42.455404 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d93ef-35ae-4a9d-aa4f-35b4cbd54a22 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:42.561206 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 585/1144] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:52:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 02:52:42.567782 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520083ff-b93d-4564-80d3-fe8bd6ee31c1 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:42.681477 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520083ff-b93d-4564-80d3-fe8bd6ee31c1 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:42.716143 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d060dc6-bf71-45e0-9a72-51a2d1a8b892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:42.716919 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d060dc6-bf71-45e0-9a72-51a2d1a8b892 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:42.717189 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d060dc6-bf71-45e0-9a72-51a2d1a8b892 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:42.717453 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d060dc6-bf71-45e0-9a72-51a2d1a8b892 None admin] PATH_INFO: `/v3/projects/54f65b07792f4e9bace7aa6bd933e894` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:42.718734 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d060dc6-bf71-45e0-9a72-51a2d1a8b892 None admin] RBAC: Authorizing `identity:get_project(project_id=54f65b07792f4e9bace7aa6bd933e894)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:42.720209 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d060dc6-bf71-45e0-9a72-51a2d1a8b892 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:42.721876 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 560/1145] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:52:42 2022] GET /identity/v3/projects/54f65b07792f4e9bace7aa6bd933e894 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:42.728876 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d93ef-35ae-4a9d-aa4f-35b4cbd54a22 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:42.829542 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d93ef-35ae-4a9d-aa4f-35b4cbd54a22 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:42.864855 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd09e5-0a42-4ae7-ac4b-14b77bf37725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:42.865507 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd09e5-0a42-4ae7-ac4b-14b77bf37725 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:42.865776 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd09e5-0a42-4ae7-ac4b-14b77bf37725 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:42.866048 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd09e5-0a42-4ae7-ac4b-14b77bf37725 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:42.866873 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd09e5-0a42-4ae7-ac4b-14b77bf37725 None admin] RBAC: Adding query filter params (role.id=c0f19d3800f44637822d5162ffe4b497, scope.project.id=54f65b07792f4e9bace7aa6bd933e894, user.id=a9dc14dd208b4a489cad917064efd6d2) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:42.867179 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd09e5-0a42-4ae7-ac4b-14b77bf37725 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:42.868665 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd09e5-0a42-4ae7-ac4b-14b77bf37725 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:42.873997 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 586/1146] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:52:42 2022] GET /identity/v3/role_assignments?user.id=a9dc14dd208b4a489cad917064efd6d2&scope.project.id=54f65b07792f4e9bace7aa6bd933e894&role.id=c0f19d3800f44637822d5162ffe4b497 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:45.135161 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f2626-fac7-4d43-99fb-11ee0197f1d0 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:45.135702 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f2626-fac7-4d43-99fb-11ee0197f1d0 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:45.135702 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f2626-fac7-4d43-99fb-11ee0197f1d0 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:45.137777 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 561/1147] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:52:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:52:45.146506 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11efb8a-16b8-4bb0-bd56-8a9c6d3d4a40 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:45.146896 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11efb8a-16b8-4bb0-bd56-8a9c6d3d4a40 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:45.147185 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11efb8a-16b8-4bb0-bd56-8a9c6d3d4a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:45.170828 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-e11efb8a-16b8-4bb0-bd56-8a9c6d3d4a40 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:52:45.172040 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-e11efb8a-16b8-4bb0-bd56-8a9c6d3d4a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:52:45.248250 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 587/1148] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:52:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:52:45.275528 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f2626-fac7-4d43-99fb-11ee0197f1d0 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:45.385551 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f2626-fac7-4d43-99fb-11ee0197f1d0 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:45.424544 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64570e-282b-4ebe-bf80-2113dc0b4fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:45.425719 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64570e-282b-4ebe-bf80-2113dc0b4fa2 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:45.426113 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64570e-282b-4ebe-bf80-2113dc0b4fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:45.426492 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64570e-282b-4ebe-bf80-2113dc0b4fa2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:45.438792 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64570e-282b-4ebe-bf80-2113dc0b4fa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:52:45.445569 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-9d64570e-282b-4ebe-bf80-2113dc0b4fa2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 02:52:45.447112 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 562/1149] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 02:52:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:52:45.455599 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11efb8a-16b8-4bb0-bd56-8a9c6d3d4a40 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:45.557882 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11efb8a-16b8-4bb0-bd56-8a9c6d3d4a40 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:45.594835 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6cfa26-8e5d-46d8-b052-d0c94ba0f462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:45.595501 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6cfa26-8e5d-46d8-b052-d0c94ba0f462 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:45.595780 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6cfa26-8e5d-46d8-b052-d0c94ba0f462 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:45.596094 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6cfa26-8e5d-46d8-b052-d0c94ba0f462 None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:45.596831 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6cfa26-8e5d-46d8-b052-d0c94ba0f462 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:45.597132 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6cfa26-8e5d-46d8-b052-d0c94ba0f462 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:45.598508 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6cfa26-8e5d-46d8-b052-d0c94ba0f462 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:45.606849 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 588/1150] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:52:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:45.616189 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64570e-282b-4ebe-bf80-2113dc0b4fa2 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:45.719114 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64570e-282b-4ebe-bf80-2113dc0b4fa2 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:45.757124 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ea66a-794e-43d4-849c-2c50993abb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:45.757978 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ea66a-794e-43d4-849c-2c50993abb14 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:45.758243 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ea66a-794e-43d4-849c-2c50993abb14 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:45.758504 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ea66a-794e-43d4-849c-2c50993abb14 None admin] PATH_INFO: `/v3/users/a9dc14dd208b4a489cad917064efd6d2` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:45.760067 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ea66a-794e-43d4-849c-2c50993abb14 None admin] RBAC: Authorizing `identity:get_user(user_id=a9dc14dd208b4a489cad917064efd6d2)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:45.761518 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ea66a-794e-43d4-849c-2c50993abb14 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:45.763155 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 563/1151] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:52:45 2022] GET /identity/v3/users/a9dc14dd208b4a489cad917064efd6d2 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:45.772691 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6cfa26-8e5d-46d8-b052-d0c94ba0f462 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:45.881276 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6cfa26-8e5d-46d8-b052-d0c94ba0f462 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:45.914584 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307ff2d-e233-4aec-a103-a52b339536c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:45.915613 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307ff2d-e233-4aec-a103-a52b339536c5 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:45.915910 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307ff2d-e233-4aec-a103-a52b339536c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:45.916207 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307ff2d-e233-4aec-a103-a52b339536c5 None admin] PATH_INFO: `/v3/projects/54f65b07792f4e9bace7aa6bd933e894` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:45.917460 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9307ff2d-e233-4aec-a103-a52b339536c5 None admin] RBAC: Authorizing `identity:get_project(project_id=54f65b07792f4e9bace7aa6bd933e894)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:45.918893 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9307ff2d-e233-4aec-a103-a52b339536c5 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:45.920586 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 589/1152] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:52:45 2022] GET /identity/v3/projects/54f65b07792f4e9bace7aa6bd933e894 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:45.927158 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ea66a-794e-43d4-849c-2c50993abb14 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:46.031043 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ea66a-794e-43d4-849c-2c50993abb14 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:46.064329 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5abcce4-4f20-4870-a88c-c2d22df8e657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:46.065203 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abcce4-4f20-4870-a88c-c2d22df8e657 None admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:46.065471 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abcce4-4f20-4870-a88c-c2d22df8e657 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:46.065737 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abcce4-4f20-4870-a88c-c2d22df8e657 None admin] PATH_INFO: `/v3/projects/54f65b07792f4e9bace7aa6bd933e894/users/a9dc14dd208b4a489cad917064efd6d2/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:46.067931 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5abcce4-4f20-4870-a88c-c2d22df8e657 None admin] RBAC: Authorizing `identity:create_grant(project_id=54f65b07792f4e9bace7aa6bd933e894, user_id=a9dc14dd208b4a489cad917064efd6d2, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:46.069360 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5abcce4-4f20-4870-a88c-c2d22df8e657 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:46.090416 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 564/1153] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 02:52:45 2022] PUT /identity/v3/projects/54f65b07792f4e9bace7aa6bd933e894/users/a9dc14dd208b4a489cad917064efd6d2/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 02:52:48.379909 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27284a-dbbc-4a2e-921f-710356edd0c0 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:48.380513 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27284a-dbbc-4a2e-921f-710356edd0c0 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:48.380513 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27284a-dbbc-4a2e-921f-710356edd0c0 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:48.382522 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 590/1154] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:52:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:52:48.388870 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283d4aa-5280-4ace-8930-62d949e29ba8 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:48.389281 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283d4aa-5280-4ace-8930-62d949e29ba8 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:48.389400 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283d4aa-5280-4ace-8930-62d949e29ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:48.407632 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-c283d4aa-5280-4ace-8930-62d949e29ba8 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:52:48.408815 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-c283d4aa-5280-4ace-8930-62d949e29ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:52:48.479076 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 565/1155] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:52:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:52:48.504164 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27284a-dbbc-4a2e-921f-710356edd0c0 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:48.616903 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27284a-dbbc-4a2e-921f-710356edd0c0 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:48.652602 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b454c-258f-463b-9e76-0d561107f5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:48.653320 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b454c-258f-463b-9e76-0d561107f5e8 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:48.653594 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b454c-258f-463b-9e76-0d561107f5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:48.653856 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b454c-258f-463b-9e76-0d561107f5e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:48.664262 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b454c-258f-463b-9e76-0d561107f5e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:52:48.671043 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-e82b454c-258f-463b-9e76-0d561107f5e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 02:52:48.672288 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 591/1156] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 02:52:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:52:48.679079 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283d4aa-5280-4ace-8930-62d949e29ba8 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:48.792063 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283d4aa-5280-4ace-8930-62d949e29ba8 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:48.829388 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1767c-9fac-408c-a84d-e513adb6944a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:48.830384 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1767c-9fac-408c-a84d-e513adb6944a None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:48.830803 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1767c-9fac-408c-a84d-e513adb6944a None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:48.831222 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1767c-9fac-408c-a84d-e513adb6944a None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:48.832464 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1767c-9fac-408c-a84d-e513adb6944a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:48.832933 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1767c-9fac-408c-a84d-e513adb6944a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:48.835117 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1767c-9fac-408c-a84d-e513adb6944a None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:48.844182 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 566/1157] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:52:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:48.850108 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b454c-258f-463b-9e76-0d561107f5e8 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:48.953427 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b454c-258f-463b-9e76-0d561107f5e8 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:48.991416 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411ae4e-dfde-489e-ab56-c9ed4de5d673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:48.992288 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411ae4e-dfde-489e-ab56-c9ed4de5d673 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:48.992554 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411ae4e-dfde-489e-ab56-c9ed4de5d673 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:48.992813 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411ae4e-dfde-489e-ab56-c9ed4de5d673 None admin] PATH_INFO: `/v3/users/a9dc14dd208b4a489cad917064efd6d2` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:48.994095 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0411ae4e-dfde-489e-ab56-c9ed4de5d673 None admin] RBAC: Authorizing `identity:get_user(user_id=a9dc14dd208b4a489cad917064efd6d2)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:48.995514 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0411ae4e-dfde-489e-ab56-c9ed4de5d673 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:48.997118 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 592/1158] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:52:48 2022] GET /identity/v3/users/a9dc14dd208b4a489cad917064efd6d2 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:49.005679 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1767c-9fac-408c-a84d-e513adb6944a None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:49.125742 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1767c-9fac-408c-a84d-e513adb6944a None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:49.160126 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d38fd-2fb7-42e9-b4ea-fbdd29b31169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:49.160765 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d38fd-2fb7-42e9-b4ea-fbdd29b31169 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:49.161037 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d38fd-2fb7-42e9-b4ea-fbdd29b31169 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:49.161310 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d38fd-2fb7-42e9-b4ea-fbdd29b31169 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:49.229986 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d38fd-2fb7-42e9-b4ea-fbdd29b31169 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:49.231377 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d38fd-2fb7-42e9-b4ea-fbdd29b31169 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:49.335955 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 567/1159] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:52:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 02:52:49.344191 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411ae4e-dfde-489e-ab56-c9ed4de5d673 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:49.470087 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411ae4e-dfde-489e-ab56-c9ed4de5d673 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:49.503320 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2dd143-a4e2-43be-b8fb-93e34a06027a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:49.504136 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2dd143-a4e2-43be-b8fb-93e34a06027a None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:49.504414 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2dd143-a4e2-43be-b8fb-93e34a06027a None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:49.504682 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2dd143-a4e2-43be-b8fb-93e34a06027a None admin] PATH_INFO: `/v3/projects/54f65b07792f4e9bace7aa6bd933e894` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:49.505908 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2dd143-a4e2-43be-b8fb-93e34a06027a None admin] RBAC: Authorizing `identity:get_project(project_id=54f65b07792f4e9bace7aa6bd933e894)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:49.507332 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2dd143-a4e2-43be-b8fb-93e34a06027a None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:49.509080 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 593/1160] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:52:49 2022] GET /identity/v3/projects/54f65b07792f4e9bace7aa6bd933e894 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:49.515424 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d38fd-2fb7-42e9-b4ea-fbdd29b31169 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:49.634794 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d38fd-2fb7-42e9-b4ea-fbdd29b31169 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:49.670413 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad6317-5983-48a8-a838-a40daa6ae736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:49.671023 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad6317-5983-48a8-a838-a40daa6ae736 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:49.671291 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad6317-5983-48a8-a838-a40daa6ae736 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:49.671551 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad6317-5983-48a8-a838-a40daa6ae736 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:49.672391 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad6317-5983-48a8-a838-a40daa6ae736 None admin] RBAC: Adding query filter params (role.id=c0f19d3800f44637822d5162ffe4b497, scope.project.id=54f65b07792f4e9bace7aa6bd933e894, user.id=a9dc14dd208b4a489cad917064efd6d2) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:49.672691 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad6317-5983-48a8-a838-a40daa6ae736 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:49.674118 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad6317-5983-48a8-a838-a40daa6ae736 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:49.679850 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 568/1161] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:52:49 2022] GET /identity/v3/role_assignments?user.id=a9dc14dd208b4a489cad917064efd6d2&scope.project.id=54f65b07792f4e9bace7aa6bd933e894&role.id=c0f19d3800f44637822d5162ffe4b497 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:51.992400 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51495a-5dff-4299-b586-500d3d32bc63 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:51.993225 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51495a-5dff-4299-b586-500d3d32bc63 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:51.993406 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51495a-5dff-4299-b586-500d3d32bc63 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:51.995987 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 594/1162] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:52:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:52:52.004853 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66b1cc-ff67-4587-baeb-1b31138b1efe None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:52.005568 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66b1cc-ff67-4587-baeb-1b31138b1efe None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:52.005740 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66b1cc-ff67-4587-baeb-1b31138b1efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:52.024860 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-7c66b1cc-ff67-4587-baeb-1b31138b1efe None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:52:52.026084 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-7c66b1cc-ff67-4587-baeb-1b31138b1efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:52:52.095160 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 569/1163] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:52:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:52:52.118588 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51495a-5dff-4299-b586-500d3d32bc63 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:52.247437 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51495a-5dff-4299-b586-500d3d32bc63 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:52.281084 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e458f-242d-4b00-8391-d190854288f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:52.281717 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e458f-242d-4b00-8391-d190854288f5 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:52.281995 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e458f-242d-4b00-8391-d190854288f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:52.282261 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e458f-242d-4b00-8391-d190854288f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:52.349910 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e458f-242d-4b00-8391-d190854288f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:52.351345 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e458f-242d-4b00-8391-d190854288f5 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:52.446116 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 595/1164] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:52:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 02:52:52.455050 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66b1cc-ff67-4587-baeb-1b31138b1efe None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:52.563645 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66b1cc-ff67-4587-baeb-1b31138b1efe None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:52.599730 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b216fe-7e1a-440e-9a6b-f38a58a06fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:52.600579 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b216fe-7e1a-440e-9a6b-f38a58a06fc0 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:52.600903 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b216fe-7e1a-440e-9a6b-f38a58a06fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:52.601163 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b216fe-7e1a-440e-9a6b-f38a58a06fc0 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:52.608539 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b216fe-7e1a-440e-9a6b-f38a58a06fc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:52.609976 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b216fe-7e1a-440e-9a6b-f38a58a06fc0 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:52.624325 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-46b216fe-7e1a-440e-9a6b-f38a58a06fc0 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Apr 12 02:52:52.625496 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 570/1165] 10.222.0.32 () {56 vars in 1117 bytes} [Tue Apr 12 02:52:52 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:52:52.631978 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e458f-242d-4b00-8391-d190854288f5 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:52.745996 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e458f-242d-4b00-8391-d190854288f5 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:52.779557 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf96f9a-0ae7-405f-bd56-812645ae68d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:52.780235 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf96f9a-0ae7-405f-bd56-812645ae68d4 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:52.780512 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf96f9a-0ae7-405f-bd56-812645ae68d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:52.780777 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf96f9a-0ae7-405f-bd56-812645ae68d4 None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:52.781493 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf96f9a-0ae7-405f-bd56-812645ae68d4 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:52:52.781798 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf96f9a-0ae7-405f-bd56-812645ae68d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:52.783159 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf96f9a-0ae7-405f-bd56-812645ae68d4 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:52.790314 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 596/1166] 10.222.0.32 () {56 vars in 1115 bytes} [Tue Apr 12 02:52:52 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:55.090276 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702005f-82fc-4e38-b7e4-1fd8be59ed53 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:55.090868 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702005f-82fc-4e38-b7e4-1fd8be59ed53 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:55.090868 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702005f-82fc-4e38-b7e4-1fd8be59ed53 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:55.093080 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 571/1167] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:52:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:52:55.101847 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5ee01-dc92-44c5-86eb-1cf1150c05cf None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:55.102321 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5ee01-dc92-44c5-86eb-1cf1150c05cf None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:55.102447 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5ee01-dc92-44c5-86eb-1cf1150c05cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:55.130225 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-80e5ee01-dc92-44c5-86eb-1cf1150c05cf None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:52:55.132096 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-80e5ee01-dc92-44c5-86eb-1cf1150c05cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:52:55.200112 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 597/1168] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:52:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:52:55.235563 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702005f-82fc-4e38-b7e4-1fd8be59ed53 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:55.337630 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702005f-82fc-4e38-b7e4-1fd8be59ed53 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:55.372374 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c0d12-058b-402f-8f58-2fe4c34b2180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:55.372949 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c0d12-058b-402f-8f58-2fe4c34b2180 None admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:55.373230 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c0d12-058b-402f-8f58-2fe4c34b2180 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:55.373496 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c0d12-058b-402f-8f58-2fe4c34b2180 None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:55.374215 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c0d12-058b-402f-8f58-2fe4c34b2180 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:55.375588 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c0d12-058b-402f-8f58-2fe4c34b2180 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:55.392862 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 572/1169] 10.222.0.32 () {60 vars in 1138 bytes} [Tue Apr 12 02:52:55 2022] POST /identity/v3/domains => generated 267 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 02:52:57.721340 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857554c-dd5c-44b6-b55d-dfab73ba81ba None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:57.722213 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857554c-dd5c-44b6-b55d-dfab73ba81ba None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:57.722213 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857554c-dd5c-44b6-b55d-dfab73ba81ba None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:57.724359 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 598/1170] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:52:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:52:57.733020 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa89f60-fc05-41cc-abff-fa5d3a6cb818 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:57.733456 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa89f60-fc05-41cc-abff-fa5d3a6cb818 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:57.733582 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa89f60-fc05-41cc-abff-fa5d3a6cb818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:57.755652 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-2fa89f60-fc05-41cc-abff-fa5d3a6cb818 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:52:57.756934 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-2fa89f60-fc05-41cc-abff-fa5d3a6cb818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:52:57.828687 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 573/1171] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:52:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:52:57.856509 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857554c-dd5c-44b6-b55d-dfab73ba81ba None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:57.978902 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857554c-dd5c-44b6-b55d-dfab73ba81ba None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:58.018523 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa6dde-cc49-4371-9a1c-5a11fab4f7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:58.019404 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa6dde-cc49-4371-9a1c-5a11fab4f7d9 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:58.019679 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa6dde-cc49-4371-9a1c-5a11fab4f7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:58.019977 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa6dde-cc49-4371-9a1c-5a11fab4f7d9 None admin] PATH_INFO: `/v3/domains/a1e8131a97ca4b08bb4e4964456de067` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:58.030706 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa6dde-cc49-4371-9a1c-5a11fab4f7d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a1e8131a97ca4b08bb4e4964456de067)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:58.032182 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa6dde-cc49-4371-9a1c-5a11fab4f7d9 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:58.033871 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 599/1172] 10.222.0.32 () {56 vars in 1183 bytes} [Tue Apr 12 02:52:57 2022] GET /identity/v3/domains/a1e8131a97ca4b08bb4e4964456de067 => generated 267 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:52:58.040251 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa89f60-fc05-41cc-abff-fa5d3a6cb818 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:52:58.160235 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa89f60-fc05-41cc-abff-fa5d3a6cb818 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:52:58.207141 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18d53a-f09f-4930-a359-1d6cb50fa330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:52:58.207807 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18d53a-f09f-4930-a359-1d6cb50fa330 None admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:52:58.208102 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18d53a-f09f-4930-a359-1d6cb50fa330 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:52:58.208367 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18d53a-f09f-4930-a359-1d6cb50fa330 None admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:52:58.209061 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18d53a-f09f-4930-a359-1d6cb50fa330 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:52:58.210501 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18d53a-f09f-4930-a359-1d6cb50fa330 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:52:58.238215 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 574/1173] 10.222.0.32 () {60 vars in 1141 bytes} [Tue Apr 12 02:52:58 2022] POST /identity/v3/projects => generated 361 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 02:53:00.570592 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1127bec-d43c-4257-90bb-dfb3d29bc1b3 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:53:00.571287 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1127bec-d43c-4257-90bb-dfb3d29bc1b3 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:53:00.571287 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1127bec-d43c-4257-90bb-dfb3d29bc1b3 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:53:00.573398 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 600/1174] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:53:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:53:00.580153 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602957e-156d-4fe9-9ca5-7add450e65b5 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:53:00.580743 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602957e-156d-4fe9-9ca5-7add450e65b5 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:53:00.580843 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602957e-156d-4fe9-9ca5-7add450e65b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:53:00.598386 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-0602957e-156d-4fe9-9ca5-7add450e65b5 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:53:00.599524 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-0602957e-156d-4fe9-9ca5-7add450e65b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:53:00.666252 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 575/1175] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:53:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:53:00.696235 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1127bec-d43c-4257-90bb-dfb3d29bc1b3 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:53:00.800542 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1127bec-d43c-4257-90bb-dfb3d29bc1b3 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:53:00.849757 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597589b-d7a7-49c1-a394-a1bb7415cd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:53:00.850684 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597589b-d7a7-49c1-a394-a1bb7415cd69 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:53:00.850960 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597589b-d7a7-49c1-a394-a1bb7415cd69 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:53:00.851365 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597589b-d7a7-49c1-a394-a1bb7415cd69 None admin] PATH_INFO: `/v3/domains/a1e8131a97ca4b08bb4e4964456de067` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:53:00.853576 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597589b-d7a7-49c1-a394-a1bb7415cd69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a1e8131a97ca4b08bb4e4964456de067)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:53:00.855148 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597589b-d7a7-49c1-a394-a1bb7415cd69 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:53:00.856810 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 601/1176] 10.222.0.32 () {56 vars in 1183 bytes} [Tue Apr 12 02:53:00 2022] GET /identity/v3/domains/a1e8131a97ca4b08bb4e4964456de067 => generated 267 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:53:00.863006 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602957e-156d-4fe9-9ca5-7add450e65b5 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:53:00.969571 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602957e-156d-4fe9-9ca5-7add450e65b5 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:53:01.003328 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311aa81-64d7-4017-a87b-3f584f8b485e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:53:01.004042 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311aa81-64d7-4017-a87b-3f584f8b485e None admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:53:01.004315 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311aa81-64d7-4017-a87b-3f584f8b485e None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:53:01.004568 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311aa81-64d7-4017-a87b-3f584f8b485e None admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:53:01.005258 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311aa81-64d7-4017-a87b-3f584f8b485e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:53:01.006702 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311aa81-64d7-4017-a87b-3f584f8b485e None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:53:01.029201 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 576/1177] 10.222.0.32 () {60 vars in 1132 bytes} [Tue Apr 12 02:53:00 2022] POST /identity/v3/users => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 02:53:03.367985 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c73e18-57d7-4a9b-9461-e5f8bc133824 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:53:03.369008 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c73e18-57d7-4a9b-9461-e5f8bc133824 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:53:03.369008 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c73e18-57d7-4a9b-9461-e5f8bc133824 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:53:03.370476 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 602/1178] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:53:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:53:03.379520 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e783e9-8014-471d-aff7-fa2929538525 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:53:03.379969 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e783e9-8014-471d-aff7-fa2929538525 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:53:03.380146 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e783e9-8014-471d-aff7-fa2929538525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:53:03.400321 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-15e783e9-8014-471d-aff7-fa2929538525 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:53:03.401488 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-15e783e9-8014-471d-aff7-fa2929538525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:53:03.486143 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 577/1179] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:53:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:53:03.511171 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c73e18-57d7-4a9b-9461-e5f8bc133824 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:53:03.629409 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c73e18-57d7-4a9b-9461-e5f8bc133824 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:53:03.673690 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbcb03-3b2d-49d1-ae31-bd6cc9e12ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:53:03.674503 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbcb03-3b2d-49d1-ae31-bd6cc9e12ab9 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:53:03.674767 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbcb03-3b2d-49d1-ae31-bd6cc9e12ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:53:03.675028 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbcb03-3b2d-49d1-ae31-bd6cc9e12ab9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:53:03.686513 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bbcb03-3b2d-49d1-ae31-bd6cc9e12ab9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:53:03.693225 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-47bbcb03-3b2d-49d1-ae31-bd6cc9e12ab9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 02:53:03.694415 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 603/1180] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 02:53:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:53:03.704237 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e783e9-8014-471d-aff7-fa2929538525 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:53:03.808671 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e783e9-8014-471d-aff7-fa2929538525 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:53:03.842217 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8198c-25bb-4ee3-9c7b-1f044e6c401d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:53:03.842859 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8198c-25bb-4ee3-9c7b-1f044e6c401d None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:53:03.843131 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8198c-25bb-4ee3-9c7b-1f044e6c401d None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:53:03.843397 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8198c-25bb-4ee3-9c7b-1f044e6c401d None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:53:03.844161 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8198c-25bb-4ee3-9c7b-1f044e6c401d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:53:03.844462 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8198c-25bb-4ee3-9c7b-1f044e6c401d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:53:03.845825 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8198c-25bb-4ee3-9c7b-1f044e6c401d None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:53:03.853972 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 578/1181] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:53:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:53:03.860759 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbcb03-3b2d-49d1-ae31-bd6cc9e12ab9 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:53:03.970296 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbcb03-3b2d-49d1-ae31-bd6cc9e12ab9 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:53:04.007592 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1572c-71b6-41e0-a33b-4d077ddd3774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:53:04.008543 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1572c-71b6-41e0-a33b-4d077ddd3774 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:53:04.008816 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1572c-71b6-41e0-a33b-4d077ddd3774 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:53:04.009081 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1572c-71b6-41e0-a33b-4d077ddd3774 None admin] PATH_INFO: `/v3/users/86e155ffa46848ea9c547abe06a00265` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:53:04.023750 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1572c-71b6-41e0-a33b-4d077ddd3774 None admin] RBAC: Authorizing `identity:get_user(user_id=86e155ffa46848ea9c547abe06a00265)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:53:04.025210 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1572c-71b6-41e0-a33b-4d077ddd3774 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:53:04.026837 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 604/1182] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:53:03 2022] GET /identity/v3/users/86e155ffa46848ea9c547abe06a00265 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:53:04.033379 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8198c-25bb-4ee3-9c7b-1f044e6c401d None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:53:04.135471 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8198c-25bb-4ee3-9c7b-1f044e6c401d None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:53:04.168372 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22932a-e02c-4387-95e2-89403837a93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:53:04.168995 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22932a-e02c-4387-95e2-89403837a93d None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:53:04.169270 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22932a-e02c-4387-95e2-89403837a93d None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:53:04.169535 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22932a-e02c-4387-95e2-89403837a93d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:53:04.234419 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22932a-e02c-4387-95e2-89403837a93d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:53:04.235823 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22932a-e02c-4387-95e2-89403837a93d None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:53:04.332533 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 579/1183] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:53:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 02:53:04.340266 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1572c-71b6-41e0-a33b-4d077ddd3774 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:53:04.438212 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1572c-71b6-41e0-a33b-4d077ddd3774 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:53:04.472832 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a6af2-155d-4d50-a98e-9194ff32ff28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:53:04.473688 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a6af2-155d-4d50-a98e-9194ff32ff28 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:53:04.473961 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a6af2-155d-4d50-a98e-9194ff32ff28 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:53:04.474233 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a6af2-155d-4d50-a98e-9194ff32ff28 None admin] PATH_INFO: `/v3/projects/6a10616317924089b6342f82866ad77c` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:53:04.475520 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a6af2-155d-4d50-a98e-9194ff32ff28 None admin] RBAC: Authorizing `identity:get_project(project_id=6a10616317924089b6342f82866ad77c)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:53:04.476997 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a6af2-155d-4d50-a98e-9194ff32ff28 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:53:04.478705 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 605/1184] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:53:04 2022] GET /identity/v3/projects/6a10616317924089b6342f82866ad77c => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:53:04.485777 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22932a-e02c-4387-95e2-89403837a93d None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:53:04.590168 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22932a-e02c-4387-95e2-89403837a93d None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:53:04.624854 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa16c43-d5d1-49e8-80b1-7b8fa5c83ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:53:04.625497 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa16c43-d5d1-49e8-80b1-7b8fa5c83ec7 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:53:04.625771 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa16c43-d5d1-49e8-80b1-7b8fa5c83ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:53:04.626037 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa16c43-d5d1-49e8-80b1-7b8fa5c83ec7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:53:04.626846 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa16c43-d5d1-49e8-80b1-7b8fa5c83ec7 None admin] RBAC: Adding query filter params (role.id=c0f19d3800f44637822d5162ffe4b497, scope.project.id=6a10616317924089b6342f82866ad77c, user.id=86e155ffa46848ea9c547abe06a00265) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:53:04.627146 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa16c43-d5d1-49e8-80b1-7b8fa5c83ec7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:53:04.628614 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa16c43-d5d1-49e8-80b1-7b8fa5c83ec7 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:53:04.634922 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 580/1185] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:53:04 2022] GET /identity/v3/role_assignments?user.id=86e155ffa46848ea9c547abe06a00265&scope.project.id=6a10616317924089b6342f82866ad77c&role.id=c0f19d3800f44637822d5162ffe4b497 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:53:06.876132 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b863e-71f8-4422-afe4-960bfe5de35f None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:53:06.876656 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b863e-71f8-4422-afe4-960bfe5de35f None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:53:06.876656 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b863e-71f8-4422-afe4-960bfe5de35f None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:53:06.877974 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 606/1186] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:53:06.884337 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e3041-7a70-4a0c-a5dc-7d06f59945d8 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:53:06.885044 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e3041-7a70-4a0c-a5dc-7d06f59945d8 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:53:06.885217 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e3041-7a70-4a0c-a5dc-7d06f59945d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:53:06.911955 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-e51e3041-7a70-4a0c-a5dc-7d06f59945d8 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:53:06.913810 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-e51e3041-7a70-4a0c-a5dc-7d06f59945d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:53:06.984110 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 581/1187] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:53:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:53:07.006872 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b863e-71f8-4422-afe4-960bfe5de35f None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:53:07.114139 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b863e-71f8-4422-afe4-960bfe5de35f None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:53:07.148203 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248982f5-27ba-4c9a-9d0a-57ac1786f53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:53:07.149147 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248982f5-27ba-4c9a-9d0a-57ac1786f53e None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:53:07.149403 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248982f5-27ba-4c9a-9d0a-57ac1786f53e None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:53:07.149704 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248982f5-27ba-4c9a-9d0a-57ac1786f53e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:53:07.160213 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248982f5-27ba-4c9a-9d0a-57ac1786f53e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:53:07.167160 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-248982f5-27ba-4c9a-9d0a-57ac1786f53e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 02:53:07.168366 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 607/1188] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 02:53:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:53:07.176559 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e3041-7a70-4a0c-a5dc-7d06f59945d8 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:53:07.284214 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e3041-7a70-4a0c-a5dc-7d06f59945d8 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:53:07.321902 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472ee06-cd06-4440-bc16-26f1073998c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:53:07.322535 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472ee06-cd06-4440-bc16-26f1073998c3 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:53:07.322802 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472ee06-cd06-4440-bc16-26f1073998c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:53:07.323064 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472ee06-cd06-4440-bc16-26f1073998c3 None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:53:07.323788 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472ee06-cd06-4440-bc16-26f1073998c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:53:07.324106 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472ee06-cd06-4440-bc16-26f1073998c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:53:07.325462 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472ee06-cd06-4440-bc16-26f1073998c3 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:53:07.334367 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 582/1189] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:53:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:53:07.341138 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248982f5-27ba-4c9a-9d0a-57ac1786f53e None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:53:07.450920 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248982f5-27ba-4c9a-9d0a-57ac1786f53e None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:53:07.484338 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e7c1a-f787-4402-8c8d-e39c9e557654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:53:07.485181 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e7c1a-f787-4402-8c8d-e39c9e557654 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:53:07.485454 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e7c1a-f787-4402-8c8d-e39c9e557654 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:53:07.485716 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e7c1a-f787-4402-8c8d-e39c9e557654 None admin] PATH_INFO: `/v3/users/86e155ffa46848ea9c547abe06a00265` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:53:07.486997 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e7c1a-f787-4402-8c8d-e39c9e557654 None admin] RBAC: Authorizing `identity:get_user(user_id=86e155ffa46848ea9c547abe06a00265)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:53:07.488437 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e7c1a-f787-4402-8c8d-e39c9e557654 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:53:07.490050 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 608/1190] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:53:07 2022] GET /identity/v3/users/86e155ffa46848ea9c547abe06a00265 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:53:07.499300 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472ee06-cd06-4440-bc16-26f1073998c3 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:53:07.607117 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472ee06-cd06-4440-bc16-26f1073998c3 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:53:07.639808 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ae652-0538-4dec-8f85-5d2196c4a943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:53:07.640642 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ae652-0538-4dec-8f85-5d2196c4a943 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:53:07.640917 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ae652-0538-4dec-8f85-5d2196c4a943 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:53:07.641181 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ae652-0538-4dec-8f85-5d2196c4a943 None admin] PATH_INFO: `/v3/projects/6a10616317924089b6342f82866ad77c` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:53:07.642331 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ae652-0538-4dec-8f85-5d2196c4a943 None admin] RBAC: Authorizing `identity:get_project(project_id=6a10616317924089b6342f82866ad77c)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:53:07.643760 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ae652-0538-4dec-8f85-5d2196c4a943 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:53:07.645431 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 583/1191] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:53:07 2022] GET /identity/v3/projects/6a10616317924089b6342f82866ad77c => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:53:07.652283 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e7c1a-f787-4402-8c8d-e39c9e557654 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:53:07.760850 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e7c1a-f787-4402-8c8d-e39c9e557654 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:53:07.799493 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9ae1f-2645-4d45-b8cf-a09930a9cb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:53:07.800349 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9ae1f-2645-4d45-b8cf-a09930a9cb71 None admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:53:07.800615 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9ae1f-2645-4d45-b8cf-a09930a9cb71 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:53:07.800879 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9ae1f-2645-4d45-b8cf-a09930a9cb71 None admin] PATH_INFO: `/v3/projects/6a10616317924089b6342f82866ad77c/users/86e155ffa46848ea9c547abe06a00265/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:53:07.802940 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c9ae1f-2645-4d45-b8cf-a09930a9cb71 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a10616317924089b6342f82866ad77c, user_id=86e155ffa46848ea9c547abe06a00265, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:53:07.804401 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c9ae1f-2645-4d45-b8cf-a09930a9cb71 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:53:07.826249 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 609/1192] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 02:53:07 2022] PUT /identity/v3/projects/6a10616317924089b6342f82866ad77c/users/86e155ffa46848ea9c547abe06a00265/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 02:53:10.080133 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691017be-161a-4adb-85e6-2e41d669d781 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:53:10.080688 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691017be-161a-4adb-85e6-2e41d669d781 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:53:10.080688 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691017be-161a-4adb-85e6-2e41d669d781 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:53:10.082024 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 584/1193] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:53:10.088586 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1add9-8ab8-4946-bfa8-aac9caeb5ed0 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:53:10.089318 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1add9-8ab8-4946-bfa8-aac9caeb5ed0 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:53:10.089465 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1add9-8ab8-4946-bfa8-aac9caeb5ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:53:10.112620 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-32c1add9-8ab8-4946-bfa8-aac9caeb5ed0 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:53:10.113798 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-32c1add9-8ab8-4946-bfa8-aac9caeb5ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:53:10.184653 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 610/1194] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:53:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:53:10.214694 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691017be-161a-4adb-85e6-2e41d669d781 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:53:10.319919 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691017be-161a-4adb-85e6-2e41d669d781 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:53:10.354038 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66c926-76fc-4622-b954-265f6c20bda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:53:10.354755 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66c926-76fc-4622-b954-265f6c20bda5 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:53:10.355025 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66c926-76fc-4622-b954-265f6c20bda5 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:53:10.355285 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66c926-76fc-4622-b954-265f6c20bda5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:53:10.365506 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66c926-76fc-4622-b954-265f6c20bda5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:53:10.372447 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-ee66c926-76fc-4622-b954-265f6c20bda5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 02:53:10.373645 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 585/1195] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 02:53:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:53:10.383255 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1add9-8ab8-4946-bfa8-aac9caeb5ed0 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:53:10.489808 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1add9-8ab8-4946-bfa8-aac9caeb5ed0 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:53:10.523517 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91acf91f-cd73-4001-8933-74d71025912a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:53:10.524216 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91acf91f-cd73-4001-8933-74d71025912a None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:53:10.524514 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91acf91f-cd73-4001-8933-74d71025912a None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:53:10.524781 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91acf91f-cd73-4001-8933-74d71025912a None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:53:10.525522 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91acf91f-cd73-4001-8933-74d71025912a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:53:10.525820 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91acf91f-cd73-4001-8933-74d71025912a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:53:10.527181 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91acf91f-cd73-4001-8933-74d71025912a None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:53:10.536128 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 611/1196] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:53:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:53:10.542786 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66c926-76fc-4622-b954-265f6c20bda5 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:53:10.663492 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66c926-76fc-4622-b954-265f6c20bda5 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:53:10.700584 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f9641-f13d-4f6d-9089-7d63b393f321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:53:10.701443 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f9641-f13d-4f6d-9089-7d63b393f321 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:53:10.701715 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f9641-f13d-4f6d-9089-7d63b393f321 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:53:10.701982 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f9641-f13d-4f6d-9089-7d63b393f321 None admin] PATH_INFO: `/v3/users/86e155ffa46848ea9c547abe06a00265` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:53:10.703590 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f9641-f13d-4f6d-9089-7d63b393f321 None admin] RBAC: Authorizing `identity:get_user(user_id=86e155ffa46848ea9c547abe06a00265)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:53:10.705061 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f9641-f13d-4f6d-9089-7d63b393f321 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:53:10.706685 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 586/1197] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 02:53:10 2022] GET /identity/v3/users/86e155ffa46848ea9c547abe06a00265 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:53:10.713970 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91acf91f-cd73-4001-8933-74d71025912a None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:53:10.817100 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91acf91f-cd73-4001-8933-74d71025912a None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:53:10.850523 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6c097-c00c-4fbf-8506-42a238c09fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:53:10.851145 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6c097-c00c-4fbf-8506-42a238c09fbd None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:53:10.851419 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6c097-c00c-4fbf-8506-42a238c09fbd None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:53:10.851680 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6c097-c00c-4fbf-8506-42a238c09fbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:53:10.915861 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6c097-c00c-4fbf-8506-42a238c09fbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:53:10.917217 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6c097-c00c-4fbf-8506-42a238c09fbd None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:53:11.012188 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 612/1198] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:53:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 02:53:11.018460 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f9641-f13d-4f6d-9089-7d63b393f321 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:53:11.130507 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f9641-f13d-4f6d-9089-7d63b393f321 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:53:11.164282 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adbe1a9-d39e-4b97-9954-fa68daffe8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:53:11.165218 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbe1a9-d39e-4b97-9954-fa68daffe8d0 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:53:11.165493 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbe1a9-d39e-4b97-9954-fa68daffe8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:53:11.165756 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbe1a9-d39e-4b97-9954-fa68daffe8d0 None admin] PATH_INFO: `/v3/projects/6a10616317924089b6342f82866ad77c` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:53:11.167103 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adbe1a9-d39e-4b97-9954-fa68daffe8d0 None admin] RBAC: Authorizing `identity:get_project(project_id=6a10616317924089b6342f82866ad77c)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:53:11.168512 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adbe1a9-d39e-4b97-9954-fa68daffe8d0 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:53:11.170191 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 587/1199] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 02:53:11 2022] GET /identity/v3/projects/6a10616317924089b6342f82866ad77c => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:53:11.179620 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6c097-c00c-4fbf-8506-42a238c09fbd None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:53:11.277816 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6c097-c00c-4fbf-8506-42a238c09fbd None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:53:11.310980 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562fc0f3-af93-4314-93e2-9cb86c33943b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:53:11.311605 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562fc0f3-af93-4314-93e2-9cb86c33943b None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:53:11.311903 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562fc0f3-af93-4314-93e2-9cb86c33943b None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:53:11.312167 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562fc0f3-af93-4314-93e2-9cb86c33943b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:53:11.312971 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562fc0f3-af93-4314-93e2-9cb86c33943b None admin] RBAC: Adding query filter params (role.id=c0f19d3800f44637822d5162ffe4b497, scope.project.id=6a10616317924089b6342f82866ad77c, user.id=86e155ffa46848ea9c547abe06a00265) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:53:11.313263 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562fc0f3-af93-4314-93e2-9cb86c33943b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:53:11.314682 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562fc0f3-af93-4314-93e2-9cb86c33943b None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:53:11.320438 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 613/1200] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:53:11 2022] GET /identity/v3/role_assignments?user.id=86e155ffa46848ea9c547abe06a00265&scope.project.id=6a10616317924089b6342f82866ad77c&role.id=c0f19d3800f44637822d5162ffe4b497 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:13.233294 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b063d-ffa8-4ac0-8191-d3c72f947c73 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:13.233918 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b063d-ffa8-4ac0-8191-d3c72f947c73 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:13.233918 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b063d-ffa8-4ac0-8191-d3c72f947c73 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:13.235394 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 588/1201] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:54:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:54:13.243690 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2c31b-1fd8-4a8a-a550-4d85b3326af6 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:13.243690 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2c31b-1fd8-4a8a-a550-4d85b3326af6 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:13.243690 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2c31b-1fd8-4a8a-a550-4d85b3326af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:13.265830 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-05b2c31b-1fd8-4a8a-a550-4d85b3326af6 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:54:13.267390 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-05b2c31b-1fd8-4a8a-a550-4d85b3326af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:54:13.340936 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 614/1202] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:54:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:54:13.368309 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b063d-ffa8-4ac0-8191-d3c72f947c73 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:13.489305 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b063d-ffa8-4ac0-8191-d3c72f947c73 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:13.526795 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49633db5-c1d2-4519-b16e-37d86c38ce19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:13.527626 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49633db5-c1d2-4519-b16e-37d86c38ce19 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:13.527939 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49633db5-c1d2-4519-b16e-37d86c38ce19 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:13.528205 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49633db5-c1d2-4519-b16e-37d86c38ce19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:13.539031 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49633db5-c1d2-4519-b16e-37d86c38ce19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:13.540535 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49633db5-c1d2-4519-b16e-37d86c38ce19 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:13.558726 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-49633db5-c1d2-4519-b16e-37d86c38ce19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:54:13.560220 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 589/1203] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:54:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:54:13.566078 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2c31b-1fd8-4a8a-a550-4d85b3326af6 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:13.678896 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2c31b-1fd8-4a8a-a550-4d85b3326af6 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:13.720702 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023788a-64e5-4011-95c4-860de78433c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:13.721388 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023788a-64e5-4011-95c4-860de78433c7 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:13.721754 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023788a-64e5-4011-95c4-860de78433c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:13.722040 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023788a-64e5-4011-95c4-860de78433c7 None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:13.722830 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023788a-64e5-4011-95c4-860de78433c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:13.723145 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023788a-64e5-4011-95c4-860de78433c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:13.724760 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023788a-64e5-4011-95c4-860de78433c7 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:13.738082 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 615/1204] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:13.744870 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49633db5-c1d2-4519-b16e-37d86c38ce19 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:13.870190 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49633db5-c1d2-4519-b16e-37d86c38ce19 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:13.908222 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94671cf8-d9a7-4fb5-b830-956830a8f39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:13.908927 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94671cf8-d9a7-4fb5-b830-956830a8f39f None admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:13.909200 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94671cf8-d9a7-4fb5-b830-956830a8f39f None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:13.909507 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94671cf8-d9a7-4fb5-b830-956830a8f39f None admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:13.910223 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94671cf8-d9a7-4fb5-b830-956830a8f39f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:13.911677 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94671cf8-d9a7-4fb5-b830-956830a8f39f None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:13.943752 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 590/1205] 10.222.0.32 () {60 vars in 1132 bytes} [Tue Apr 12 02:54:13 2022] POST /identity/v3/users => generated 251 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 02:54:16.563607 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced427d-7346-48c6-b0c7-fe4854a3d9b2 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:16.564338 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced427d-7346-48c6-b0c7-fe4854a3d9b2 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:16.564338 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced427d-7346-48c6-b0c7-fe4854a3d9b2 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:16.565677 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 616/1206] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:54:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:54:16.570915 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c23d11-0f24-4b0b-8ce9-bb12c6672b7b None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:16.571404 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c23d11-0f24-4b0b-8ce9-bb12c6672b7b None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:16.571504 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c23d11-0f24-4b0b-8ce9-bb12c6672b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:16.589912 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-07c23d11-0f24-4b0b-8ce9-bb12c6672b7b None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:54:16.591139 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-07c23d11-0f24-4b0b-8ce9-bb12c6672b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:54:16.667790 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 591/1207] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:54:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:54:16.691106 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced427d-7346-48c6-b0c7-fe4854a3d9b2 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:16.805124 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced427d-7346-48c6-b0c7-fe4854a3d9b2 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:16.850983 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348696aa-891b-478c-b48c-3705517c42a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:16.852294 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348696aa-891b-478c-b48c-3705517c42a1 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:16.853308 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348696aa-891b-478c-b48c-3705517c42a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:16.853308 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348696aa-891b-478c-b48c-3705517c42a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:16.867626 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348696aa-891b-478c-b48c-3705517c42a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:54:16.875773 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-348696aa-891b-478c-b48c-3705517c42a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 02:54:16.877360 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 617/1208] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 02:54:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:54:16.884115 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c23d11-0f24-4b0b-8ce9-bb12c6672b7b None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:16.996790 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c23d11-0f24-4b0b-8ce9-bb12c6672b7b None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:17.037723 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f93871-cf14-409f-bbb1-fd6d2fa64f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:17.037723 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f93871-cf14-409f-bbb1-fd6d2fa64f0c None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:17.037723 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f93871-cf14-409f-bbb1-fd6d2fa64f0c None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:17.037723 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f93871-cf14-409f-bbb1-fd6d2fa64f0c None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:17.038566 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f93871-cf14-409f-bbb1-fd6d2fa64f0c None admin] RBAC: Adding query filter params (name=service) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:17.038698 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f93871-cf14-409f-bbb1-fd6d2fa64f0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:17.040758 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f93871-cf14-409f-bbb1-fd6d2fa64f0c None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:17.051761 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 592/1209] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 02:54:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:17.056794 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348696aa-891b-478c-b48c-3705517c42a1 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:17.170037 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348696aa-891b-478c-b48c-3705517c42a1 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:17.205724 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f2900-27eb-4eb9-913b-38b995812c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:17.206878 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f2900-27eb-4eb9-913b-38b995812c94 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:17.207316 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f2900-27eb-4eb9-913b-38b995812c94 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:17.207597 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f2900-27eb-4eb9-913b-38b995812c94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:17.219394 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f2900-27eb-4eb9-913b-38b995812c94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:17.220938 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f2900-27eb-4eb9-913b-38b995812c94 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:17.240476 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-247f2900-27eb-4eb9-913b-38b995812c94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:54:17.242007 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 618/1210] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:54:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:54:17.247486 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f93871-cf14-409f-bbb1-fd6d2fa64f0c None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:17.352078 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f93871-cf14-409f-bbb1-fd6d2fa64f0c None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:17.385221 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148e622-b013-403c-8212-95a47105cb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:17.385955 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148e622-b013-403c-8212-95a47105cb79 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:17.386293 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148e622-b013-403c-8212-95a47105cb79 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:17.386617 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148e622-b013-403c-8212-95a47105cb79 None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:17.387380 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148e622-b013-403c-8212-95a47105cb79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:17.387775 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148e622-b013-403c-8212-95a47105cb79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:17.389313 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148e622-b013-403c-8212-95a47105cb79 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:17.401334 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 593/1211] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:54:17.407112 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f2900-27eb-4eb9-913b-38b995812c94 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:17.507632 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f2900-27eb-4eb9-913b-38b995812c94 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:17.548051 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9bd446-b1e8-43ed-adb1-59e895bb633a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:17.549034 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bd446-b1e8-43ed-adb1-59e895bb633a None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:17.549566 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bd446-b1e8-43ed-adb1-59e895bb633a None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:17.550064 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bd446-b1e8-43ed-adb1-59e895bb633a None admin] PATH_INFO: `/v3/users/placement` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:17.562155 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9bd446-b1e8-43ed-adb1-59e895bb633a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:17.564266 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9bd446-b1e8-43ed-adb1-59e895bb633a None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:17.586417 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-fc9bd446-b1e8-43ed-adb1-59e895bb633a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 12 02:54:17.594780 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 619/1212] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:54:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:54:17.597206 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148e622-b013-403c-8212-95a47105cb79 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:17.748131 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148e622-b013-403c-8212-95a47105cb79 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:17.801366 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efad33-1151-4b9c-b6d1-6cc841cc8285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:17.802387 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efad33-1151-4b9c-b6d1-6cc841cc8285 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:17.802862 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efad33-1151-4b9c-b6d1-6cc841cc8285 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:17.803312 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efad33-1151-4b9c-b6d1-6cc841cc8285 None admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:17.805220 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efad33-1151-4b9c-b6d1-6cc841cc8285 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:17.805747 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efad33-1151-4b9c-b6d1-6cc841cc8285 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:17.808397 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efad33-1151-4b9c-b6d1-6cc841cc8285 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:17.837265 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 594/1213] 10.222.0.32 () {56 vars in 1143 bytes} [Tue Apr 12 02:54:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:54:17.844853 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9bd446-b1e8-43ed-adb1-59e895bb633a None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:17.953502 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9bd446-b1e8-43ed-adb1-59e895bb633a None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:17.987592 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38843d7-b369-4a19-988f-5afa0d64e333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:17.988429 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38843d7-b369-4a19-988f-5afa0d64e333 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:17.988795 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38843d7-b369-4a19-988f-5afa0d64e333 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:17.989264 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38843d7-b369-4a19-988f-5afa0d64e333 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:18.064757 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38843d7-b369-4a19-988f-5afa0d64e333 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:18.066498 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38843d7-b369-4a19-988f-5afa0d64e333 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:18.193676 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 620/1214] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:54:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 02:54:18.199545 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efad33-1151-4b9c-b6d1-6cc841cc8285 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:18.304374 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efad33-1151-4b9c-b6d1-6cc841cc8285 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:18.341555 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3ca6d-1977-468e-8abd-703674053495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:18.342313 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3ca6d-1977-468e-8abd-703674053495 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:18.342588 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3ca6d-1977-468e-8abd-703674053495 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:18.342878 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3ca6d-1977-468e-8abd-703674053495 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:18.354009 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e3ca6d-1977-468e-8abd-703674053495 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:18.355477 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e3ca6d-1977-468e-8abd-703674053495 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:18.372849 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-e3e3ca6d-1977-468e-8abd-703674053495 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:54:18.374405 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 595/1215] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:54:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:54:18.380061 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38843d7-b369-4a19-988f-5afa0d64e333 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:18.487633 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38843d7-b369-4a19-988f-5afa0d64e333 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:18.528222 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c385fef-ed93-4531-b5f8-56bde66df7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:18.529011 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c385fef-ed93-4531-b5f8-56bde66df7db None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:18.529352 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c385fef-ed93-4531-b5f8-56bde66df7db None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:18.529701 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c385fef-ed93-4531-b5f8-56bde66df7db None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:18.530485 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c385fef-ed93-4531-b5f8-56bde66df7db None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:18.530854 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c385fef-ed93-4531-b5f8-56bde66df7db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:18.532365 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c385fef-ed93-4531-b5f8-56bde66df7db None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:18.545394 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 621/1216] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:18.550713 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3ca6d-1977-468e-8abd-703674053495 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:18.660674 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3ca6d-1977-468e-8abd-703674053495 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:18.700477 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb43eeb-e561-4434-a4db-f231c3a747c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:18.701689 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb43eeb-e561-4434-a4db-f231c3a747c1 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:18.702136 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb43eeb-e561-4434-a4db-f231c3a747c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:18.702499 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb43eeb-e561-4434-a4db-f231c3a747c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:18.711903 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb43eeb-e561-4434-a4db-f231c3a747c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:18.713898 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb43eeb-e561-4434-a4db-f231c3a747c1 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:18.730337 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-bfb43eeb-e561-4434-a4db-f231c3a747c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:54:18.736656 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 596/1217] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:54:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:54:18.738096 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c385fef-ed93-4531-b5f8-56bde66df7db None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:18.857692 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c385fef-ed93-4531-b5f8-56bde66df7db None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:18.895281 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686610b-b049-499e-8cac-d8ddd8e0c503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:18.896066 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686610b-b049-499e-8cac-d8ddd8e0c503 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:18.896397 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686610b-b049-499e-8cac-d8ddd8e0c503 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:18.896596 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686610b-b049-499e-8cac-d8ddd8e0c503 None admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:18.897505 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6686610b-b049-499e-8cac-d8ddd8e0c503 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:18.897813 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6686610b-b049-499e-8cac-d8ddd8e0c503 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:18.899316 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6686610b-b049-499e-8cac-d8ddd8e0c503 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:18.915680 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 622/1218] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 02:54:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:54:18.922006 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb43eeb-e561-4434-a4db-f231c3a747c1 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:19.052350 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb43eeb-e561-4434-a4db-f231c3a747c1 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:19.090140 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e86bc-b72f-4c7a-87f7-8a453c13405d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:19.090956 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e86bc-b72f-4c7a-87f7-8a453c13405d None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:19.091297 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e86bc-b72f-4c7a-87f7-8a453c13405d None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:19.091646 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e86bc-b72f-4c7a-87f7-8a453c13405d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:19.092644 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e86bc-b72f-4c7a-87f7-8a453c13405d None admin] RBAC: Adding query filter params (role.id=a8b79923b07243e385187b6641381ee1, scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed, user.id=c2a88ae51543497382d34573afc2bde3) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:19.093002 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e86bc-b72f-4c7a-87f7-8a453c13405d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:19.094690 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e86bc-b72f-4c7a-87f7-8a453c13405d None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:19.101208 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 597/1219] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:54:18 2022] GET /identity/v3/role_assignments?user.id=c2a88ae51543497382d34573afc2bde3&scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed&role.id=a8b79923b07243e385187b6641381ee1 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:21.552402 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41442c99-f3dd-4942-ba27-30d8312243db None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:21.552995 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41442c99-f3dd-4942-ba27-30d8312243db None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:21.552995 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41442c99-f3dd-4942-ba27-30d8312243db None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:21.554462 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 623/1220] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:54:21.559925 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569482ef-4bea-431f-adfb-7696648c1768 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:21.560420 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569482ef-4bea-431f-adfb-7696648c1768 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:21.560528 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569482ef-4bea-431f-adfb-7696648c1768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:21.577124 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-569482ef-4bea-431f-adfb-7696648c1768 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:54:21.578551 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-569482ef-4bea-431f-adfb-7696648c1768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:54:21.647018 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 598/1221] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:54:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:54:21.670370 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41442c99-f3dd-4942-ba27-30d8312243db None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:21.778108 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41442c99-f3dd-4942-ba27-30d8312243db None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:21.814854 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5c853-a15e-4732-a084-c473b6e7b722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:21.815698 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5c853-a15e-4732-a084-c473b6e7b722 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:21.816068 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5c853-a15e-4732-a084-c473b6e7b722 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:21.816383 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5c853-a15e-4732-a084-c473b6e7b722 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:21.827249 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5c853-a15e-4732-a084-c473b6e7b722 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:54:21.834638 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-c4b5c853-a15e-4732-a084-c473b6e7b722 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 02:54:21.836371 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 624/1222] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 02:54:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:54:21.843836 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569482ef-4bea-431f-adfb-7696648c1768 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:21.945878 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569482ef-4bea-431f-adfb-7696648c1768 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:21.981304 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60607e4d-67fe-4f4d-9b6c-2e431012b9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:21.981978 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60607e4d-67fe-4f4d-9b6c-2e431012b9fd None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:21.982253 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60607e4d-67fe-4f4d-9b6c-2e431012b9fd None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:21.982519 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60607e4d-67fe-4f4d-9b6c-2e431012b9fd None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:21.983263 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60607e4d-67fe-4f4d-9b6c-2e431012b9fd None admin] RBAC: Adding query filter params (name=service) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:21.983563 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60607e4d-67fe-4f4d-9b6c-2e431012b9fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:21.985001 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60607e4d-67fe-4f4d-9b6c-2e431012b9fd None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:21.993874 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 599/1223] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 02:54:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:22.000038 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5c853-a15e-4732-a084-c473b6e7b722 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:22.114450 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5c853-a15e-4732-a084-c473b6e7b722 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:22.161402 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72513160-3c2d-4e8e-bf64-1aeb10558729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:22.162292 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72513160-3c2d-4e8e-bf64-1aeb10558729 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:22.162572 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72513160-3c2d-4e8e-bf64-1aeb10558729 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:22.163017 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72513160-3c2d-4e8e-bf64-1aeb10558729 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:22.176223 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72513160-3c2d-4e8e-bf64-1aeb10558729 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:22.178269 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72513160-3c2d-4e8e-bf64-1aeb10558729 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:22.195988 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-72513160-3c2d-4e8e-bf64-1aeb10558729 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:54:22.197201 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 625/1224] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:54:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:54:22.204058 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60607e4d-67fe-4f4d-9b6c-2e431012b9fd None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:22.314474 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60607e4d-67fe-4f4d-9b6c-2e431012b9fd None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:22.354141 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59dd63-9d28-4d17-bcba-d3d6a21a0419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:22.354876 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59dd63-9d28-4d17-bcba-d3d6a21a0419 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:22.355149 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59dd63-9d28-4d17-bcba-d3d6a21a0419 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:22.355421 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59dd63-9d28-4d17-bcba-d3d6a21a0419 None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:22.356286 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db59dd63-9d28-4d17-bcba-d3d6a21a0419 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:22.356590 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db59dd63-9d28-4d17-bcba-d3d6a21a0419 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:22.357977 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db59dd63-9d28-4d17-bcba-d3d6a21a0419 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:22.370512 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 600/1225] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:54:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:22.376155 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72513160-3c2d-4e8e-bf64-1aeb10558729 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:22.486066 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72513160-3c2d-4e8e-bf64-1aeb10558729 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:22.520712 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a53e8-0bde-4aa4-8e5a-39435157750e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:22.521509 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a53e8-0bde-4aa4-8e5a-39435157750e None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:22.521783 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a53e8-0bde-4aa4-8e5a-39435157750e None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:22.522042 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a53e8-0bde-4aa4-8e5a-39435157750e None admin] PATH_INFO: `/v3/users/placement` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:22.529837 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a53e8-0bde-4aa4-8e5a-39435157750e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:22.531258 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a53e8-0bde-4aa4-8e5a-39435157750e None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:22.544405 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-4f7a53e8-0bde-4aa4-8e5a-39435157750e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 12 02:54:22.545614 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 626/1226] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:54:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:54:22.551558 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59dd63-9d28-4d17-bcba-d3d6a21a0419 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:22.663919 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59dd63-9d28-4d17-bcba-d3d6a21a0419 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:22.701066 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12228def-843e-4aa5-b677-af75aa5edfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:22.701733 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12228def-843e-4aa5-b677-af75aa5edfea None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:22.702002 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12228def-843e-4aa5-b677-af75aa5edfea None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:22.702269 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12228def-843e-4aa5-b677-af75aa5edfea None admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:22.703398 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12228def-843e-4aa5-b677-af75aa5edfea None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:22.703697 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12228def-843e-4aa5-b677-af75aa5edfea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:22.705174 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12228def-843e-4aa5-b677-af75aa5edfea None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:22.723003 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 601/1227] 10.222.0.32 () {56 vars in 1143 bytes} [Tue Apr 12 02:54:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:22.728995 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a53e8-0bde-4aa4-8e5a-39435157750e None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:22.830665 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a53e8-0bde-4aa4-8e5a-39435157750e None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:22.867018 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f40368-7a09-45c8-aae5-dcc2039d974c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:22.867843 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f40368-7a09-45c8-aae5-dcc2039d974c None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:22.868122 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f40368-7a09-45c8-aae5-dcc2039d974c None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:22.868389 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f40368-7a09-45c8-aae5-dcc2039d974c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:22.880608 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f40368-7a09-45c8-aae5-dcc2039d974c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:22.882294 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f40368-7a09-45c8-aae5-dcc2039d974c None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:22.900054 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-84f40368-7a09-45c8-aae5-dcc2039d974c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:54:22.901428 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 627/1228] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:54:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:54:22.907361 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12228def-843e-4aa5-b677-af75aa5edfea None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:23.009415 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12228def-843e-4aa5-b677-af75aa5edfea None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:23.045230 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47efa2ba-802d-442b-b58b-aa5b1f87a8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:23.045885 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efa2ba-802d-442b-b58b-aa5b1f87a8e5 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:23.046240 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efa2ba-802d-442b-b58b-aa5b1f87a8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:23.046505 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efa2ba-802d-442b-b58b-aa5b1f87a8e5 None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:23.047211 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47efa2ba-802d-442b-b58b-aa5b1f87a8e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:23.047502 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47efa2ba-802d-442b-b58b-aa5b1f87a8e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:23.048911 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47efa2ba-802d-442b-b58b-aa5b1f87a8e5 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:23.060295 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 602/1229] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:54:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:23.066413 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f40368-7a09-45c8-aae5-dcc2039d974c None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:23.183971 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f40368-7a09-45c8-aae5-dcc2039d974c None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:23.218681 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36060816-5c6f-4e69-8acd-f12f08b8b415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:23.219475 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36060816-5c6f-4e69-8acd-f12f08b8b415 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:23.219771 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36060816-5c6f-4e69-8acd-f12f08b8b415 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:23.220038 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36060816-5c6f-4e69-8acd-f12f08b8b415 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:23.226863 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36060816-5c6f-4e69-8acd-f12f08b8b415 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:23.228341 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36060816-5c6f-4e69-8acd-f12f08b8b415 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:23.242221 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-36060816-5c6f-4e69-8acd-f12f08b8b415 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:54:23.243444 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 628/1230] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:54:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:54:23.249273 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47efa2ba-802d-442b-b58b-aa5b1f87a8e5 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:23.359582 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47efa2ba-802d-442b-b58b-aa5b1f87a8e5 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:23.398233 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5e5bf-3a98-4ed4-ac31-3f83e3710f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:23.398909 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5e5bf-3a98-4ed4-ac31-3f83e3710f6e None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:23.399182 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5e5bf-3a98-4ed4-ac31-3f83e3710f6e None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:23.399448 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5e5bf-3a98-4ed4-ac31-3f83e3710f6e None admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:23.400241 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5e5bf-3a98-4ed4-ac31-3f83e3710f6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:23.400541 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5e5bf-3a98-4ed4-ac31-3f83e3710f6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:23.401969 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5e5bf-3a98-4ed4-ac31-3f83e3710f6e None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:23.415097 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 603/1231] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 02:54:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:23.421901 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36060816-5c6f-4e69-8acd-f12f08b8b415 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:23.524976 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36060816-5c6f-4e69-8acd-f12f08b8b415 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:23.559407 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44f026-1beb-43ba-8c86-b6e93fc655ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:23.560316 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44f026-1beb-43ba-8c86-b6e93fc655ba None admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:23.560586 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44f026-1beb-43ba-8c86-b6e93fc655ba None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:23.560847 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44f026-1beb-43ba-8c86-b6e93fc655ba None admin] PATH_INFO: `/v3/projects/82cb5f6cfa0e46b28a37565fc2b560ed/users/c2a88ae51543497382d34573afc2bde3/roles/a8b79923b07243e385187b6641381ee1` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:23.576376 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44f026-1beb-43ba-8c86-b6e93fc655ba None admin] RBAC: Authorizing `identity:create_grant(project_id=82cb5f6cfa0e46b28a37565fc2b560ed, user_id=c2a88ae51543497382d34573afc2bde3, role_id=a8b79923b07243e385187b6641381ee1)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:23.578347 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44f026-1beb-43ba-8c86-b6e93fc655ba None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:23.592868 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 629/1232] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 02:54:23 2022] PUT /identity/v3/projects/82cb5f6cfa0e46b28a37565fc2b560ed/users/c2a88ae51543497382d34573afc2bde3/roles/a8b79923b07243e385187b6641381ee1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 02:54:25.947203 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96f744-3516-4d61-b87d-f46151034a1a None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:25.947841 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96f744-3516-4d61-b87d-f46151034a1a None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:25.947841 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96f744-3516-4d61-b87d-f46151034a1a None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:25.949241 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 604/1233] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:54:25.955178 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d40e0-2874-4d80-99f3-15f568da9694 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:25.955690 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d40e0-2874-4d80-99f3-15f568da9694 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:25.955911 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d40e0-2874-4d80-99f3-15f568da9694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:25.973828 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-f22d40e0-2874-4d80-99f3-15f568da9694 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:54:25.975089 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-f22d40e0-2874-4d80-99f3-15f568da9694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:54:26.044780 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 630/1234] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:54:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:54:26.071163 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96f744-3516-4d61-b87d-f46151034a1a None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:26.191496 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96f744-3516-4d61-b87d-f46151034a1a None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:26.230091 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a53f0-c5a8-42be-a8dd-40956aa6bf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:26.230885 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a53f0-c5a8-42be-a8dd-40956aa6bf26 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:26.231153 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a53f0-c5a8-42be-a8dd-40956aa6bf26 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:26.231413 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a53f0-c5a8-42be-a8dd-40956aa6bf26 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:26.241621 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a53f0-c5a8-42be-a8dd-40956aa6bf26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:54:26.249403 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-804a53f0-c5a8-42be-a8dd-40956aa6bf26 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 02:54:26.250768 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 605/1235] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 02:54:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:54:26.256930 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d40e0-2874-4d80-99f3-15f568da9694 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:26.368699 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d40e0-2874-4d80-99f3-15f568da9694 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:26.405187 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d156858-792e-4faf-af7e-10a2f5c89ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:26.405891 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d156858-792e-4faf-af7e-10a2f5c89ac5 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:26.406187 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d156858-792e-4faf-af7e-10a2f5c89ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:26.406517 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d156858-792e-4faf-af7e-10a2f5c89ac5 None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:26.407270 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d156858-792e-4faf-af7e-10a2f5c89ac5 None admin] RBAC: Adding query filter params (name=service) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:26.407571 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d156858-792e-4faf-af7e-10a2f5c89ac5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:26.409179 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d156858-792e-4faf-af7e-10a2f5c89ac5 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:26.418378 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 631/1236] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 02:54:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:26.424307 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a53f0-c5a8-42be-a8dd-40956aa6bf26 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:26.535927 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a53f0-c5a8-42be-a8dd-40956aa6bf26 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:26.574942 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb4554-efb7-4b64-ab08-3474e10bda89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:26.576154 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb4554-efb7-4b64-ab08-3474e10bda89 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:26.576434 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb4554-efb7-4b64-ab08-3474e10bda89 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:26.576773 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb4554-efb7-4b64-ab08-3474e10bda89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:26.590565 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb4554-efb7-4b64-ab08-3474e10bda89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:26.592085 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb4554-efb7-4b64-ab08-3474e10bda89 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:26.609343 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-62fb4554-efb7-4b64-ab08-3474e10bda89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:54:26.610852 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 606/1237] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:54:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:54:26.616888 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d156858-792e-4faf-af7e-10a2f5c89ac5 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:26.726332 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d156858-792e-4faf-af7e-10a2f5c89ac5 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:26.762219 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd83def-7bef-49d0-af7b-a0057d8ad3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:26.762884 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd83def-7bef-49d0-af7b-a0057d8ad3b5 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:26.763185 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd83def-7bef-49d0-af7b-a0057d8ad3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:26.763468 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd83def-7bef-49d0-af7b-a0057d8ad3b5 None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:26.764273 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd83def-7bef-49d0-af7b-a0057d8ad3b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:26.764598 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd83def-7bef-49d0-af7b-a0057d8ad3b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:26.766060 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd83def-7bef-49d0-af7b-a0057d8ad3b5 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:26.778761 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 632/1238] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:26.784516 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb4554-efb7-4b64-ab08-3474e10bda89 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:26.886053 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb4554-efb7-4b64-ab08-3474e10bda89 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:26.921169 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5b4dc-6445-43de-9b7a-23667ae94f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:26.921970 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5b4dc-6445-43de-9b7a-23667ae94f22 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:26.922242 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5b4dc-6445-43de-9b7a-23667ae94f22 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:26.922508 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5b4dc-6445-43de-9b7a-23667ae94f22 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:26.929956 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d5b4dc-6445-43de-9b7a-23667ae94f22 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:26.931372 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d5b4dc-6445-43de-9b7a-23667ae94f22 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:26.944520 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-68d5b4dc-6445-43de-9b7a-23667ae94f22 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 12 02:54:26.945949 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 607/1239] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:54:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:54:26.951670 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd83def-7bef-49d0-af7b-a0057d8ad3b5 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:27.057796 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd83def-7bef-49d0-af7b-a0057d8ad3b5 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:27.099917 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a15f0-69a7-4c5a-9390-aa50d21d6d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:27.100807 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a15f0-69a7-4c5a-9390-aa50d21d6d72 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:27.101084 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a15f0-69a7-4c5a-9390-aa50d21d6d72 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:27.101412 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a15f0-69a7-4c5a-9390-aa50d21d6d72 None admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:27.102287 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a15f0-69a7-4c5a-9390-aa50d21d6d72 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:27.102605 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a15f0-69a7-4c5a-9390-aa50d21d6d72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:27.104071 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a15f0-69a7-4c5a-9390-aa50d21d6d72 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:27.124707 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 633/1240] 10.222.0.32 () {56 vars in 1143 bytes} [Tue Apr 12 02:54:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:27.129252 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5b4dc-6445-43de-9b7a-23667ae94f22 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:27.244134 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5b4dc-6445-43de-9b7a-23667ae94f22 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:27.281813 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619feb3-de61-4019-85e4-8078300f13da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:27.282511 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619feb3-de61-4019-85e4-8078300f13da None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:27.282788 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619feb3-de61-4019-85e4-8078300f13da None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:27.283161 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619feb3-de61-4019-85e4-8078300f13da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:27.352891 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1619feb3-de61-4019-85e4-8078300f13da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:27.354514 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1619feb3-de61-4019-85e4-8078300f13da None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:27.466777 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 608/1241] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:54:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 02:54:27.473153 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a15f0-69a7-4c5a-9390-aa50d21d6d72 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:27.578146 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a15f0-69a7-4c5a-9390-aa50d21d6d72 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:27.611679 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cee9d4-4cdc-4bbc-90e6-420060216dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:27.612527 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cee9d4-4cdc-4bbc-90e6-420060216dd8 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:27.612871 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cee9d4-4cdc-4bbc-90e6-420060216dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:27.613140 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cee9d4-4cdc-4bbc-90e6-420060216dd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:27.623127 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cee9d4-4cdc-4bbc-90e6-420060216dd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:27.624610 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cee9d4-4cdc-4bbc-90e6-420060216dd8 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:27.644157 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-c1cee9d4-4cdc-4bbc-90e6-420060216dd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:54:27.645851 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 634/1242] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:54:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:54:27.654120 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619feb3-de61-4019-85e4-8078300f13da None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:27.754789 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619feb3-de61-4019-85e4-8078300f13da None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:27.790334 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed67a59-8b1b-4f48-8222-ec029c2c38aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:27.790998 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed67a59-8b1b-4f48-8222-ec029c2c38aa None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:27.791321 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed67a59-8b1b-4f48-8222-ec029c2c38aa None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:27.791587 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed67a59-8b1b-4f48-8222-ec029c2c38aa None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:27.792328 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed67a59-8b1b-4f48-8222-ec029c2c38aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:27.792627 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed67a59-8b1b-4f48-8222-ec029c2c38aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:27.794008 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed67a59-8b1b-4f48-8222-ec029c2c38aa None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:27.805643 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 609/1243] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:54:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:27.811858 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cee9d4-4cdc-4bbc-90e6-420060216dd8 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:27.923184 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cee9d4-4cdc-4bbc-90e6-420060216dd8 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:27.958570 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8a722-9b90-413f-922f-3c9b8a24cbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:27.959451 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8a722-9b90-413f-922f-3c9b8a24cbd4 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:27.959785 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8a722-9b90-413f-922f-3c9b8a24cbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:27.960161 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8a722-9b90-413f-922f-3c9b8a24cbd4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:27.967114 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8a722-9b90-413f-922f-3c9b8a24cbd4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:27.968773 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8a722-9b90-413f-922f-3c9b8a24cbd4 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:27.983395 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-bdf8a722-9b90-413f-922f-3c9b8a24cbd4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:54:27.984706 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 635/1244] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:54:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:54:27.991804 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed67a59-8b1b-4f48-8222-ec029c2c38aa None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:28.098444 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed67a59-8b1b-4f48-8222-ec029c2c38aa None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:28.137473 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164a022-4243-4319-8a1a-4ebda307a8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:28.138215 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164a022-4243-4319-8a1a-4ebda307a8b8 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:28.138452 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164a022-4243-4319-8a1a-4ebda307a8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:28.138718 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164a022-4243-4319-8a1a-4ebda307a8b8 None admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:28.139593 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164a022-4243-4319-8a1a-4ebda307a8b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:28.140111 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164a022-4243-4319-8a1a-4ebda307a8b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:28.141589 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164a022-4243-4319-8a1a-4ebda307a8b8 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:28.156565 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 610/1245] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 02:54:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:28.164004 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8a722-9b90-413f-922f-3c9b8a24cbd4 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:28.272814 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8a722-9b90-413f-922f-3c9b8a24cbd4 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:28.310333 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a760b2-a5f8-46d3-ade3-d7450e26223d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:28.311345 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a760b2-a5f8-46d3-ade3-d7450e26223d None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:28.311627 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a760b2-a5f8-46d3-ade3-d7450e26223d None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:28.311973 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a760b2-a5f8-46d3-ade3-d7450e26223d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:28.312980 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a760b2-a5f8-46d3-ade3-d7450e26223d None admin] RBAC: Adding query filter params (role.id=a8b79923b07243e385187b6641381ee1, scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed, user.id=c2a88ae51543497382d34573afc2bde3) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:28.313479 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a760b2-a5f8-46d3-ade3-d7450e26223d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:28.315453 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a760b2-a5f8-46d3-ade3-d7450e26223d None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:28.324000 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 636/1246] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:54:28 2022] GET /identity/v3/role_assignments?user.id=c2a88ae51543497382d34573afc2bde3&scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed&role.id=a8b79923b07243e385187b6641381ee1 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:30.801443 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225c6ac-ef21-4470-8c05-d6293a6c895a None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:30.802062 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225c6ac-ef21-4470-8c05-d6293a6c895a None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:30.802062 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225c6ac-ef21-4470-8c05-d6293a6c895a None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:30.803619 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 611/1247] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:54:30.809119 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd510a09-7400-4be2-b3c4-e4be51b1f8f4 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:30.809556 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd510a09-7400-4be2-b3c4-e4be51b1f8f4 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:30.809674 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd510a09-7400-4be2-b3c4-e4be51b1f8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:30.829219 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-cd510a09-7400-4be2-b3c4-e4be51b1f8f4 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:54:30.830423 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-cd510a09-7400-4be2-b3c4-e4be51b1f8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:54:30.910329 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 637/1248] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:54:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:54:30.936728 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225c6ac-ef21-4470-8c05-d6293a6c895a None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:31.057258 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225c6ac-ef21-4470-8c05-d6293a6c895a None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:31.104470 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d99d3e-cd45-4561-ac68-7c78990fad4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:31.105890 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d99d3e-cd45-4561-ac68-7c78990fad4e None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:31.106211 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d99d3e-cd45-4561-ac68-7c78990fad4e None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:31.106867 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d99d3e-cd45-4561-ac68-7c78990fad4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:31.123734 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d99d3e-cd45-4561-ac68-7c78990fad4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:54:31.133374 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-a4d99d3e-cd45-4561-ac68-7c78990fad4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 02:54:31.134946 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 612/1249] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 02:54:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:54:31.141610 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd510a09-7400-4be2-b3c4-e4be51b1f8f4 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:31.256300 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd510a09-7400-4be2-b3c4-e4be51b1f8f4 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:31.293799 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd81178-1227-4cc6-b61e-6ec1f81fb659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:31.294468 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd81178-1227-4cc6-b61e-6ec1f81fb659 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:31.294741 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd81178-1227-4cc6-b61e-6ec1f81fb659 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:31.295004 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd81178-1227-4cc6-b61e-6ec1f81fb659 None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:31.295771 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd81178-1227-4cc6-b61e-6ec1f81fb659 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:31.296065 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd81178-1227-4cc6-b61e-6ec1f81fb659 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:31.297503 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd81178-1227-4cc6-b61e-6ec1f81fb659 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:31.306398 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 638/1250] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:54:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:31.312523 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d99d3e-cd45-4561-ac68-7c78990fad4e None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:31.417878 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d99d3e-cd45-4561-ac68-7c78990fad4e None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:31.457384 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9610f6f-c53b-47f2-821d-92be2d185aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:31.458382 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9610f6f-c53b-47f2-821d-92be2d185aca None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:31.458714 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9610f6f-c53b-47f2-821d-92be2d185aca None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:31.459038 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9610f6f-c53b-47f2-821d-92be2d185aca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:31.471212 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9610f6f-c53b-47f2-821d-92be2d185aca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:31.472711 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9610f6f-c53b-47f2-821d-92be2d185aca None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:31.492487 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-a9610f6f-c53b-47f2-821d-92be2d185aca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:54:31.494055 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 613/1251] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:54:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:54:31.500639 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd81178-1227-4cc6-b61e-6ec1f81fb659 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:31.609484 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd81178-1227-4cc6-b61e-6ec1f81fb659 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:31.645213 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a13fd-cd82-4e06-96c1-fbcf99a63a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:31.646184 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a13fd-cd82-4e06-96c1-fbcf99a63a61 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:31.646184 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a13fd-cd82-4e06-96c1-fbcf99a63a61 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:31.646476 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a13fd-cd82-4e06-96c1-fbcf99a63a61 None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:31.647164 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a13fd-cd82-4e06-96c1-fbcf99a63a61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:31.647488 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a13fd-cd82-4e06-96c1-fbcf99a63a61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:31.649342 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a13fd-cd82-4e06-96c1-fbcf99a63a61 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:31.661918 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 639/1252] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:31.668339 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9610f6f-c53b-47f2-821d-92be2d185aca None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:31.778104 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9610f6f-c53b-47f2-821d-92be2d185aca None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:31.815546 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d33f0-2da7-4e4a-abcb-6d68e993b3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:31.816416 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d33f0-2da7-4e4a-abcb-6d68e993b3fb None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:31.816651 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d33f0-2da7-4e4a-abcb-6d68e993b3fb None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:31.816960 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d33f0-2da7-4e4a-abcb-6d68e993b3fb None admin] PATH_INFO: `/v3/users/placement` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:31.824626 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d33f0-2da7-4e4a-abcb-6d68e993b3fb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:31.826071 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d33f0-2da7-4e4a-abcb-6d68e993b3fb None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:31.840282 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-cf4d33f0-2da7-4e4a-abcb-6d68e993b3fb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 12 02:54:31.841599 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 614/1253] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:54:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:54:31.847927 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a13fd-cd82-4e06-96c1-fbcf99a63a61 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:31.952806 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a13fd-cd82-4e06-96c1-fbcf99a63a61 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:31.991592 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e68d0c-4fd7-4055-8b9c-0a27a361539d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:31.992407 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e68d0c-4fd7-4055-8b9c-0a27a361539d None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:31.992685 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e68d0c-4fd7-4055-8b9c-0a27a361539d None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:31.992957 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e68d0c-4fd7-4055-8b9c-0a27a361539d None admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:31.993810 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e68d0c-4fd7-4055-8b9c-0a27a361539d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:31.994110 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e68d0c-4fd7-4055-8b9c-0a27a361539d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:31.995567 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e68d0c-4fd7-4055-8b9c-0a27a361539d None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:32.016047 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 640/1254] 10.222.0.32 () {56 vars in 1143 bytes} [Tue Apr 12 02:54:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:32.022075 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d33f0-2da7-4e4a-abcb-6d68e993b3fb None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:32.133141 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d33f0-2da7-4e4a-abcb-6d68e993b3fb None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:32.174383 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf28f09-fb1c-4228-902d-189c60a9cf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:32.175221 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf28f09-fb1c-4228-902d-189c60a9cf27 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:32.175545 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf28f09-fb1c-4228-902d-189c60a9cf27 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:32.175861 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf28f09-fb1c-4228-902d-189c60a9cf27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:32.250875 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf28f09-fb1c-4228-902d-189c60a9cf27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:32.252307 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf28f09-fb1c-4228-902d-189c60a9cf27 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:32.354603 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 615/1255] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:54:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 02:54:32.360499 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e68d0c-4fd7-4055-8b9c-0a27a361539d None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:32.461422 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e68d0c-4fd7-4055-8b9c-0a27a361539d None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:32.496825 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a5175-d8d7-4abc-99ad-423f422bd0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:32.497630 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a5175-d8d7-4abc-99ad-423f422bd0c3 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:32.497904 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a5175-d8d7-4abc-99ad-423f422bd0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:32.498160 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a5175-d8d7-4abc-99ad-423f422bd0c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:32.509638 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a5175-d8d7-4abc-99ad-423f422bd0c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:32.511004 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a5175-d8d7-4abc-99ad-423f422bd0c3 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:32.528617 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-095a5175-d8d7-4abc-99ad-423f422bd0c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:54:32.529853 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 641/1256] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:54:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:54:32.535976 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf28f09-fb1c-4228-902d-189c60a9cf27 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:32.635667 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf28f09-fb1c-4228-902d-189c60a9cf27 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:32.669198 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6df4c-9aa4-420c-8dbd-cbc7e421a8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:32.669839 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6df4c-9aa4-420c-8dbd-cbc7e421a8ca None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:32.670107 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6df4c-9aa4-420c-8dbd-cbc7e421a8ca None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:32.670365 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6df4c-9aa4-420c-8dbd-cbc7e421a8ca None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:32.671062 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6df4c-9aa4-420c-8dbd-cbc7e421a8ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:32.671350 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6df4c-9aa4-420c-8dbd-cbc7e421a8ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:32.672748 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6df4c-9aa4-420c-8dbd-cbc7e421a8ca None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:32.683592 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 616/1257] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:54:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:32.689836 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a5175-d8d7-4abc-99ad-423f422bd0c3 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:32.797254 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a5175-d8d7-4abc-99ad-423f422bd0c3 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:32.831118 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d563d-89ce-46a3-91cb-01cd15de2dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:32.831905 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d563d-89ce-46a3-91cb-01cd15de2dab None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:32.832175 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d563d-89ce-46a3-91cb-01cd15de2dab None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:32.832436 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d563d-89ce-46a3-91cb-01cd15de2dab None admin] PATH_INFO: `/v3/projects/service` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:32.839337 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d563d-89ce-46a3-91cb-01cd15de2dab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:32.840779 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d563d-89ce-46a3-91cb-01cd15de2dab None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:32.853750 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-9a0d563d-89ce-46a3-91cb-01cd15de2dab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:54:32.854888 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 642/1258] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:54:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:54:32.864075 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6df4c-9aa4-420c-8dbd-cbc7e421a8ca None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:32.969799 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6df4c-9aa4-420c-8dbd-cbc7e421a8ca None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:33.012663 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5198f3a-fcc2-4b83-87d4-47115f7bd0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:33.013578 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5198f3a-fcc2-4b83-87d4-47115f7bd0d7 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:33.013921 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5198f3a-fcc2-4b83-87d4-47115f7bd0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:33.014250 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5198f3a-fcc2-4b83-87d4-47115f7bd0d7 None admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:33.015397 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5198f3a-fcc2-4b83-87d4-47115f7bd0d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:33.015877 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5198f3a-fcc2-4b83-87d4-47115f7bd0d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:33.018093 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5198f3a-fcc2-4b83-87d4-47115f7bd0d7 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:33.031766 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 617/1259] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 02:54:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:33.037995 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d563d-89ce-46a3-91cb-01cd15de2dab None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:33.157843 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d563d-89ce-46a3-91cb-01cd15de2dab None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:33.193658 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b8bdc-a586-4c00-90ee-0007eceb1a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:33.194358 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b8bdc-a586-4c00-90ee-0007eceb1a0c None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:33.194634 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b8bdc-a586-4c00-90ee-0007eceb1a0c None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:33.194897 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b8bdc-a586-4c00-90ee-0007eceb1a0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:33.195703 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b8bdc-a586-4c00-90ee-0007eceb1a0c None admin] RBAC: Adding query filter params (role.id=c0f19d3800f44637822d5162ffe4b497, scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed, user.id=c2a88ae51543497382d34573afc2bde3) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:33.196040 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b8bdc-a586-4c00-90ee-0007eceb1a0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:33.197457 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b8bdc-a586-4c00-90ee-0007eceb1a0c None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:33.203503 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 643/1260] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:54:33 2022] GET /identity/v3/role_assignments?user.id=c2a88ae51543497382d34573afc2bde3&scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed&role.id=c0f19d3800f44637822d5162ffe4b497 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:35.440026 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9899be2-d472-4811-950d-3489aaeaaf61 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:35.440944 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9899be2-d472-4811-950d-3489aaeaaf61 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:35.440944 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9899be2-d472-4811-950d-3489aaeaaf61 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:35.443052 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 618/1261] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:54:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:54:35.448521 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b51a8a-70f9-406b-87f3-ed2b884c3f13 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:35.448934 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b51a8a-70f9-406b-87f3-ed2b884c3f13 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:35.449040 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b51a8a-70f9-406b-87f3-ed2b884c3f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:35.467437 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-a1b51a8a-70f9-406b-87f3-ed2b884c3f13 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:54:35.468605 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-a1b51a8a-70f9-406b-87f3-ed2b884c3f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:54:35.534453 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 644/1262] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:54:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:54:35.556755 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9899be2-d472-4811-950d-3489aaeaaf61 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:35.666609 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9899be2-d472-4811-950d-3489aaeaaf61 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:35.699978 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860312f-b361-45ba-b2da-4565738878d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:35.700692 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860312f-b361-45ba-b2da-4565738878d8 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:35.700963 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860312f-b361-45ba-b2da-4565738878d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:35.701226 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860312f-b361-45ba-b2da-4565738878d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:35.711624 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860312f-b361-45ba-b2da-4565738878d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:54:35.718409 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-0860312f-b361-45ba-b2da-4565738878d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 02:54:35.719574 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 619/1263] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 02:54:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:54:35.728029 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b51a8a-70f9-406b-87f3-ed2b884c3f13 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:35.824114 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b51a8a-70f9-406b-87f3-ed2b884c3f13 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:35.858674 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7746a-38be-4116-a168-64507abad05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:35.859324 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7746a-38be-4116-a168-64507abad05d None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:35.859591 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7746a-38be-4116-a168-64507abad05d None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:35.859878 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7746a-38be-4116-a168-64507abad05d None admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:35.860612 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf7746a-38be-4116-a168-64507abad05d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:35.860908 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf7746a-38be-4116-a168-64507abad05d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:35.862250 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf7746a-38be-4116-a168-64507abad05d None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:35.870434 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 645/1264] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:54:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:35.876651 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860312f-b361-45ba-b2da-4565738878d8 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:35.981541 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860312f-b361-45ba-b2da-4565738878d8 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:36.020536 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906b048-81e1-49c3-8746-c04d167e43f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:36.021310 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906b048-81e1-49c3-8746-c04d167e43f4 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:36.021581 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906b048-81e1-49c3-8746-c04d167e43f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:36.021874 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906b048-81e1-49c3-8746-c04d167e43f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:36.032955 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906b048-81e1-49c3-8746-c04d167e43f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:36.034404 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906b048-81e1-49c3-8746-c04d167e43f4 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:36.051031 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-6906b048-81e1-49c3-8746-c04d167e43f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:54:36.052224 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 620/1265] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:54:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:54:36.058923 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7746a-38be-4116-a168-64507abad05d None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:36.179344 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7746a-38be-4116-a168-64507abad05d None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:36.218965 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d0a87-b453-4ec0-8224-a790a010944c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:36.219631 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d0a87-b453-4ec0-8224-a790a010944c None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:36.219971 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d0a87-b453-4ec0-8224-a790a010944c None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:36.220237 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d0a87-b453-4ec0-8224-a790a010944c None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:36.220950 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d0a87-b453-4ec0-8224-a790a010944c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:36.221246 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d0a87-b453-4ec0-8224-a790a010944c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:36.222625 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d0a87-b453-4ec0-8224-a790a010944c None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:36.234228 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 646/1266] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:36.243273 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906b048-81e1-49c3-8746-c04d167e43f4 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:36.365431 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906b048-81e1-49c3-8746-c04d167e43f4 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:36.405317 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f09b13-31d3-4e49-8575-ec747b6fdff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:36.406104 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f09b13-31d3-4e49-8575-ec747b6fdff4 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:36.406383 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f09b13-31d3-4e49-8575-ec747b6fdff4 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:36.406650 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f09b13-31d3-4e49-8575-ec747b6fdff4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:36.413941 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f09b13-31d3-4e49-8575-ec747b6fdff4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:36.415382 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f09b13-31d3-4e49-8575-ec747b6fdff4 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:36.428960 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-95f09b13-31d3-4e49-8575-ec747b6fdff4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 12 02:54:36.430148 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 621/1267] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:54:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:54:36.436643 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d0a87-b453-4ec0-8224-a790a010944c None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:36.542889 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d0a87-b453-4ec0-8224-a790a010944c None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:36.576461 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25848c-6c15-4400-acba-8a2d5a2f6975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:36.577113 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25848c-6c15-4400-acba-8a2d5a2f6975 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:36.577380 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25848c-6c15-4400-acba-8a2d5a2f6975 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:36.577641 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25848c-6c15-4400-acba-8a2d5a2f6975 None admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:36.578792 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25848c-6c15-4400-acba-8a2d5a2f6975 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:36.579095 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25848c-6c15-4400-acba-8a2d5a2f6975 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:36.580532 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25848c-6c15-4400-acba-8a2d5a2f6975 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:36.597240 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 647/1268] 10.222.0.32 () {56 vars in 1143 bytes} [Tue Apr 12 02:54:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:36.605629 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f09b13-31d3-4e49-8575-ec747b6fdff4 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:36.714248 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f09b13-31d3-4e49-8575-ec747b6fdff4 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:36.748223 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c110ceb-4e7b-4d83-b752-fc59d43e2c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:36.749001 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c110ceb-4e7b-4d83-b752-fc59d43e2c04 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:36.749272 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c110ceb-4e7b-4d83-b752-fc59d43e2c04 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:36.749540 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c110ceb-4e7b-4d83-b752-fc59d43e2c04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:36.760988 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c110ceb-4e7b-4d83-b752-fc59d43e2c04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:36.762432 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c110ceb-4e7b-4d83-b752-fc59d43e2c04 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:36.779096 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-6c110ceb-4e7b-4d83-b752-fc59d43e2c04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:54:36.780277 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 622/1269] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:54:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:54:36.787018 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25848c-6c15-4400-acba-8a2d5a2f6975 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:36.898627 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25848c-6c15-4400-acba-8a2d5a2f6975 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:36.933660 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b47fb3-8c23-45fa-95b6-ca31e2766090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:36.934313 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b47fb3-8c23-45fa-95b6-ca31e2766090 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:36.934588 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b47fb3-8c23-45fa-95b6-ca31e2766090 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:36.934853 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b47fb3-8c23-45fa-95b6-ca31e2766090 None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:36.935570 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b47fb3-8c23-45fa-95b6-ca31e2766090 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:36.935907 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b47fb3-8c23-45fa-95b6-ca31e2766090 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:36.937263 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b47fb3-8c23-45fa-95b6-ca31e2766090 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:36.949559 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 648/1270] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:36.958173 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c110ceb-4e7b-4d83-b752-fc59d43e2c04 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:37.063280 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c110ceb-4e7b-4d83-b752-fc59d43e2c04 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:37.102365 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d101d85-303f-4607-bff3-9e6907cfc8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:37.103155 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d101d85-303f-4607-bff3-9e6907cfc8f6 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:37.103429 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d101d85-303f-4607-bff3-9e6907cfc8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:37.103698 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d101d85-303f-4607-bff3-9e6907cfc8f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:37.110836 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d101d85-303f-4607-bff3-9e6907cfc8f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:37.112509 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d101d85-303f-4607-bff3-9e6907cfc8f6 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:37.127946 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-7d101d85-303f-4607-bff3-9e6907cfc8f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:54:37.129359 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 623/1271] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:54:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:54:37.136588 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b47fb3-8c23-45fa-95b6-ca31e2766090 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:37.252115 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b47fb3-8c23-45fa-95b6-ca31e2766090 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:37.289399 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65972d-eeb7-473d-b63d-d781b63182ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:37.290061 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65972d-eeb7-473d-b63d-d781b63182ef None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:37.290483 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65972d-eeb7-473d-b63d-d781b63182ef None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:37.290980 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65972d-eeb7-473d-b63d-d781b63182ef None admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:37.292030 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65972d-eeb7-473d-b63d-d781b63182ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:37.292398 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65972d-eeb7-473d-b63d-d781b63182ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:37.294926 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65972d-eeb7-473d-b63d-d781b63182ef None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:37.310157 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 649/1272] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 02:54:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 02:54:37.316471 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d101d85-303f-4607-bff3-9e6907cfc8f6 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:37.427972 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d101d85-303f-4607-bff3-9e6907cfc8f6 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:37.466967 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0da7b-cf82-46fb-9c7b-cd3e7cff1bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:37.467934 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0da7b-cf82-46fb-9c7b-cd3e7cff1bbe None admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:37.468207 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0da7b-cf82-46fb-9c7b-cd3e7cff1bbe None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:37.468476 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0da7b-cf82-46fb-9c7b-cd3e7cff1bbe None admin] PATH_INFO: `/v3/projects/82cb5f6cfa0e46b28a37565fc2b560ed/users/c2a88ae51543497382d34573afc2bde3/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:37.470865 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0da7b-cf82-46fb-9c7b-cd3e7cff1bbe None admin] RBAC: Authorizing `identity:create_grant(project_id=82cb5f6cfa0e46b28a37565fc2b560ed, user_id=c2a88ae51543497382d34573afc2bde3, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:37.472694 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0da7b-cf82-46fb-9c7b-cd3e7cff1bbe None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:37.489301 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 624/1273] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 02:54:37 2022] PUT /identity/v3/projects/82cb5f6cfa0e46b28a37565fc2b560ed/users/c2a88ae51543497382d34573afc2bde3/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 02:54:39.798725 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f9c3b-2bbe-4c3a-8eb7-ed445bf090c5 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:39.799549 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f9c3b-2bbe-4c3a-8eb7-ed445bf090c5 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:39.799549 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f9c3b-2bbe-4c3a-8eb7-ed445bf090c5 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:39.801728 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 650/1274] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:54:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:54:39.809633 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef99d78-9082-4717-a978-89c8305b767c None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:39.810093 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef99d78-9082-4717-a978-89c8305b767c None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:39.810186 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef99d78-9082-4717-a978-89c8305b767c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:39.826863 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-3ef99d78-9082-4717-a978-89c8305b767c None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:54:39.828351 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-3ef99d78-9082-4717-a978-89c8305b767c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:54:39.894065 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 625/1275] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:54:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 02:54:39.918997 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f9c3b-2bbe-4c3a-8eb7-ed445bf090c5 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:40.027210 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f9c3b-2bbe-4c3a-8eb7-ed445bf090c5 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:40.063565 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00723966-319f-4069-a9aa-5e0c1ecf68ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:40.064363 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00723966-319f-4069-a9aa-5e0c1ecf68ee None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:40.064634 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00723966-319f-4069-a9aa-5e0c1ecf68ee None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:40.064898 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00723966-319f-4069-a9aa-5e0c1ecf68ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:40.074933 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00723966-319f-4069-a9aa-5e0c1ecf68ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 02:54:40.082063 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-00723966-319f-4069-a9aa-5e0c1ecf68ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 02:54:40.083232 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 651/1276] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 02:54:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:54:40.089853 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef99d78-9082-4717-a978-89c8305b767c None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:40.207558 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef99d78-9082-4717-a978-89c8305b767c None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:40.241246 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d8275-c629-4f62-ba24-2f9da1419bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:40.242194 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d8275-c629-4f62-ba24-2f9da1419bd0 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:40.242475 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d8275-c629-4f62-ba24-2f9da1419bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:40.242745 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d8275-c629-4f62-ba24-2f9da1419bd0 None admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:40.243478 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d8275-c629-4f62-ba24-2f9da1419bd0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:40.243771 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d8275-c629-4f62-ba24-2f9da1419bd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:40.245179 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d8275-c629-4f62-ba24-2f9da1419bd0 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:40.252896 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 626/1277] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 02:54:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:40.259247 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00723966-319f-4069-a9aa-5e0c1ecf68ee None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:40.360202 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00723966-319f-4069-a9aa-5e0c1ecf68ee None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:40.393197 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99a5db-45ed-4337-a0f5-c8126633ac72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:40.393987 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99a5db-45ed-4337-a0f5-c8126633ac72 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:40.394243 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99a5db-45ed-4337-a0f5-c8126633ac72 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:40.394506 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99a5db-45ed-4337-a0f5-c8126633ac72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:40.404884 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f99a5db-45ed-4337-a0f5-c8126633ac72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:40.406311 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f99a5db-45ed-4337-a0f5-c8126633ac72 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:40.422290 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-5f99a5db-45ed-4337-a0f5-c8126633ac72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:54:40.423458 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 652/1278] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:54:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:54:40.430293 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d8275-c629-4f62-ba24-2f9da1419bd0 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:40.549094 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d8275-c629-4f62-ba24-2f9da1419bd0 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:40.590088 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f8260-2b07-4921-ac34-5bc3b88ae57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:40.590744 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f8260-2b07-4921-ac34-5bc3b88ae57f None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:40.591016 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f8260-2b07-4921-ac34-5bc3b88ae57f None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:40.591283 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f8260-2b07-4921-ac34-5bc3b88ae57f None admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:40.592004 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f8260-2b07-4921-ac34-5bc3b88ae57f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:40.592285 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f8260-2b07-4921-ac34-5bc3b88ae57f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:40.593688 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f8260-2b07-4921-ac34-5bc3b88ae57f None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:40.609374 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 627/1279] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:40.615464 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99a5db-45ed-4337-a0f5-c8126633ac72 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:40.716340 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99a5db-45ed-4337-a0f5-c8126633ac72 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:40.749463 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef99b1-2832-4dfd-9746-c9bd0f1bb57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:40.750237 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef99b1-2832-4dfd-9746-c9bd0f1bb57d None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:40.750510 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef99b1-2832-4dfd-9746-c9bd0f1bb57d None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:40.750770 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef99b1-2832-4dfd-9746-c9bd0f1bb57d None admin] PATH_INFO: `/v3/users/placement` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:40.759021 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef99b1-2832-4dfd-9746-c9bd0f1bb57d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:40.760468 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef99b1-2832-4dfd-9746-c9bd0f1bb57d None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:40.774759 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-a7ef99b1-2832-4dfd-9746-c9bd0f1bb57d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 12 02:54:40.775958 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 653/1280] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:54:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:54:40.782184 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f8260-2b07-4921-ac34-5bc3b88ae57f None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:40.884049 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f8260-2b07-4921-ac34-5bc3b88ae57f None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:40.919987 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03e0ff-d601-485d-964f-57e240541e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:40.920639 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03e0ff-d601-485d-964f-57e240541e43 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:40.920904 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03e0ff-d601-485d-964f-57e240541e43 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:40.921167 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03e0ff-d601-485d-964f-57e240541e43 None admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:40.921976 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03e0ff-d601-485d-964f-57e240541e43 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:40.922266 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03e0ff-d601-485d-964f-57e240541e43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:40.923700 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03e0ff-d601-485d-964f-57e240541e43 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:40.941965 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 628/1281] 10.222.0.32 () {56 vars in 1143 bytes} [Tue Apr 12 02:54:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:40.948874 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef99b1-2832-4dfd-9746-c9bd0f1bb57d None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:41.066526 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef99b1-2832-4dfd-9746-c9bd0f1bb57d None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:41.100234 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72fe8f-35a8-49de-9474-c78e873af518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:41.101134 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72fe8f-35a8-49de-9474-c78e873af518 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:41.101412 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72fe8f-35a8-49de-9474-c78e873af518 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:41.101683 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72fe8f-35a8-49de-9474-c78e873af518 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:41.170104 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72fe8f-35a8-49de-9474-c78e873af518 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:41.171467 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72fe8f-35a8-49de-9474-c78e873af518 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:41.269839 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 654/1282] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 02:54:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 02:54:41.275815 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03e0ff-d601-485d-964f-57e240541e43 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:41.372595 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03e0ff-d601-485d-964f-57e240541e43 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:41.406353 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308d072-a288-4eef-ad0e-3d107b1e6aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:41.407118 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308d072-a288-4eef-ad0e-3d107b1e6aac None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:41.407385 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308d072-a288-4eef-ad0e-3d107b1e6aac None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:41.407643 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308d072-a288-4eef-ad0e-3d107b1e6aac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:41.417709 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308d072-a288-4eef-ad0e-3d107b1e6aac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:41.419151 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308d072-a288-4eef-ad0e-3d107b1e6aac None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:41.435691 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-1308d072-a288-4eef-ad0e-3d107b1e6aac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 02:54:41.436811 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 629/1283] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:54:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 02:54:41.443381 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72fe8f-35a8-49de-9474-c78e873af518 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:41.562484 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72fe8f-35a8-49de-9474-c78e873af518 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:41.596968 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d6a60-1bfb-41cc-a3aa-ba9a9c0d6f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:41.597622 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d6a60-1bfb-41cc-a3aa-ba9a9c0d6f65 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:41.597893 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d6a60-1bfb-41cc-a3aa-ba9a9c0d6f65 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:41.598160 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d6a60-1bfb-41cc-a3aa-ba9a9c0d6f65 None admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:41.598873 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d6a60-1bfb-41cc-a3aa-ba9a9c0d6f65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:41.599169 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d6a60-1bfb-41cc-a3aa-ba9a9c0d6f65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:41.600764 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d6a60-1bfb-41cc-a3aa-ba9a9c0d6f65 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:41.611919 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 655/1284] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 02:54:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:41.617773 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308d072-a288-4eef-ad0e-3d107b1e6aac None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:41.721423 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308d072-a288-4eef-ad0e-3d107b1e6aac None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:41.758125 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8583aea-841e-43ff-8f95-6b94c1a65f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:41.758906 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8583aea-841e-43ff-8f95-6b94c1a65f70 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:41.759178 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8583aea-841e-43ff-8f95-6b94c1a65f70 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:41.759437 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8583aea-841e-43ff-8f95-6b94c1a65f70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:41.766685 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8583aea-841e-43ff-8f95-6b94c1a65f70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:41.768156 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8583aea-841e-43ff-8f95-6b94c1a65f70 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:41.781488 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING keystone.server.flask.application [None req-d8583aea-841e-43ff-8f95-6b94c1a65f70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 02:54:41.782626 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 630/1285] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 02:54:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:54:41.789750 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d6a60-1bfb-41cc-a3aa-ba9a9c0d6f65 None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:41.893791 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d6a60-1bfb-41cc-a3aa-ba9a9c0d6f65 None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:41.926950 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b2900-fe54-4f8f-a955-bead7287ce56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:41.927582 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b2900-fe54-4f8f-a955-bead7287ce56 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:41.927896 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b2900-fe54-4f8f-a955-bead7287ce56 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:41.928210 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b2900-fe54-4f8f-a955-bead7287ce56 None admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:41.929024 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b2900-fe54-4f8f-a955-bead7287ce56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:41.929321 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b2900-fe54-4f8f-a955-bead7287ce56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:41.930720 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b2900-fe54-4f8f-a955-bead7287ce56 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:41.942174 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 656/1286] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 02:54:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:41.949142 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8583aea-841e-43ff-8f95-6b94c1a65f70 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:42.046762 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8583aea-841e-43ff-8f95-6b94c1a65f70 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:42.079920 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b5aa0-b034-43c4-80df-ba9502b8a0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:42.080539 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b5aa0-b034-43c4-80df-ba9502b8a0ad None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:42.080806 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b5aa0-b034-43c4-80df-ba9502b8a0ad None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:42.081068 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b5aa0-b034-43c4-80df-ba9502b8a0ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:42.081879 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b5aa0-b034-43c4-80df-ba9502b8a0ad None admin] RBAC: Adding query filter params (role.id=c0f19d3800f44637822d5162ffe4b497, scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed, user.id=c2a88ae51543497382d34573afc2bde3) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:42.082182 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b5aa0-b034-43c4-80df-ba9502b8a0ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:42.083593 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b5aa0-b034-43c4-80df-ba9502b8a0ad None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:42.089399 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 631/1287] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 02:54:41 2022] GET /identity/v3/role_assignments?user.id=c2a88ae51543497382d34573afc2bde3&scope.project.id=82cb5f6cfa0e46b28a37565fc2b560ed&role.id=c0f19d3800f44637822d5162ffe4b497 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:44.406852 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870d0aa-4509-4e05-b795-129d7c76f925 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:44.407715 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870d0aa-4509-4e05-b795-129d7c76f925 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:44.407715 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870d0aa-4509-4e05-b795-129d7c76f925 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:44.409816 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 657/1288] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:54:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:54:44.416004 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb39796-e37c-4706-8067-2a77a20ea83b None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:44.416514 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb39796-e37c-4706-8067-2a77a20ea83b None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:44.416608 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb39796-e37c-4706-8067-2a77a20ea83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:44.443100 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-5cb39796-e37c-4706-8067-2a77a20ea83b None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:54:44.444614 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-5cb39796-e37c-4706-8067-2a77a20ea83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:54:44.510892 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 632/1289] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:54:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:54:44.533510 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870d0aa-4509-4e05-b795-129d7c76f925 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:44.640101 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870d0aa-4509-4e05-b795-129d7c76f925 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:44.674461 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d7943-0f47-40a8-98f7-31959fef91df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:44.675163 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d7943-0f47-40a8-98f7-31959fef91df None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:44.675434 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d7943-0f47-40a8-98f7-31959fef91df None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:44.675688 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d7943-0f47-40a8-98f7-31959fef91df None admin] PATH_INFO: `/v3/services/placement` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:44.676358 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d7943-0f47-40a8-98f7-31959fef91df None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:44.677701 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d7943-0f47-40a8-98f7-31959fef91df None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:44.688324 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-754d7943-0f47-40a8-98f7-31959fef91df None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 12 02:54:44.689472 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 658/1290] 10.222.0.32 () {56 vars in 1117 bytes} [Tue Apr 12 02:54:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:54:44.698569 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb39796-e37c-4706-8067-2a77a20ea83b None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:44.809715 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb39796-e37c-4706-8067-2a77a20ea83b None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:44.843486 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710248a-8de3-4b5a-8c00-31c9ddcdf2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:44.844167 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710248a-8de3-4b5a-8c00-31c9ddcdf2ac None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:44.844440 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710248a-8de3-4b5a-8c00-31c9ddcdf2ac None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:44.844701 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710248a-8de3-4b5a-8c00-31c9ddcdf2ac None admin] PATH_INFO: `/v3/services` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:44.845387 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5710248a-8de3-4b5a-8c00-31c9ddcdf2ac None admin] RBAC: Adding query filter params (name=placement) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:44.845684 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5710248a-8de3-4b5a-8c00-31c9ddcdf2ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:44.847044 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5710248a-8de3-4b5a-8c00-31c9ddcdf2ac None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:44.852013 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 633/1291] 10.222.0.32 () {56 vars in 1116 bytes} [Tue Apr 12 02:54:44 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:44.858768 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d7943-0f47-40a8-98f7-31959fef91df None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:44.965349 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d7943-0f47-40a8-98f7-31959fef91df None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:44.999077 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f746129-186f-434e-8cc9-68e3d9dbf4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:44.999754 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f746129-186f-434e-8cc9-68e3d9dbf4e3 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:45.000054 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f746129-186f-434e-8cc9-68e3d9dbf4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:45.000321 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f746129-186f-434e-8cc9-68e3d9dbf4e3 None admin] PATH_INFO: `/v3/services` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:45.001016 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f746129-186f-434e-8cc9-68e3d9dbf4e3 None admin] RBAC: Adding query filter params (type=placement) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:45.001314 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f746129-186f-434e-8cc9-68e3d9dbf4e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:45.002672 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f746129-186f-434e-8cc9-68e3d9dbf4e3 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:45.007331 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 659/1292] 10.222.0.32 () {56 vars in 1116 bytes} [Tue Apr 12 02:54:44 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:47.263820 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd74ff-c87a-42b0-8479-8a8ece199f6f None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:47.264404 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd74ff-c87a-42b0-8479-8a8ece199f6f None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:47.264404 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd74ff-c87a-42b0-8479-8a8ece199f6f None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:47.265702 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 634/1293] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:54:47.272054 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfdc4b-04d2-497d-bb28-9416c6f2c1b3 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:47.272697 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfdc4b-04d2-497d-bb28-9416c6f2c1b3 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:47.272847 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfdc4b-04d2-497d-bb28-9416c6f2c1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:47.300365 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-c6bfdc4b-04d2-497d-bb28-9416c6f2c1b3 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:54:47.302305 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-c6bfdc4b-04d2-497d-bb28-9416c6f2c1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:54:47.369766 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 660/1294] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:54:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:54:47.397975 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd74ff-c87a-42b0-8479-8a8ece199f6f None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:47.511268 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd74ff-c87a-42b0-8479-8a8ece199f6f None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:47.548370 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b7af4-f600-4831-80e5-7a17cdfc956e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:47.548950 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b7af4-f600-4831-80e5-7a17cdfc956e None admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:47.549227 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b7af4-f600-4831-80e5-7a17cdfc956e None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:47.549492 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b7af4-f600-4831-80e5-7a17cdfc956e None admin] PATH_INFO: `/v3/services` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:47.550199 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b7af4-f600-4831-80e5-7a17cdfc956e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:47.551582 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b7af4-f600-4831-80e5-7a17cdfc956e None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:47.566460 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 635/1295] 10.222.0.32 () {60 vars in 1141 bytes} [Tue Apr 12 02:54:47 2022] POST /identity/v3/services => generated 246 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 02:54:49.847423 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdd67f-9ba2-4bc6-b3a4-4cc6071eb138 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:49.848064 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdd67f-9ba2-4bc6-b3a4-4cc6071eb138 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:49.848064 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdd67f-9ba2-4bc6-b3a4-4cc6071eb138 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:49.849378 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 661/1296] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:54:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:54:49.855707 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70ea2e-c232-4d38-8a68-0769ccdd6b44 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:49.856168 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70ea2e-c232-4d38-8a68-0769ccdd6b44 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:49.856266 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70ea2e-c232-4d38-8a68-0769ccdd6b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:49.883022 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-ba70ea2e-c232-4d38-8a68-0769ccdd6b44 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:54:49.884227 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-ba70ea2e-c232-4d38-8a68-0769ccdd6b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:54:49.957794 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 636/1297] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:54:49 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:54:49.989247 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bdd67f-9ba2-4bc6-b3a4-4cc6071eb138 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:50.098949 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bdd67f-9ba2-4bc6-b3a4-4cc6071eb138 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:50.134201 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94d272-6bea-4e6e-8a83-e7cd0642503e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:50.134910 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94d272-6bea-4e6e-8a83-e7cd0642503e None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:50.135182 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94d272-6bea-4e6e-8a83-e7cd0642503e None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:50.135449 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94d272-6bea-4e6e-8a83-e7cd0642503e None admin] PATH_INFO: `/v3/services/placement` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:50.136125 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94d272-6bea-4e6e-8a83-e7cd0642503e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:50.137486 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94d272-6bea-4e6e-8a83-e7cd0642503e None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:50.149080 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-5e94d272-6bea-4e6e-8a83-e7cd0642503e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 12 02:54:50.150227 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 662/1298] 10.222.0.32 () {56 vars in 1117 bytes} [Tue Apr 12 02:54:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:54:50.160253 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70ea2e-c232-4d38-8a68-0769ccdd6b44 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:50.266223 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70ea2e-c232-4d38-8a68-0769ccdd6b44 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:50.299754 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8fb0c-758b-4de8-9acd-02d163220e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:50.300421 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8fb0c-758b-4de8-9acd-02d163220e83 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:50.300697 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8fb0c-758b-4de8-9acd-02d163220e83 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:50.300964 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8fb0c-758b-4de8-9acd-02d163220e83 None admin] PATH_INFO: `/v3/services` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:50.301656 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8fb0c-758b-4de8-9acd-02d163220e83 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:50.301960 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8fb0c-758b-4de8-9acd-02d163220e83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:50.303561 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8fb0c-758b-4de8-9acd-02d163220e83 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:50.308713 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 637/1299] 10.222.0.32 () {56 vars in 1116 bytes} [Tue Apr 12 02:54:50 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:50.315378 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94d272-6bea-4e6e-8a83-e7cd0642503e None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:50.425333 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94d272-6bea-4e6e-8a83-e7cd0642503e None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:50.467321 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500988b5-5f09-4d06-8149-449b1dc7f113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:50.467980 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500988b5-5f09-4d06-8149-449b1dc7f113 None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:50.468253 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500988b5-5f09-4d06-8149-449b1dc7f113 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:50.468514 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500988b5-5f09-4d06-8149-449b1dc7f113 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:50.469290 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500988b5-5f09-4d06-8149-449b1dc7f113 None admin] RBAC: Adding query filter params (interface=public, service_id=ad346d00351348e3ad86f27d1371b14e, region_id=RegionOne) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:50.469589 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500988b5-5f09-4d06-8149-449b1dc7f113 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:50.470929 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500988b5-5f09-4d06-8149-449b1dc7f113 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:50.476231 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 663/1300] 10.222.0.32 () {56 vars in 1251 bytes} [Tue Apr 12 02:54:50 2022] GET /identity/v3/endpoints?service_id=ad346d00351348e3ad86f27d1371b14e&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:50.485147 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8fb0c-758b-4de8-9acd-02d163220e83 None admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:50.599923 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8fb0c-758b-4de8-9acd-02d163220e83 None admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:50.635036 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a665126-4b93-4128-be3c-6e5a9078ff3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:50.635680 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a665126-4b93-4128-be3c-6e5a9078ff3b None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:50.635985 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a665126-4b93-4128-be3c-6e5a9078ff3b None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:50.636247 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a665126-4b93-4128-be3c-6e5a9078ff3b None admin] PATH_INFO: `/v3/services` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:50.636908 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a665126-4b93-4128-be3c-6e5a9078ff3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:50.638273 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a665126-4b93-4128-be3c-6e5a9078ff3b None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:50.644896 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 638/1301] 10.222.0.32 () {56 vars in 1087 bytes} [Tue Apr 12 02:54:50 2022] GET /identity/v3/services => generated 2191 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 02:54:52.904796 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a33e4-6d28-41fc-b747-b45d161b8f08 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:52.905318 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a33e4-6d28-41fc-b747-b45d161b8f08 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:52.905318 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a33e4-6d28-41fc-b747-b45d161b8f08 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:52.906594 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 664/1302] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:54:52.912967 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3360a-eb0e-4a9e-ba57-eb6b8c2dd365 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:52.913668 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3360a-eb0e-4a9e-ba57-eb6b8c2dd365 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:52.913823 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3360a-eb0e-4a9e-ba57-eb6b8c2dd365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:52.941807 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-79e3360a-eb0e-4a9e-ba57-eb6b8c2dd365 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:54:52.943757 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-79e3360a-eb0e-4a9e-ba57-eb6b8c2dd365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:54:53.010269 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 639/1303] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:54:52 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 02:54:53.038570 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a33e4-6d28-41fc-b747-b45d161b8f08 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:53.139488 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a33e4-6d28-41fc-b747-b45d161b8f08 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:53.172558 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720a01b-4a46-4dc2-a2f9-0cfa212d118f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:53.173270 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720a01b-4a46-4dc2-a2f9-0cfa212d118f None admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:53.173543 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720a01b-4a46-4dc2-a2f9-0cfa212d118f None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:53.173805 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720a01b-4a46-4dc2-a2f9-0cfa212d118f None admin] PATH_INFO: `/v3/services/placement` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:53.174442 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720a01b-4a46-4dc2-a2f9-0cfa212d118f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:53.175777 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720a01b-4a46-4dc2-a2f9-0cfa212d118f None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:53.186644 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING keystone.server.flask.application [None req-9720a01b-4a46-4dc2-a2f9-0cfa212d118f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 12 02:54:53.187769 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 665/1304] 10.222.0.32 () {56 vars in 1117 bytes} [Tue Apr 12 02:54:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 02:54:53.194552 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3360a-eb0e-4a9e-ba57-eb6b8c2dd365 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:53.305822 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3360a-eb0e-4a9e-ba57-eb6b8c2dd365 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:53.342812 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784f5e9-db5a-40ba-b81a-b0917599d6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:53.343457 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784f5e9-db5a-40ba-b81a-b0917599d6f6 None admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:53.343767 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784f5e9-db5a-40ba-b81a-b0917599d6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:53.344021 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784f5e9-db5a-40ba-b81a-b0917599d6f6 None admin] PATH_INFO: `/v3/services` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:53.344713 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784f5e9-db5a-40ba-b81a-b0917599d6f6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 02:54:53.345015 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784f5e9-db5a-40ba-b81a-b0917599d6f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:53.346399 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784f5e9-db5a-40ba-b81a-b0917599d6f6 None admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:53.351402 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 640/1305] 10.222.0.32 () {56 vars in 1116 bytes} [Tue Apr 12 02:54:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 02:54:53.360594 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720a01b-4a46-4dc2-a2f9-0cfa212d118f None admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:54:53.470846 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720a01b-4a46-4dc2-a2f9-0cfa212d118f None admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:54:53.506236 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19cb6b-a7a6-4fb3-8f4e-02c8d52ca591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:54:53.506945 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19cb6b-a7a6-4fb3-8f4e-02c8d52ca591 None admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:54:53.507235 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19cb6b-a7a6-4fb3-8f4e-02c8d52ca591 None admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:54:53.507483 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19cb6b-a7a6-4fb3-8f4e-02c8d52ca591 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:54:53.508233 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19cb6b-a7a6-4fb3-8f4e-02c8d52ca591 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:54:53.509583 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19cb6b-a7a6-4fb3-8f4e-02c8d52ca591 None admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:54:53.534059 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 666/1306] 10.222.0.32 () {60 vars in 1144 bytes} [Tue Apr 12 02:54:53 2022] POST /identity/v3/endpoints => generated 331 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 02:55:57.897433 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1e2f4-76d5-4e88-a12f-c552cd67ac5e None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:55:57.899946 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1e2f4-76d5-4e88-a12f-c552cd67ac5e None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:55:57.901627 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1e2f4-76d5-4e88-a12f-c552cd67ac5e None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:55:57.908256 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 641/1307] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:55:57 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:55:57.912826 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7c822-a28d-485a-bd11-1c9fbb62cdd7 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:55:57.913255 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7c822-a28d-485a-bd11-1c9fbb62cdd7 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:55:57.913517 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7c822-a28d-485a-bd11-1c9fbb62cdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:55:58.052098 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-cfb7c822-a28d-485a-bd11-1c9fbb62cdd7 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:55:58.053245 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-cfb7c822-a28d-485a-bd11-1c9fbb62cdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:55:58.176935 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 667/1308] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:55:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:55:58.229432 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18499645-771c-4416-9e02-112d9c449349 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:55:58.229706 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18499645-771c-4416-9e02-112d9c449349 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:55:58.230137 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18499645-771c-4416-9e02-112d9c449349 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:55:58.231675 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 642/1309] 10.222.0.32 () {54 vars in 964 bytes} [Tue Apr 12 02:55:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:55:58.237825 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083455a-136e-4307-9c79-3f3368296411 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:55:58.240075 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083455a-136e-4307-9c79-3f3368296411 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:55:58.241625 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083455a-136e-4307-9c79-3f3368296411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:55:58.321561 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-5083455a-136e-4307-9c79-3f3368296411 None None] MFA Rules not processed for user `8f516943aec14608b5c9d343418a2677`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:55:58.322832 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-5083455a-136e-4307-9c79-3f3368296411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:55:58.411430 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 668/1310] 10.222.0.32 () {58 vars in 1061 bytes} [Tue Apr 12 02:55:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 02:55:58.422343 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18499645-771c-4416-9e02-112d9c449349 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:55:58.424216 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-18499645-771c-4416-9e02-112d9c449349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:55:58.541566 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18499645-771c-4416-9e02-112d9c449349 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:55:58.620901 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71693a64-fc17-490e-8113-a57c6a87c31c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:55:58.621809 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71693a64-fc17-490e-8113-a57c6a87c31c service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:55:58.622243 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71693a64-fc17-490e-8113-a57c6a87c31c service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:55:58.622653 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71693a64-fc17-490e-8113-a57c6a87c31c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:55:58.625758 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-71693a64-fc17-490e-8113-a57c6a87c31c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:55:58.745857 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71693a64-fc17-490e-8113-a57c6a87c31c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:55:58.747687 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71693a64-fc17-490e-8113-a57c6a87c31c service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:55:58.767916 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 643/1311] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:55:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:56:01.357203 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb793e2-92f1-451c-a274-e5fef8770394 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:01.357755 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb793e2-92f1-451c-a274-e5fef8770394 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:01.357755 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb793e2-92f1-451c-a274-e5fef8770394 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:01.359913 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 669/1312] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:56:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:56:01.364921 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ae9ce-92ae-4c67-a13d-213842ede284 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:01.365361 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ae9ce-92ae-4c67-a13d-213842ede284 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:01.365460 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ae9ce-92ae-4c67-a13d-213842ede284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:01.438337 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-0f0ae9ce-92ae-4c67-a13d-213842ede284 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:56:01.439440 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-0f0ae9ce-92ae-4c67-a13d-213842ede284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:01.537110 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 644/1313] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 02:56:01.575650 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb793e2-92f1-451c-a274-e5fef8770394 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:56:01.577326 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-8eb793e2-92f1-451c-a274-e5fef8770394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:01.692040 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb793e2-92f1-451c-a274-e5fef8770394 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:56:01.765237 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad2016-9958-48ec-8c5d-2a3757604490 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:56:01.765930 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad2016-9958-48ec-8c5d-2a3757604490 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:01.766205 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad2016-9958-48ec-8c5d-2a3757604490 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:01.766465 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad2016-9958-48ec-8c5d-2a3757604490 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:01.768127 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-4cad2016-9958-48ec-8c5d-2a3757604490 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:01.887372 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad2016-9958-48ec-8c5d-2a3757604490 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:56:01.888900 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad2016-9958-48ec-8c5d-2a3757604490 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:56:01.909128 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 670/1314] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:56:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:56:04.540054 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70261e49-8321-4e12-bae5-4a8cdfeed403 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:04.540649 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70261e49-8321-4e12-bae5-4a8cdfeed403 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:04.540649 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70261e49-8321-4e12-bae5-4a8cdfeed403 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:04.542613 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 645/1315] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:56:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:56:04.550471 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d19e98-f55b-4d6f-90d5-5c3c3af5c016 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:04.550977 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d19e98-f55b-4d6f-90d5-5c3c3af5c016 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:04.551379 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d19e98-f55b-4d6f-90d5-5c3c3af5c016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:04.618603 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-c8d19e98-f55b-4d6f-90d5-5c3c3af5c016 None None] MFA Rules not processed for user `7ec35991c252426ba394c75df977df0e`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:56:04.619827 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-c8d19e98-f55b-4d6f-90d5-5c3c3af5c016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:04.722460 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 671/1316] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:56:04 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:56:04.797632 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1a10c-f069-4d3f-a4d9-d6cc30931922 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:04.797829 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1a10c-f069-4d3f-a4d9-d6cc30931922 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:04.798083 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1a10c-f069-4d3f-a4d9-d6cc30931922 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:04.799455 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 646/1317] 10.222.0.32 () {54 vars in 964 bytes} [Tue Apr 12 02:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:56:04.805686 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58e334-791d-416f-89e0-3a0c389453a9 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:04.805962 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58e334-791d-416f-89e0-3a0c389453a9 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:04.806230 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58e334-791d-416f-89e0-3a0c389453a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:04.884655 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-4e58e334-791d-416f-89e0-3a0c389453a9 None None] MFA Rules not processed for user `8f516943aec14608b5c9d343418a2677`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:56:04.885852 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-4e58e334-791d-416f-89e0-3a0c389453a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:04.959386 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 672/1318] 10.222.0.32 () {58 vars in 1061 bytes} [Tue Apr 12 02:56:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:56:04.972921 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1a10c-f069-4d3f-a4d9-d6cc30931922 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:56:04.974573 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-7ad1a10c-f069-4d3f-a4d9-d6cc30931922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:05.083905 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1a10c-f069-4d3f-a4d9-d6cc30931922 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:56:05.159654 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ba5d1-dffc-4cf6-9187-bc8bb2c30af6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:56:05.160372 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ba5d1-dffc-4cf6-9187-bc8bb2c30af6 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:05.160669 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ba5d1-dffc-4cf6-9187-bc8bb2c30af6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:05.160934 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ba5d1-dffc-4cf6-9187-bc8bb2c30af6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:05.162531 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-8d4ba5d1-dffc-4cf6-9187-bc8bb2c30af6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:05.286019 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ba5d1-dffc-4cf6-9187-bc8bb2c30af6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:56:05.287457 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ba5d1-dffc-4cf6-9187-bc8bb2c30af6 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:56:05.305996 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 647/1319] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:56:04 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:56:08.526472 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed307eda-91b2-4005-98a5-dd07aea082ec None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:08.527329 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed307eda-91b2-4005-98a5-dd07aea082ec None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:08.527329 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed307eda-91b2-4005-98a5-dd07aea082ec None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:08.529650 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 673/1320] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:56:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:56:08.535105 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba274c3-9f3a-4258-ac0f-222a83dcf058 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:08.535750 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba274c3-9f3a-4258-ac0f-222a83dcf058 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:08.535750 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba274c3-9f3a-4258-ac0f-222a83dcf058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:08.601195 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-5ba274c3-9f3a-4258-ac0f-222a83dcf058 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:56:08.602381 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-5ba274c3-9f3a-4258-ac0f-222a83dcf058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:08.700474 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 648/1321] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:56:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:56:08.741572 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed307eda-91b2-4005-98a5-dd07aea082ec None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:56:08.744006 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-ed307eda-91b2-4005-98a5-dd07aea082ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:08.857746 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed307eda-91b2-4005-98a5-dd07aea082ec None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:56:08.937483 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2195a-c6b8-46e1-9bcc-026b8bbaf148 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:56:08.938122 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2195a-c6b8-46e1-9bcc-026b8bbaf148 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:08.938437 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2195a-c6b8-46e1-9bcc-026b8bbaf148 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:08.938647 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2195a-c6b8-46e1-9bcc-026b8bbaf148 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:08.940287 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-e7b2195a-c6b8-46e1-9bcc-026b8bbaf148 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:09.073081 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2195a-c6b8-46e1-9bcc-026b8bbaf148 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:56:09.074512 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2195a-c6b8-46e1-9bcc-026b8bbaf148 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:56:09.092980 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 674/1322] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:56:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:56:12.144530 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2f726-387f-43a4-b00f-07411b81efee None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:12.145082 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2f726-387f-43a4-b00f-07411b81efee None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:12.145171 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2f726-387f-43a4-b00f-07411b81efee None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:12.146619 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 649/1323] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:56:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:56:12.152404 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236d3a3-c608-4002-a5d0-0847fd8669aa None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:12.152841 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236d3a3-c608-4002-a5d0-0847fd8669aa None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:12.152941 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236d3a3-c608-4002-a5d0-0847fd8669aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:12.215377 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-f236d3a3-c608-4002-a5d0-0847fd8669aa None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:56:12.216564 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-f236d3a3-c608-4002-a5d0-0847fd8669aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:12.311269 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 675/1324] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:56:12.348515 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2f726-387f-43a4-b00f-07411b81efee None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:56:12.350018 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-5ab2f726-387f-43a4-b00f-07411b81efee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:12.452178 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2f726-387f-43a4-b00f-07411b81efee None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:56:12.525784 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1da44-c277-4a1e-a073-302654ab9ff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:56:12.526432 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1da44-c277-4a1e-a073-302654ab9ff9 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:12.526709 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1da44-c277-4a1e-a073-302654ab9ff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:12.526982 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1da44-c277-4a1e-a073-302654ab9ff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:12.528619 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-06a1da44-c277-4a1e-a073-302654ab9ff9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:12.637743 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1da44-c277-4a1e-a073-302654ab9ff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:56:12.639193 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1da44-c277-4a1e-a073-302654ab9ff9 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:56:12.658473 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 650/1325] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:56:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:56:15.024075 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2e582-4a6d-4a38-ac8c-ae0dab697d37 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:15.024669 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2e582-4a6d-4a38-ac8c-ae0dab697d37 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:15.024669 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2e582-4a6d-4a38-ac8c-ae0dab697d37 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:15.025948 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 676/1326] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:56:15.031238 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9518c-7c2a-431a-82f4-fc0bf7afb322 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:15.031668 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9518c-7c2a-431a-82f4-fc0bf7afb322 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:15.031817 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9518c-7c2a-431a-82f4-fc0bf7afb322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:15.096581 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-13e9518c-7c2a-431a-82f4-fc0bf7afb322 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:56:15.097927 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-13e9518c-7c2a-431a-82f4-fc0bf7afb322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:15.196453 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 651/1327] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:56:15.233366 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2e582-4a6d-4a38-ac8c-ae0dab697d37 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:56:15.234885 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-0ee2e582-4a6d-4a38-ac8c-ae0dab697d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:15.335593 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2e582-4a6d-4a38-ac8c-ae0dab697d37 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:56:15.408576 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d7acd-4a54-450e-b0a2-ad692f1d3b95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:56:15.409231 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d7acd-4a54-450e-b0a2-ad692f1d3b95 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:15.409480 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d7acd-4a54-450e-b0a2-ad692f1d3b95 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:15.409772 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d7acd-4a54-450e-b0a2-ad692f1d3b95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:15.411512 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-062d7acd-4a54-450e-b0a2-ad692f1d3b95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:15.530100 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d7acd-4a54-450e-b0a2-ad692f1d3b95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:56:15.531553 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d7acd-4a54-450e-b0a2-ad692f1d3b95 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:56:15.552055 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 677/1328] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:56:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:56:17.883882 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ceda9-3fdc-44be-bfd9-4486eb3ef416 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:17.884418 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ceda9-3fdc-44be-bfd9-4486eb3ef416 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:17.884418 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ceda9-3fdc-44be-bfd9-4486eb3ef416 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:17.885713 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 652/1329] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:56:17.891041 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3319d-096c-4627-a6b1-9e4f513aa97d None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:17.891474 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3319d-096c-4627-a6b1-9e4f513aa97d None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:17.891580 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3319d-096c-4627-a6b1-9e4f513aa97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:17.954883 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-4ff3319d-096c-4627-a6b1-9e4f513aa97d None None] MFA Rules not processed for user `7ec35991c252426ba394c75df977df0e`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:56:17.956082 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-4ff3319d-096c-4627-a6b1-9e4f513aa97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:18.051385 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 678/1330] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:56:17 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:56:18.091220 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ceda9-3fdc-44be-bfd9-4486eb3ef416 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:56:18.092809 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-de4ceda9-3fdc-44be-bfd9-4486eb3ef416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:18.196739 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ceda9-3fdc-44be-bfd9-4486eb3ef416 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:56:18.269099 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783284a-4408-4673-bd81-96d824db18d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:56:18.269791 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783284a-4408-4673-bd81-96d824db18d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:18.270086 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783284a-4408-4673-bd81-96d824db18d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:18.270355 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783284a-4408-4673-bd81-96d824db18d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:18.272082 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-f783284a-4408-4673-bd81-96d824db18d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:18.379736 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f783284a-4408-4673-bd81-96d824db18d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:56:18.381213 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f783284a-4408-4673-bd81-96d824db18d8 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:56:18.400757 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 653/1331] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:56:18 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:56:21.053394 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83cc29-be8d-446f-8150-dcec6c4de99a None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:21.053914 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83cc29-be8d-446f-8150-dcec6c4de99a None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:21.053914 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83cc29-be8d-446f-8150-dcec6c4de99a None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:21.055327 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 679/1332] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:56:21.061824 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f72e0-6f40-4de3-b43d-eb0fb8b912e9 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:21.062214 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f72e0-6f40-4de3-b43d-eb0fb8b912e9 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:21.062385 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f72e0-6f40-4de3-b43d-eb0fb8b912e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:21.141718 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-436f72e0-6f40-4de3-b43d-eb0fb8b912e9 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:56:21.142917 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-436f72e0-6f40-4de3-b43d-eb0fb8b912e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:21.244397 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 654/1333] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:56:21.281487 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83cc29-be8d-446f-8150-dcec6c4de99a None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:56:21.283026 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-7a83cc29-be8d-446f-8150-dcec6c4de99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:21.388382 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83cc29-be8d-446f-8150-dcec6c4de99a None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:56:21.463020 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbce2f7-4d19-4d3d-b09c-c9d054db908a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:56:21.463670 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbce2f7-4d19-4d3d-b09c-c9d054db908a service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:21.463878 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbce2f7-4d19-4d3d-b09c-c9d054db908a service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:21.464146 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbce2f7-4d19-4d3d-b09c-c9d054db908a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:21.465792 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-3fbce2f7-4d19-4d3d-b09c-c9d054db908a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:21.578666 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbce2f7-4d19-4d3d-b09c-c9d054db908a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:56:21.580271 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbce2f7-4d19-4d3d-b09c-c9d054db908a service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:56:21.599269 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 680/1334] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:56:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:56:23.953727 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f002b0-e197-4f82-a051-7f4db6041171 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:23.954651 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f002b0-e197-4f82-a051-7f4db6041171 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:23.954651 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f002b0-e197-4f82-a051-7f4db6041171 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:23.956949 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 655/1335] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:56:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:56:23.963045 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a313922-8ef8-4ab9-9904-5e04e2260f84 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:23.963704 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a313922-8ef8-4ab9-9904-5e04e2260f84 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:23.963846 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a313922-8ef8-4ab9-9904-5e04e2260f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:24.037572 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-1a313922-8ef8-4ab9-9904-5e04e2260f84 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:56:24.038901 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-1a313922-8ef8-4ab9-9904-5e04e2260f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:24.137345 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 681/1336] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:56:24.179469 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f002b0-e197-4f82-a051-7f4db6041171 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:56:24.181035 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-06f002b0-e197-4f82-a051-7f4db6041171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:24.280475 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f002b0-e197-4f82-a051-7f4db6041171 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:56:24.368174 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4ac98-f5b1-4446-8dc4-b69453c80a10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:56:24.368808 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4ac98-f5b1-4446-8dc4-b69453c80a10 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:24.369075 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4ac98-f5b1-4446-8dc4-b69453c80a10 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:24.369336 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4ac98-f5b1-4446-8dc4-b69453c80a10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:24.370944 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-14d4ac98-f5b1-4446-8dc4-b69453c80a10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:24.486346 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d4ac98-f5b1-4446-8dc4-b69453c80a10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:56:24.487685 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d4ac98-f5b1-4446-8dc4-b69453c80a10 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:56:24.507882 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 656/1337] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:56:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:56:27.136039 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb8f62-4095-420d-b307-a8716177a886 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:27.137109 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb8f62-4095-420d-b307-a8716177a886 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:27.137109 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb8f62-4095-420d-b307-a8716177a886 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:27.139157 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 682/1338] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:56:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:56:27.148551 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d067c9-71af-4c86-8648-0b7c6e853ca1 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:27.148990 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d067c9-71af-4c86-8648-0b7c6e853ca1 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:27.149347 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d067c9-71af-4c86-8648-0b7c6e853ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:27.222581 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-48d067c9-71af-4c86-8648-0b7c6e853ca1 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:56:27.223672 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-48d067c9-71af-4c86-8648-0b7c6e853ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:27.331671 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 657/1339] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:56:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:56:27.385032 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb8f62-4095-420d-b307-a8716177a886 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:56:27.386632 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-0beb8f62-4095-420d-b307-a8716177a886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:27.513449 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb8f62-4095-420d-b307-a8716177a886 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:56:27.588652 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b3012-6a82-4aac-bf28-d2902da59abe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:56:27.589287 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b3012-6a82-4aac-bf28-d2902da59abe service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:27.589555 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b3012-6a82-4aac-bf28-d2902da59abe service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:27.589817 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b3012-6a82-4aac-bf28-d2902da59abe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:27.591424 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-0f8b3012-6a82-4aac-bf28-d2902da59abe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:27.721918 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b3012-6a82-4aac-bf28-d2902da59abe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:56:27.723666 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b3012-6a82-4aac-bf28-d2902da59abe service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:56:27.742631 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 683/1340] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:56:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:56:32.040072 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21eea58-c5e5-4aa9-bcf1-128653a115d8 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:32.040551 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21eea58-c5e5-4aa9-bcf1-128653a115d8 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:32.040551 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21eea58-c5e5-4aa9-bcf1-128653a115d8 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:32.042129 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 658/1341] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:56:32.047139 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60260b-a2ff-4d3b-bacc-3a632b5432df None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:32.047577 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60260b-a2ff-4d3b-bacc-3a632b5432df None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:32.047867 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60260b-a2ff-4d3b-bacc-3a632b5432df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:32.121120 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-dd60260b-a2ff-4d3b-bacc-3a632b5432df None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:56:32.122302 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-dd60260b-a2ff-4d3b-bacc-3a632b5432df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:32.230160 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 684/1342] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:56:32.269365 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21eea58-c5e5-4aa9-bcf1-128653a115d8 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:56:32.271657 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-e21eea58-c5e5-4aa9-bcf1-128653a115d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:32.369811 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21eea58-c5e5-4aa9-bcf1-128653a115d8 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:56:32.373641 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a98af6-35d0-4863-9fc7-553766c4995f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:56:32.374280 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a98af6-35d0-4863-9fc7-553766c4995f service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:32.374549 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a98af6-35d0-4863-9fc7-553766c4995f service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:32.374824 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a98af6-35d0-4863-9fc7-553766c4995f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:32.385886 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a98af6-35d0-4863-9fc7-553766c4995f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:56:32.387327 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a98af6-35d0-4863-9fc7-553766c4995f service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:56:32.397411 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 659/1343] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:56:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:56:35.425074 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2248d-76e3-4cda-9801-c289122d972e None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:35.425640 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2248d-76e3-4cda-9801-c289122d972e None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:35.425819 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2248d-76e3-4cda-9801-c289122d972e None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:35.427266 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 685/1344] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:56:35.432788 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703bb70-9617-4752-8370-9a21af62e4a9 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:35.433248 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703bb70-9617-4752-8370-9a21af62e4a9 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:35.433348 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703bb70-9617-4752-8370-9a21af62e4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:35.461996 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-6703bb70-9617-4752-8370-9a21af62e4a9 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:56:35.463200 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-6703bb70-9617-4752-8370-9a21af62e4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:35.541100 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 660/1345] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:56:35 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:56:35.578893 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2248d-76e3-4cda-9801-c289122d972e None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:56:35.590069 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2248d-76e3-4cda-9801-c289122d972e None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:56:35.594560 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c399e5c-1b83-43a6-8c70-ccc31ff1953c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:56:35.595237 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c399e5c-1b83-43a6-8c70-ccc31ff1953c service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:35.595510 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c399e5c-1b83-43a6-8c70-ccc31ff1953c service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:35.595831 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c399e5c-1b83-43a6-8c70-ccc31ff1953c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:35.609398 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c399e5c-1b83-43a6-8c70-ccc31ff1953c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:56:35.610832 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c399e5c-1b83-43a6-8c70-ccc31ff1953c service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:56:35.620588 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 686/1346] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:56:35 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:56:40.331561 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b5e5d-3702-45e8-b6d4-4d1a8b27cec9 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:40.332154 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b5e5d-3702-45e8-b6d4-4d1a8b27cec9 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:40.332154 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b5e5d-3702-45e8-b6d4-4d1a8b27cec9 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:40.333460 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 661/1347] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:56:40.338783 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e81808-0534-4fae-b63f-63452089d20b None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:40.339178 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e81808-0534-4fae-b63f-63452089d20b None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:40.339349 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e81808-0534-4fae-b63f-63452089d20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:40.357862 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-88e81808-0534-4fae-b63f-63452089d20b None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:56:40.359029 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-88e81808-0534-4fae-b63f-63452089d20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:40.368256 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 687/1348] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:56:40.406882 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b5e5d-3702-45e8-b6d4-4d1a8b27cec9 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:56:40.408937 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-2a3b5e5d-3702-45e8-b6d4-4d1a8b27cec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:40.423618 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b5e5d-3702-45e8-b6d4-4d1a8b27cec9 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:56:40.428137 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834c707-ddea-46de-9e01-577ea3c7c311 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:56:40.428782 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834c707-ddea-46de-9e01-577ea3c7c311 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:40.429055 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834c707-ddea-46de-9e01-577ea3c7c311 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:40.429318 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834c707-ddea-46de-9e01-577ea3c7c311 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:40.439427 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2834c707-ddea-46de-9e01-577ea3c7c311 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:56:40.441263 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2834c707-ddea-46de-9e01-577ea3c7c311 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:56:40.451461 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 662/1349] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:56:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:56:45.745293 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaeb4b8-c528-4d6f-9d1c-9704e4638ec5 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:45.746934 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaeb4b8-c528-4d6f-9d1c-9704e4638ec5 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:45.747399 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaeb4b8-c528-4d6f-9d1c-9704e4638ec5 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:45.749059 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 688/1350] 10.222.0.32 () {54 vars in 921 bytes} [Tue Apr 12 02:56:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:56:45.754528 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf88f77-c3e7-466c-8f8b-7767ecd8356b None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:45.755387 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf88f77-c3e7-466c-8f8b-7767ecd8356b None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:45.755914 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf88f77-c3e7-466c-8f8b-7767ecd8356b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:45.826009 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-4bf88f77-c3e7-466c-8f8b-7767ecd8356b None None] MFA Rules not processed for user `c2a88ae51543497382d34573afc2bde3`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:56:45.827885 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-4bf88f77-c3e7-466c-8f8b-7767ecd8356b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:45.902994 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 663/1351] 10.222.0.32 () {58 vars in 1018 bytes} [Tue Apr 12 02:56:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 02:56:50.260349 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d60b4-6ea9-45d9-b1b7-e783d9e2743c None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:50.261216 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d60b4-6ea9-45d9-b1b7-e783d9e2743c None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:50.261494 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d60b4-6ea9-45d9-b1b7-e783d9e2743c None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:50.263066 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 689/1352] 10.222.0.32 () {54 vars in 921 bytes} [Tue Apr 12 02:56:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:56:50.268049 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d687a5-4c18-4902-a406-778ba078a32a None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:50.268804 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d687a5-4c18-4902-a406-778ba078a32a None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:50.269085 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d687a5-4c18-4902-a406-778ba078a32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:50.288313 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-c4d687a5-4c18-4902-a406-778ba078a32a None None] MFA Rules not processed for user `c2a88ae51543497382d34573afc2bde3`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:56:50.289492 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-c4d687a5-4c18-4902-a406-778ba078a32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:50.298912 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 664/1353] 10.222.0.32 () {58 vars in 1018 bytes} [Tue Apr 12 02:56:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:56:51.902347 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a0b59-7771-4aea-b9e8-ecaa45826b8e None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:51.902863 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a0b59-7771-4aea-b9e8-ecaa45826b8e None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:51.902863 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a0b59-7771-4aea-b9e8-ecaa45826b8e None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:51.904179 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 690/1354] 10.222.0.32 () {54 vars in 921 bytes} [Tue Apr 12 02:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:56:51.909617 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a7dbb-ecdd-4b23-ab25-1257d48e700b None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:51.910040 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a7dbb-ecdd-4b23-ab25-1257d48e700b None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:51.910186 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a7dbb-ecdd-4b23-ab25-1257d48e700b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:51.929537 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-7d1a7dbb-ecdd-4b23-ab25-1257d48e700b None None] MFA Rules not processed for user `c2a88ae51543497382d34573afc2bde3`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:56:51.930697 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-7d1a7dbb-ecdd-4b23-ab25-1257d48e700b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:51.939785 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 665/1355] 10.222.0.32 () {58 vars in 1018 bytes} [Tue Apr 12 02:56:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:56:55.761270 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747b7f1-6737-4979-b664-1b1c3db1c10b None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:55.761862 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747b7f1-6737-4979-b664-1b1c3db1c10b None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:55.761862 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747b7f1-6737-4979-b664-1b1c3db1c10b None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:55.763422 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 691/1356] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:56:55.768929 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529897a-bd96-44a4-91dd-5bdc574a1f53 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:55.769431 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529897a-bd96-44a4-91dd-5bdc574a1f53 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:55.769655 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529897a-bd96-44a4-91dd-5bdc574a1f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:55.791111 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-8529897a-bd96-44a4-91dd-5bdc574a1f53 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:56:55.792675 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-8529897a-bd96-44a4-91dd-5bdc574a1f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:55.801745 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 666/1357] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:56:55.853960 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921d9b9-80c2-489a-a858-cd42e9ed6eb2 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:55.854669 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921d9b9-80c2-489a-a858-cd42e9ed6eb2 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:55.855052 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921d9b9-80c2-489a-a858-cd42e9ed6eb2 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:55.856612 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 692/1358] 10.222.0.32 () {54 vars in 960 bytes} [Tue Apr 12 02:56:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:56:55.863084 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145ce3f-1149-4230-9727-b6ebc15b83ba None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:55.863358 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145ce3f-1149-4230-9727-b6ebc15b83ba None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:55.863625 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145ce3f-1149-4230-9727-b6ebc15b83ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:55.913009 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-9145ce3f-1149-4230-9727-b6ebc15b83ba None None] MFA Rules not processed for user `43ee5cb310fd4538910e40ea7082708c`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:56:55.914224 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-9145ce3f-1149-4230-9727-b6ebc15b83ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:55.999888 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 667/1359] 10.222.0.32 () {58 vars in 1057 bytes} [Tue Apr 12 02:56:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:56:56.005815 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921d9b9-80c2-489a-a858-cd42e9ed6eb2 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:56:56.020672 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921d9b9-80c2-489a-a858-cd42e9ed6eb2 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:56:56.026133 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa600f8-c0bd-4e39-8a05-ec23e43b00fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:56:56.026895 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa600f8-c0bd-4e39-8a05-ec23e43b00fa service nova] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:56.027264 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa600f8-c0bd-4e39-8a05-ec23e43b00fa service nova] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:56.027768 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa600f8-c0bd-4e39-8a05-ec23e43b00fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:56.036582 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa600f8-c0bd-4e39-8a05-ec23e43b00fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:56:56.038166 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa600f8-c0bd-4e39-8a05-ec23e43b00fa service nova] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:56:56.057033 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 693/1360] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:56:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:56:58.558531 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae26325-1518-4b8c-befa-48cffaa36fa7 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:58.559099 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae26325-1518-4b8c-befa-48cffaa36fa7 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:58.559099 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae26325-1518-4b8c-befa-48cffaa36fa7 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:58.560444 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 668/1361] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:56:58.565761 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5389009-f391-4dce-8a9d-5c3bf2cf834e None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:58.566205 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5389009-f391-4dce-8a9d-5c3bf2cf834e None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:58.566297 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5389009-f391-4dce-8a9d-5c3bf2cf834e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:58.585522 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-d5389009-f391-4dce-8a9d-5c3bf2cf834e None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:56:58.586903 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-d5389009-f391-4dce-8a9d-5c3bf2cf834e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:56:58.594888 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 694/1362] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 02:56:58.639871 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae26325-1518-4b8c-befa-48cffaa36fa7 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:56:58.654587 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae26325-1518-4b8c-befa-48cffaa36fa7 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:56:58.660174 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d28892-ab6f-4950-b0ef-9e143d934447 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:56:58.660811 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d28892-ab6f-4950-b0ef-9e143d934447 service nova] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:56:58.661193 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d28892-ab6f-4950-b0ef-9e143d934447 service nova] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:56:58.661461 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d28892-ab6f-4950-b0ef-9e143d934447 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:56:58.670135 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d28892-ab6f-4950-b0ef-9e143d934447 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:56:58.671761 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d28892-ab6f-4950-b0ef-9e143d934447 service nova] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:56:58.682569 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 669/1363] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:56:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:57:01.262644 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa39db-9156-410d-9c36-920b73764d33 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:01.263207 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa39db-9156-410d-9c36-920b73764d33 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:01.263207 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa39db-9156-410d-9c36-920b73764d33 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:01.264611 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 695/1364] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:57:01.269919 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0c627-e2ae-4134-9228-c2ade539df82 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:01.270339 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0c627-e2ae-4134-9228-c2ade539df82 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:01.270499 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0c627-e2ae-4134-9228-c2ade539df82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:01.289269 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-bfb0c627-e2ae-4134-9228-c2ade539df82 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:57:01.290446 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-bfb0c627-e2ae-4134-9228-c2ade539df82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:57:01.298835 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 670/1365] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:57:01.347155 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d2938-7e51-446c-9c0e-c38a0fe2aa76 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:01.347504 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d2938-7e51-446c-9c0e-c38a0fe2aa76 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:01.347894 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d2938-7e51-446c-9c0e-c38a0fe2aa76 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:01.349265 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 696/1366] 10.222.0.32 () {54 vars in 960 bytes} [Tue Apr 12 02:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:57:01.354574 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1870ed-6164-46a8-92b1-12512e039dfd None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:01.354893 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1870ed-6164-46a8-92b1-12512e039dfd None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:01.355348 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1870ed-6164-46a8-92b1-12512e039dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:01.379950 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-9b1870ed-6164-46a8-92b1-12512e039dfd None None] MFA Rules not processed for user `43ee5cb310fd4538910e40ea7082708c`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:57:01.381103 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-9b1870ed-6164-46a8-92b1-12512e039dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:57:01.390863 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 671/1367] 10.222.0.32 () {58 vars in 1057 bytes} [Tue Apr 12 02:57:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:57:01.398898 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d2938-7e51-446c-9c0e-c38a0fe2aa76 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:57:01.413842 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d2938-7e51-446c-9c0e-c38a0fe2aa76 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:57:01.419541 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b340c9-9722-486a-902f-3b7fe23bcc08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:57:01.420192 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b340c9-9722-486a-902f-3b7fe23bcc08 service nova] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:01.420468 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b340c9-9722-486a-902f-3b7fe23bcc08 service nova] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:01.420740 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b340c9-9722-486a-902f-3b7fe23bcc08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:01.429539 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b340c9-9722-486a-902f-3b7fe23bcc08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:57:01.431117 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b340c9-9722-486a-902f-3b7fe23bcc08 service nova] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:57:01.447752 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 697/1368] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:57:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:57:03.826058 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ae4a3-c992-4198-8040-55c0ca4be0e9 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:03.826633 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ae4a3-c992-4198-8040-55c0ca4be0e9 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:03.826821 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ae4a3-c992-4198-8040-55c0ca4be0e9 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:03.828797 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 672/1369] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:57:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:57:03.835120 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46768a1-db98-4258-a5b6-3d7c8bcc4e03 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:03.835663 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46768a1-db98-4258-a5b6-3d7c8bcc4e03 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:03.835663 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46768a1-db98-4258-a5b6-3d7c8bcc4e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:03.854877 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-e46768a1-db98-4258-a5b6-3d7c8bcc4e03 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:57:03.856028 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-e46768a1-db98-4258-a5b6-3d7c8bcc4e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:57:03.864828 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 698/1370] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:57:03.888248 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4ceea-8336-4b81-a8cc-c979766783a5 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:03.888492 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4ceea-8336-4b81-a8cc-c979766783a5 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:03.888987 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4ceea-8336-4b81-a8cc-c979766783a5 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:03.890311 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 673/1371] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:57:03.896102 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6412399-b66f-4d33-a740-30912f0261cc None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:03.896374 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6412399-b66f-4d33-a740-30912f0261cc None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:03.897157 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6412399-b66f-4d33-a740-30912f0261cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:03.909958 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4ceea-8336-4b81-a8cc-c979766783a5 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:57:03.915005 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-a6412399-b66f-4d33-a740-30912f0261cc None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:57:03.916207 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-a6412399-b66f-4d33-a740-30912f0261cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:57:03.924893 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 699/1372] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:57:03.925953 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4ceea-8336-4b81-a8cc-c979766783a5 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:57:03.931604 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331eae4-b588-4078-be12-21b94b38ac06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:57:03.932405 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331eae4-b588-4078-be12-21b94b38ac06 service nova] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:03.932686 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331eae4-b588-4078-be12-21b94b38ac06 service nova] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:03.932955 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331eae4-b588-4078-be12-21b94b38ac06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:03.941918 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331eae4-b588-4078-be12-21b94b38ac06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:57:03.943711 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331eae4-b588-4078-be12-21b94b38ac06 service nova] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:57:03.955480 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 674/1373] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:57:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:57:04.241914 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7eec2c-c941-4d26-85ff-6e0506b80239 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:04.242197 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7eec2c-c941-4d26-85ff-6e0506b80239 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:04.242466 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7eec2c-c941-4d26-85ff-6e0506b80239 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:04.244047 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 700/1374] 10.222.0.32 () {54 vars in 962 bytes} [Tue Apr 12 02:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:57:04.248749 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66baf41-a4a6-4667-9d19-c1264f918b4d None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:04.249032 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66baf41-a4a6-4667-9d19-c1264f918b4d None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:04.249302 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66baf41-a4a6-4667-9d19-c1264f918b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:04.305523 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-f66baf41-a4a6-4667-9d19-c1264f918b4d None None] MFA Rules not processed for user `44248c51c2cb497b85a68dce0496a225`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:57:04.306700 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-f66baf41-a4a6-4667-9d19-c1264f918b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:57:04.367599 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 675/1375] 10.222.0.32 () {58 vars in 1059 bytes} [Tue Apr 12 02:57:04 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:57:04.375046 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7eec2c-c941-4d26-85ff-6e0506b80239 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:57:04.386246 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7eec2c-c941-4d26-85ff-6e0506b80239 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:57:04.389815 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544dd6a-afdd-4621-bdf5-1d16b901e162 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:57:04.390648 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544dd6a-afdd-4621-bdf5-1d16b901e162 service cinder] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:04.390922 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544dd6a-afdd-4621-bdf5-1d16b901e162 service cinder] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:04.391189 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544dd6a-afdd-4621-bdf5-1d16b901e162 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:04.400800 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9544dd6a-afdd-4621-bdf5-1d16b901e162 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:57:04.402230 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9544dd6a-afdd-4621-bdf5-1d16b901e162 service cinder] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:57:04.414536 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 701/1376] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:57:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:57:06.306792 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d60ba-83ed-4d34-bc90-1eee4e2f1720 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:06.307343 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d60ba-83ed-4d34-bc90-1eee4e2f1720 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:06.307343 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d60ba-83ed-4d34-bc90-1eee4e2f1720 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:06.308660 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 676/1377] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:57:06.314552 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ee28e-319b-4357-8dd4-796f14d94488 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:06.315327 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ee28e-319b-4357-8dd4-796f14d94488 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:06.315327 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ee28e-319b-4357-8dd4-796f14d94488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:06.335827 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-c38ee28e-319b-4357-8dd4-796f14d94488 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:57:06.337062 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-c38ee28e-319b-4357-8dd4-796f14d94488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:57:06.345119 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 702/1378] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:57:06.390319 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d60ba-83ed-4d34-bc90-1eee4e2f1720 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:57:06.405106 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d60ba-83ed-4d34-bc90-1eee4e2f1720 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:57:06.411394 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2519ac-8367-47b8-97e9-809c2b6a8451 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:57:06.412072 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2519ac-8367-47b8-97e9-809c2b6a8451 service nova] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:06.412349 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2519ac-8367-47b8-97e9-809c2b6a8451 service nova] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:06.412609 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2519ac-8367-47b8-97e9-809c2b6a8451 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:06.422242 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2519ac-8367-47b8-97e9-809c2b6a8451 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:57:06.423899 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2519ac-8367-47b8-97e9-809c2b6a8451 service nova] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:57:06.433881 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 677/1379] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:57:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:57:08.777067 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083bea2-75c7-4617-a69e-42f4927c7dfa None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:08.777635 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083bea2-75c7-4617-a69e-42f4927c7dfa None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:08.777635 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083bea2-75c7-4617-a69e-42f4927c7dfa None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:08.778926 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 703/1380] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:57:08.784269 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b912b2-5782-4a97-af4e-025c9439e130 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:08.784707 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b912b2-5782-4a97-af4e-025c9439e130 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:08.784833 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b912b2-5782-4a97-af4e-025c9439e130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:08.802746 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-71b912b2-5782-4a97-af4e-025c9439e130 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:57:08.803942 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-71b912b2-5782-4a97-af4e-025c9439e130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:57:08.811984 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 678/1381] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:57:08.856454 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083bea2-75c7-4617-a69e-42f4927c7dfa None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:57:08.870561 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083bea2-75c7-4617-a69e-42f4927c7dfa None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:57:08.875923 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575f463-7b93-4620-a0f4-4b9fc8d49079 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:57:08.876552 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575f463-7b93-4620-a0f4-4b9fc8d49079 service nova] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:08.876823 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575f463-7b93-4620-a0f4-4b9fc8d49079 service nova] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:08.877168 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575f463-7b93-4620-a0f4-4b9fc8d49079 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:08.885254 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575f463-7b93-4620-a0f4-4b9fc8d49079 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:57:08.886826 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575f463-7b93-4620-a0f4-4b9fc8d49079 service nova] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:57:08.896160 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 704/1382] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:57:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:57:11.231404 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2a0ad-c613-443d-9383-7dc18d5a944c None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:11.231985 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2a0ad-c613-443d-9383-7dc18d5a944c None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:11.231985 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2a0ad-c613-443d-9383-7dc18d5a944c None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:11.233340 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 679/1383] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:57:11.238982 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca21bde-a036-4501-b90e-b73d53f28b64 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:11.239413 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca21bde-a036-4501-b90e-b73d53f28b64 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:11.239506 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca21bde-a036-4501-b90e-b73d53f28b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:11.257747 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-2ca21bde-a036-4501-b90e-b73d53f28b64 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:57:11.258932 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-2ca21bde-a036-4501-b90e-b73d53f28b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:57:11.266811 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 705/1384] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 02:57:11.309934 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2a0ad-c613-443d-9383-7dc18d5a944c None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:57:11.325118 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2a0ad-c613-443d-9383-7dc18d5a944c None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:57:11.331738 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626f895-0bb3-451d-9746-38a6582ccd5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:57:11.332387 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626f895-0bb3-451d-9746-38a6582ccd5c service nova] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:11.332647 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626f895-0bb3-451d-9746-38a6582ccd5c service nova] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:11.332927 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626f895-0bb3-451d-9746-38a6582ccd5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:11.341761 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0626f895-0bb3-451d-9746-38a6582ccd5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:57:11.343343 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0626f895-0bb3-451d-9746-38a6582ccd5c service nova] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:57:11.353508 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 680/1385] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:57:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:57:13.720114 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f11f64-2016-4703-a550-a62e4a099c2d None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:13.720917 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f11f64-2016-4703-a550-a62e4a099c2d None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:13.720917 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f11f64-2016-4703-a550-a62e4a099c2d None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:13.722495 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 706/1386] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:57:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:57:13.727903 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa0e78-c9da-4c10-8891-cdf1df303515 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:13.728496 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa0e78-c9da-4c10-8891-cdf1df303515 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:13.728496 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa0e78-c9da-4c10-8891-cdf1df303515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:13.749436 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-d8aa0e78-c9da-4c10-8891-cdf1df303515 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:57:13.751010 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-d8aa0e78-c9da-4c10-8891-cdf1df303515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:57:13.761963 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 681/1387] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:57:13.808652 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f11f64-2016-4703-a550-a62e4a099c2d None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:57:13.825527 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f11f64-2016-4703-a550-a62e4a099c2d None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:57:13.832946 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250c8e2-0fdf-4f6a-9ba8-3851d1dde944 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:57:13.833720 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250c8e2-0fdf-4f6a-9ba8-3851d1dde944 service nova] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:13.834066 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250c8e2-0fdf-4f6a-9ba8-3851d1dde944 service nova] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:13.834398 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250c8e2-0fdf-4f6a-9ba8-3851d1dde944 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:13.844625 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250c8e2-0fdf-4f6a-9ba8-3851d1dde944 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:57:13.846922 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250c8e2-0fdf-4f6a-9ba8-3851d1dde944 service nova] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:57:13.858910 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 707/1388] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:57:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:57:16.753569 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360cedb-a63b-4317-8670-d3f57b5baa7f None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:16.754113 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360cedb-a63b-4317-8670-d3f57b5baa7f None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:16.754344 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360cedb-a63b-4317-8670-d3f57b5baa7f None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:16.755738 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 682/1389] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:57:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:57:16.763502 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f915a62-b941-4ac6-a9f1-5f405be1d43a None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:16.764005 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f915a62-b941-4ac6-a9f1-5f405be1d43a None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:16.764005 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f915a62-b941-4ac6-a9f1-5f405be1d43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:16.785585 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-4f915a62-b941-4ac6-a9f1-5f405be1d43a None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:57:16.786806 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-4f915a62-b941-4ac6-a9f1-5f405be1d43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:57:16.795470 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 708/1390] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:57:16.843936 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360cedb-a63b-4317-8670-d3f57b5baa7f None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:57:16.860358 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360cedb-a63b-4317-8670-d3f57b5baa7f None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:57:16.865970 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2a806-0ff9-468a-921e-07b95522395e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:57:16.866610 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2a806-0ff9-468a-921e-07b95522395e service nova] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:16.866883 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2a806-0ff9-468a-921e-07b95522395e service nova] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:16.867146 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2a806-0ff9-468a-921e-07b95522395e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:16.875336 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc2a806-0ff9-468a-921e-07b95522395e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:57:16.877767 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc2a806-0ff9-468a-921e-07b95522395e service nova] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:57:16.889961 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 683/1391] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:57:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:57:19.411998 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89fb4dc-358a-4c1a-89fc-8fbe021ac2da None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:19.412623 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89fb4dc-358a-4c1a-89fc-8fbe021ac2da None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:19.412623 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89fb4dc-358a-4c1a-89fc-8fbe021ac2da None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:19.413977 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 709/1392] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:57:19.419147 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8bdbf-8611-4056-b64a-5c75a1a9365d None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:19.419602 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8bdbf-8611-4056-b64a-5c75a1a9365d None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:19.419700 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8bdbf-8611-4056-b64a-5c75a1a9365d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:19.437594 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-d7c8bdbf-8611-4056-b64a-5c75a1a9365d None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:57:19.438746 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-d7c8bdbf-8611-4056-b64a-5c75a1a9365d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:57:19.446954 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 684/1393] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:57:19.492800 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89fb4dc-358a-4c1a-89fc-8fbe021ac2da None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:57:19.508542 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89fb4dc-358a-4c1a-89fc-8fbe021ac2da None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:57:19.514285 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140fdbd-7cc7-4ee4-b570-19c0661fb4c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:57:19.514948 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140fdbd-7cc7-4ee4-b570-19c0661fb4c5 service nova] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:19.515223 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140fdbd-7cc7-4ee4-b570-19c0661fb4c5 service nova] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:19.515480 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140fdbd-7cc7-4ee4-b570-19c0661fb4c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:19.524192 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140fdbd-7cc7-4ee4-b570-19c0661fb4c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:57:19.525783 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140fdbd-7cc7-4ee4-b570-19c0661fb4c5 service nova] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:57:19.535217 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 710/1394] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:57:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:57:20.334570 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d3365-4c1c-4bcf-901c-665346fd7888 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:20.334798 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d3365-4c1c-4bcf-901c-665346fd7888 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:20.334984 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d3365-4c1c-4bcf-901c-665346fd7888 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:20.336422 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 685/1395] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:57:20.341660 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e9c09-0568-467e-b973-c5f5bd8dc88b None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:20.341938 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e9c09-0568-467e-b973-c5f5bd8dc88b None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:20.342207 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e9c09-0568-467e-b973-c5f5bd8dc88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:20.360110 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-8a0e9c09-0568-467e-b973-c5f5bd8dc88b None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:57:20.361301 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-8a0e9c09-0568-467e-b973-c5f5bd8dc88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:57:20.369786 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 711/1396] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 02:57:20.426951 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86902cd8-fabd-49b1-b79e-818f34869c4f None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:20.427449 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86902cd8-fabd-49b1-b79e-818f34869c4f None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:20.427449 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86902cd8-fabd-49b1-b79e-818f34869c4f None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:20.428889 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 686/1397] 10.222.0.32 () {54 vars in 961 bytes} [Tue Apr 12 02:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:57:20.434001 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1503be3-7858-4061-9470-bdda86ad8ebf None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:20.434437 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1503be3-7858-4061-9470-bdda86ad8ebf None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:20.434635 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1503be3-7858-4061-9470-bdda86ad8ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:20.485863 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-a1503be3-7858-4061-9470-bdda86ad8ebf None None] MFA Rules not processed for user `828a6cffa8af470388d4b063c3c49849`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:57:20.488474 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-a1503be3-7858-4061-9470-bdda86ad8ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:57:20.546126 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 712/1398] 10.222.0.32 () {58 vars in 1058 bytes} [Tue Apr 12 02:57:20 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:57:20.553768 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86902cd8-fabd-49b1-b79e-818f34869c4f None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:57:20.564506 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86902cd8-fabd-49b1-b79e-818f34869c4f None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:57:20.568195 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242ec2b-92b4-4307-809d-c5a22f686913 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a6cffa8af470388d4b063c3c49849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:57:20.568819 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242ec2b-92b4-4307-809d-c5a22f686913 service glance] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:20.569082 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242ec2b-92b4-4307-809d-c5a22f686913 service glance] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:20.569345 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242ec2b-92b4-4307-809d-c5a22f686913 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:20.578785 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e242ec2b-92b4-4307-809d-c5a22f686913 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:57:20.580452 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e242ec2b-92b4-4307-809d-c5a22f686913 service glance] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:57:20.590429 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 687/1399] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:57:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:57:21.005382 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ae211-d3ac-491b-84ea-68c64133a8ad None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:21.005659 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ae211-d3ac-491b-84ea-68c64133a8ad None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:21.005925 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ae211-d3ac-491b-84ea-68c64133a8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:21.054088 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-700ae211-d3ac-491b-84ea-68c64133a8ad None None] MFA Rules not processed for user `83115653901749f6ade6638593fb54e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:57:21.055299 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-700ae211-d3ac-491b-84ea-68c64133a8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:57:21.117466 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 713/1400] 10.222.0.32 () {58 vars in 1009 bytes} [Tue Apr 12 02:57:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:57:21.159388 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fc5c8-a274-4ae0-ab3c-cac293691a48 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:21.159767 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fc5c8-a274-4ae0-ab3c-cac293691a48 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:21.160058 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fc5c8-a274-4ae0-ab3c-cac293691a48 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:21.161431 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 688/1401] 10.222.0.32 () {54 vars in 942 bytes} [Tue Apr 12 02:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:57:21.167466 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb9ffc-7f1c-4279-a93c-ddc8809bf6b1 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:21.167762 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb9ffc-7f1c-4279-a93c-ddc8809bf6b1 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:21.168048 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb9ffc-7f1c-4279-a93c-ddc8809bf6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:21.217903 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-c2bb9ffc-7f1c-4279-a93c-ddc8809bf6b1 None None] MFA Rules not processed for user `8e8d78f92f12405fb746ddeb2579bd2e`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:57:21.219052 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-c2bb9ffc-7f1c-4279-a93c-ddc8809bf6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:57:21.292258 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 714/1402] 10.222.0.32 () {58 vars in 1039 bytes} [Tue Apr 12 02:57:21 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:57:21.300907 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fc5c8-a274-4ae0-ab3c-cac293691a48 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:57:21.314856 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fc5c8-a274-4ae0-ab3c-cac293691a48 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:57:21.320156 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463177cb-4483-46d4-be6f-6fe3fcfc412d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e8d78f92f12405fb746ddeb2579bd2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:57:21.320799 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463177cb-4483-46d4-be6f-6fe3fcfc412d service swift] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:21.321076 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463177cb-4483-46d4-be6f-6fe3fcfc412d service swift] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:21.321342 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463177cb-4483-46d4-be6f-6fe3fcfc412d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:21.330109 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463177cb-4483-46d4-be6f-6fe3fcfc412d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:57:21.331685 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463177cb-4483-46d4-be6f-6fe3fcfc412d service swift] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:57:21.339661 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 689/1403] 10.222.0.32 () {60 vars in 1384 bytes} [Tue Apr 12 02:57:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 02:57:21.889834 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cfc0e-6f22-4853-85ce-28e3f59f7e94 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:21.890386 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cfc0e-6f22-4853-85ce-28e3f59f7e94 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:21.890386 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cfc0e-6f22-4853-85ce-28e3f59f7e94 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:21.891917 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 715/1404] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:57:21.897401 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2ab1d-3608-47c6-a38a-07f0d751d1bb None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:21.898306 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2ab1d-3608-47c6-a38a-07f0d751d1bb None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:21.900945 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2ab1d-3608-47c6-a38a-07f0d751d1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:21.921262 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-aca2ab1d-3608-47c6-a38a-07f0d751d1bb None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:57:21.922792 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-aca2ab1d-3608-47c6-a38a-07f0d751d1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:57:21.936483 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 690/1405] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:57:21.978822 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2cfc0e-6f22-4853-85ce-28e3f59f7e94 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:57:21.997844 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2cfc0e-6f22-4853-85ce-28e3f59f7e94 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:57:22.005743 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d1ddb-2ae5-44bd-b67f-78bd982f3b24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:57:22.006681 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d1ddb-2ae5-44bd-b67f-78bd982f3b24 service nova] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:22.006952 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d1ddb-2ae5-44bd-b67f-78bd982f3b24 service nova] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:22.007216 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d1ddb-2ae5-44bd-b67f-78bd982f3b24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:22.016309 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d1ddb-2ae5-44bd-b67f-78bd982f3b24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:57:22.017934 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d1ddb-2ae5-44bd-b67f-78bd982f3b24 service nova] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:57:22.033202 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 716/1406] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:57:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:57:24.473206 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e50508-81c2-4528-a7b6-78ecab3e0c66 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:24.473777 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e50508-81c2-4528-a7b6-78ecab3e0c66 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:24.473777 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e50508-81c2-4528-a7b6-78ecab3e0c66 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:24.475078 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 691/1407] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:57:24.480220 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748a2f1-a845-4957-af13-870b2b4c7466 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:24.480978 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748a2f1-a845-4957-af13-870b2b4c7466 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:24.481426 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748a2f1-a845-4957-af13-870b2b4c7466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:24.500367 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-6748a2f1-a845-4957-af13-870b2b4c7466 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:57:24.501571 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-6748a2f1-a845-4957-af13-870b2b4c7466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:57:24.509852 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 717/1408] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 02:57:24.555435 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e50508-81c2-4528-a7b6-78ecab3e0c66 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:57:24.570144 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e50508-81c2-4528-a7b6-78ecab3e0c66 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:57:24.575579 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2151499-322c-4764-a8f0-ea603f034bfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:57:24.576329 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2151499-322c-4764-a8f0-ea603f034bfb service nova] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:24.576661 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2151499-322c-4764-a8f0-ea603f034bfb service nova] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:24.577306 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2151499-322c-4764-a8f0-ea603f034bfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:24.585674 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2151499-322c-4764-a8f0-ea603f034bfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:57:24.587339 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2151499-322c-4764-a8f0-ea603f034bfb service nova] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:57:24.598820 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 692/1409] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:57:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:57:44.352733 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064adcee-466f-42fc-8331-d769bd188610 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:44.353345 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064adcee-466f-42fc-8331-d769bd188610 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:44.353345 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064adcee-466f-42fc-8331-d769bd188610 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:44.354557 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 718/1410] 10.222.0.32 () {54 vars in 918 bytes} [Tue Apr 12 02:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:57:44.361134 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21159e6-ea40-4f82-bb39-466879369d19 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:44.361887 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21159e6-ea40-4f82-bb39-466879369d19 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:44.361887 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21159e6-ea40-4f82-bb39-466879369d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:44.384899 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-d21159e6-ea40-4f82-bb39-466879369d19 None None] MFA Rules not processed for user `c2a88ae51543497382d34573afc2bde3`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:57:44.386070 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-d21159e6-ea40-4f82-bb39-466879369d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:57:44.395919 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 693/1411] 10.222.0.32 () {58 vars in 1015 bytes} [Tue Apr 12 02:57:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:57:44.410930 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd61918-68a5-45e6-8b56-91a055c8efe0 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:44.411206 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd61918-68a5-45e6-8b56-91a055c8efe0 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:44.411475 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd61918-68a5-45e6-8b56-91a055c8efe0 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:44.412877 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 719/1412] 10.222.0.32 () {54 vars in 918 bytes} [Tue Apr 12 02:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:57:44.417573 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbcd98-ff63-4468-9ef7-012e86bd99a3 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:44.417859 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbcd98-ff63-4468-9ef7-012e86bd99a3 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:44.418127 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbcd98-ff63-4468-9ef7-012e86bd99a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:44.436491 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-45bbcd98-ff63-4468-9ef7-012e86bd99a3 None None] MFA Rules not processed for user `43ee5cb310fd4538910e40ea7082708c`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:57:44.437631 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-45bbcd98-ff63-4468-9ef7-012e86bd99a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:57:44.450498 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 694/1413] 10.222.0.32 () {58 vars in 1015 bytes} [Tue Apr 12 02:57:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:57:47.253026 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e954f45-5295-42b2-8fdb-21196124a8a0 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:47.253627 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e954f45-5295-42b2-8fdb-21196124a8a0 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:47.253627 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e954f45-5295-42b2-8fdb-21196124a8a0 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:47.254992 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 720/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 02:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:57:47.261712 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34ff90-a125-49b7-bfcf-d12b200b6e76 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:47.262497 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34ff90-a125-49b7-bfcf-d12b200b6e76 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:47.262670 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34ff90-a125-49b7-bfcf-d12b200b6e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:47.282706 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-fb34ff90-a125-49b7-bfcf-d12b200b6e76 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:57:47.283931 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-fb34ff90-a125-49b7-bfcf-d12b200b6e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:57:47.292528 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 695/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 02:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:57:47.336994 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e954f45-5295-42b2-8fdb-21196124a8a0 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:57:47.352447 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e954f45-5295-42b2-8fdb-21196124a8a0 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:57:47.357969 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160539dd-e2b2-4841-9471-b2f314b3a572 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:57:47.358681 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160539dd-e2b2-4841-9471-b2f314b3a572 service nova] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:47.358942 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160539dd-e2b2-4841-9471-b2f314b3a572 service nova] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:47.359213 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160539dd-e2b2-4841-9471-b2f314b3a572 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:47.367446 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160539dd-e2b2-4841-9471-b2f314b3a572 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:57:47.369096 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160539dd-e2b2-4841-9471-b2f314b3a572 service nova] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:57:47.378575 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 721/1416] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:57:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:57:48.728183 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215edf5e-af35-40d4-9707-bf9e1ec68137 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:48.728794 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215edf5e-af35-40d4-9707-bf9e1ec68137 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:48.728794 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215edf5e-af35-40d4-9707-bf9e1ec68137 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:48.730091 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 696/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 02:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:57:48.736282 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df806ed-1cbb-4378-997b-f614bf7e1a9f None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:48.736739 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df806ed-1cbb-4378-997b-f614bf7e1a9f None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:48.736932 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df806ed-1cbb-4378-997b-f614bf7e1a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:48.756892 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-3df806ed-1cbb-4378-997b-f614bf7e1a9f None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:57:48.758063 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-3df806ed-1cbb-4378-997b-f614bf7e1a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:57:48.766073 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 722/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 02:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:57:48.927126 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215edf5e-af35-40d4-9707-bf9e1ec68137 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:57:48.942621 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215edf5e-af35-40d4-9707-bf9e1ec68137 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:57:48.948849 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9727be6-f9c4-4766-93a0-d4387a48b5a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:57:48.949473 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9727be6-f9c4-4766-93a0-d4387a48b5a9 service nova] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:48.949743 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9727be6-f9c4-4766-93a0-d4387a48b5a9 service nova] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:48.950009 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9727be6-f9c4-4766-93a0-d4387a48b5a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:48.959159 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9727be6-f9c4-4766-93a0-d4387a48b5a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:57:48.960796 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9727be6-f9c4-4766-93a0-d4387a48b5a9 service nova] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:57:48.970421 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 697/1419] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:57:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:57:50.302919 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928451b0-6ef6-43dd-b003-28bce5156a58 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:50.303708 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928451b0-6ef6-43dd-b003-28bce5156a58 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:50.303708 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928451b0-6ef6-43dd-b003-28bce5156a58 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:50.305637 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 723/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 02:57:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:57:50.313901 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4deb6-91b1-4c70-9e50-41b5b17dfcd9 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:50.314403 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4deb6-91b1-4c70-9e50-41b5b17dfcd9 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:50.314499 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4deb6-91b1-4c70-9e50-41b5b17dfcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:50.335811 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-fbd4deb6-91b1-4c70-9e50-41b5b17dfcd9 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:57:50.336880 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-fbd4deb6-91b1-4c70-9e50-41b5b17dfcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:57:50.345146 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 698/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 02:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:57:50.514182 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928451b0-6ef6-43dd-b003-28bce5156a58 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:57:50.536104 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928451b0-6ef6-43dd-b003-28bce5156a58 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:57:50.543153 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0a510-0794-48fb-af9a-bfa3a677492b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:57:50.543818 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0a510-0794-48fb-af9a-bfa3a677492b service nova] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:50.544119 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0a510-0794-48fb-af9a-bfa3a677492b service nova] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:50.544382 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0a510-0794-48fb-af9a-bfa3a677492b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:50.552883 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0a510-0794-48fb-af9a-bfa3a677492b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:57:50.554463 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0a510-0794-48fb-af9a-bfa3a677492b service nova] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:57:50.564632 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 724/1422] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:57:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:57:51.858240 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fa2f0-1035-470d-b603-f2f2a5d50805 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:51.858787 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fa2f0-1035-470d-b603-f2f2a5d50805 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:51.858787 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fa2f0-1035-470d-b603-f2f2a5d50805 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:51.860070 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 699/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 02:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:57:51.866239 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e0f36-f271-4497-9183-c5d83ced8230 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:51.866661 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e0f36-f271-4497-9183-c5d83ced8230 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:51.866790 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e0f36-f271-4497-9183-c5d83ced8230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:51.890330 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-b15e0f36-f271-4497-9183-c5d83ced8230 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:57:51.891637 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-b15e0f36-f271-4497-9183-c5d83ced8230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:57:51.901075 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 725/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 02:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:57:52.064879 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fa2f0-1035-470d-b603-f2f2a5d50805 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:57:52.087324 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fa2f0-1035-470d-b603-f2f2a5d50805 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:57:52.096325 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b4148-e524-44b9-a2ea-87fe40fddc5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:57:52.096959 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b4148-e524-44b9-a2ea-87fe40fddc5f service nova] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:52.097228 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b4148-e524-44b9-a2ea-87fe40fddc5f service nova] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:52.097493 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b4148-e524-44b9-a2ea-87fe40fddc5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:52.106199 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b4148-e524-44b9-a2ea-87fe40fddc5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:57:52.107809 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b4148-e524-44b9-a2ea-87fe40fddc5f service nova] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:57:52.117893 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 700/1425] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:57:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:57:53.398894 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda388c-2feb-4f03-9dfc-dfd4c8c5a995 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:53.399494 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda388c-2feb-4f03-9dfc-dfd4c8c5a995 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:53.399494 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda388c-2feb-4f03-9dfc-dfd4c8c5a995 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:53.400846 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 726/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 02:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:57:53.406888 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af25d9d-80d2-45db-8995-822613bf0f87 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:53.407746 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af25d9d-80d2-45db-8995-822613bf0f87 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:53.407746 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af25d9d-80d2-45db-8995-822613bf0f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:53.432495 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-7af25d9d-80d2-45db-8995-822613bf0f87 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:57:53.434033 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-7af25d9d-80d2-45db-8995-822613bf0f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:57:53.444130 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 701/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 02:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:57:53.592377 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda388c-2feb-4f03-9dfc-dfd4c8c5a995 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:57:53.610898 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda388c-2feb-4f03-9dfc-dfd4c8c5a995 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:57:53.618107 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee483e-ed05-479d-a074-f485907692fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:57:53.618731 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee483e-ed05-479d-a074-f485907692fb service nova] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:53.618997 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee483e-ed05-479d-a074-f485907692fb service nova] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:53.619223 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee483e-ed05-479d-a074-f485907692fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:53.628202 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee483e-ed05-479d-a074-f485907692fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:57:53.629798 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee483e-ed05-479d-a074-f485907692fb service nova] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:57:53.639017 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 727/1428] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:57:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:57:54.863409 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82432f34-8c69-4146-ab1d-3a6322be8f49 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:54.863975 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82432f34-8c69-4146-ab1d-3a6322be8f49 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:54.863975 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82432f34-8c69-4146-ab1d-3a6322be8f49 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:54.865200 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 702/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 02:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:57:54.871420 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97073a36-bc58-4e64-bdbb-d8c4dd0d7007 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:54.871892 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97073a36-bc58-4e64-bdbb-d8c4dd0d7007 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:54.871990 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97073a36-bc58-4e64-bdbb-d8c4dd0d7007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:54.892432 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-97073a36-bc58-4e64-bdbb-d8c4dd0d7007 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:57:54.893630 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-97073a36-bc58-4e64-bdbb-d8c4dd0d7007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:57:54.902790 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 728/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 02:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:57:55.050150 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82432f34-8c69-4146-ab1d-3a6322be8f49 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:57:55.067637 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82432f34-8c69-4146-ab1d-3a6322be8f49 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:57:55.075321 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854b0fb-2e5e-44ef-a2fc-e3e48f76b16d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:57:55.075986 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854b0fb-2e5e-44ef-a2fc-e3e48f76b16d service nova] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:55.076259 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854b0fb-2e5e-44ef-a2fc-e3e48f76b16d service nova] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:55.076528 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854b0fb-2e5e-44ef-a2fc-e3e48f76b16d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:55.086071 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854b0fb-2e5e-44ef-a2fc-e3e48f76b16d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:57:55.087705 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854b0fb-2e5e-44ef-a2fc-e3e48f76b16d service nova] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:57:55.097599 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 703/1431] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:57:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:57:56.354438 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3680305-7a28-4f74-9036-c43d8964892f None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:56.355261 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3680305-7a28-4f74-9036-c43d8964892f None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:56.355261 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3680305-7a28-4f74-9036-c43d8964892f None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:56.357290 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 729/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 02:57:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:57:56.362404 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd08b9-67c5-4a27-b9eb-8bab3a200fe3 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:56.362862 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd08b9-67c5-4a27-b9eb-8bab3a200fe3 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:56.363092 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd08b9-67c5-4a27-b9eb-8bab3a200fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:56.388867 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-d8bd08b9-67c5-4a27-b9eb-8bab3a200fe3 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:57:56.390054 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-d8bd08b9-67c5-4a27-b9eb-8bab3a200fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:57:56.399098 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 704/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 02:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:57:56.551690 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3680305-7a28-4f74-9036-c43d8964892f None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:57:56.572680 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3680305-7a28-4f74-9036-c43d8964892f None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:57:56.580320 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7be869-fcbe-4aa2-9d37-b9788846a81c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:57:56.580951 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7be869-fcbe-4aa2-9d37-b9788846a81c service nova] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:56.581216 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7be869-fcbe-4aa2-9d37-b9788846a81c service nova] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:56.581471 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7be869-fcbe-4aa2-9d37-b9788846a81c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:56.590210 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7be869-fcbe-4aa2-9d37-b9788846a81c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:57:56.591782 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7be869-fcbe-4aa2-9d37-b9788846a81c service nova] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:57:56.602116 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 730/1434] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:57:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:57:57.867591 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047b065-bab0-4842-8469-58b0ab1762bd None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:57.868484 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047b065-bab0-4842-8469-58b0ab1762bd None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:57.868484 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047b065-bab0-4842-8469-58b0ab1762bd None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:57.870538 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 705/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 02:57:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:57:57.876790 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd2771-bfb3-4d5d-bce2-1c65aea50104 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:57.877221 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd2771-bfb3-4d5d-bce2-1c65aea50104 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:57.877334 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd2771-bfb3-4d5d-bce2-1c65aea50104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:57.896982 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-12dd2771-bfb3-4d5d-bce2-1c65aea50104 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:57:57.898170 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-12dd2771-bfb3-4d5d-bce2-1c65aea50104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:57:57.907146 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 731/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 02:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:57:58.079953 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047b065-bab0-4842-8469-58b0ab1762bd None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:57:58.101588 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047b065-bab0-4842-8469-58b0ab1762bd None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:57:58.108563 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603e8bc-f985-4aee-8b4d-f62159297381 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:57:58.109204 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603e8bc-f985-4aee-8b4d-f62159297381 service nova] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:58.109477 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603e8bc-f985-4aee-8b4d-f62159297381 service nova] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:58.109744 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603e8bc-f985-4aee-8b4d-f62159297381 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:58.118467 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e603e8bc-f985-4aee-8b4d-f62159297381 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:57:58.120108 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e603e8bc-f985-4aee-8b4d-f62159297381 service nova] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:57:58.130011 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 706/1437] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:57:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:57:59.391884 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8dd44-11a1-4ac8-9a46-8761ad449f66 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:59.392487 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8dd44-11a1-4ac8-9a46-8761ad449f66 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:59.392487 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8dd44-11a1-4ac8-9a46-8761ad449f66 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:59.393844 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 732/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 02:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:57:59.400118 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433a011-5fa8-48c5-8057-74e36ef0a467 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:59.400891 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433a011-5fa8-48c5-8057-74e36ef0a467 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:59.401058 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433a011-5fa8-48c5-8057-74e36ef0a467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:59.423373 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-7433a011-5fa8-48c5-8057-74e36ef0a467 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:57:59.424594 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-7433a011-5fa8-48c5-8057-74e36ef0a467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:57:59.433410 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 707/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 02:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:57:59.596449 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8dd44-11a1-4ac8-9a46-8761ad449f66 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:57:59.612007 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8dd44-11a1-4ac8-9a46-8761ad449f66 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:57:59.618131 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04cd66d-12e6-4d7f-b324-ba724d725321 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:57:59.618764 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cd66d-12e6-4d7f-b324-ba724d725321 service nova] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:57:59.619039 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cd66d-12e6-4d7f-b324-ba724d725321 service nova] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:57:59.619296 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cd66d-12e6-4d7f-b324-ba724d725321 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:57:59.627696 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04cd66d-12e6-4d7f-b324-ba724d725321 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:57:59.629292 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04cd66d-12e6-4d7f-b324-ba724d725321 service nova] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:57:59.638530 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 733/1440] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:57:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:58:01.907646 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164785d6-57c8-4441-aec1-7dbb2ad49af1 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:58:01.908539 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164785d6-57c8-4441-aec1-7dbb2ad49af1 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:58:01.908539 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164785d6-57c8-4441-aec1-7dbb2ad49af1 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:58:01.910721 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 708/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 02:58:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:58:01.917378 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b96e4b-7b75-4170-93b9-27e2432ee2aa None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:58:01.917857 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b96e4b-7b75-4170-93b9-27e2432ee2aa None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:58:01.917966 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b96e4b-7b75-4170-93b9-27e2432ee2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:58:01.945930 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-c5b96e4b-7b75-4170-93b9-27e2432ee2aa None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:58:01.947120 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-c5b96e4b-7b75-4170-93b9-27e2432ee2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:58:01.957572 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 734/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 02:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:58:02.001504 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164785d6-57c8-4441-aec1-7dbb2ad49af1 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:58:02.018879 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164785d6-57c8-4441-aec1-7dbb2ad49af1 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:58:02.023433 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6080db54-1e9b-41ec-bb10-567504c5ad55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:58:02.024143 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080db54-1e9b-41ec-bb10-567504c5ad55 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:58:02.024440 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080db54-1e9b-41ec-bb10-567504c5ad55 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:58:02.024726 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080db54-1e9b-41ec-bb10-567504c5ad55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:58:02.034768 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6080db54-1e9b-41ec-bb10-567504c5ad55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:58:02.036256 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6080db54-1e9b-41ec-bb10-567504c5ad55 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:58:02.047440 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 709/1443] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:58:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:58:04.539250 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a316a23-db93-4e5b-917a-515e0ddede8f None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:58:04.539902 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a316a23-db93-4e5b-917a-515e0ddede8f None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:58:04.539902 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a316a23-db93-4e5b-917a-515e0ddede8f None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:58:04.541166 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 735/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 02:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:58:04.547695 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629196e-7977-440f-a136-f46e7e7dcd24 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:58:04.548169 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629196e-7977-440f-a136-f46e7e7dcd24 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:58:04.548271 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629196e-7977-440f-a136-f46e7e7dcd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:58:04.566774 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-2629196e-7977-440f-a136-f46e7e7dcd24 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:58:04.567996 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-2629196e-7977-440f-a136-f46e7e7dcd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:58:04.577557 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 710/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 02:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:58:04.623916 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a316a23-db93-4e5b-917a-515e0ddede8f None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:58:04.636942 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a316a23-db93-4e5b-917a-515e0ddede8f None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:58:04.641191 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91219441-c993-4976-82be-e49eb0edbfaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:58:04.641776 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91219441-c993-4976-82be-e49eb0edbfaa service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:58:04.642054 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91219441-c993-4976-82be-e49eb0edbfaa service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:58:04.642351 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91219441-c993-4976-82be-e49eb0edbfaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:58:04.652401 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91219441-c993-4976-82be-e49eb0edbfaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:58:04.653920 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91219441-c993-4976-82be-e49eb0edbfaa service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:58:04.664274 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 736/1446] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:58:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:58:07.262445 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27161fdc-7d49-43ca-8676-40cde16e2ca2 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:58:07.263364 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27161fdc-7d49-43ca-8676-40cde16e2ca2 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:58:07.263364 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27161fdc-7d49-43ca-8676-40cde16e2ca2 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:58:07.265635 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 711/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 02:58:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:58:07.271537 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b14ee9-ae9d-4b28-a792-1dd3e8fb74da None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:58:07.272011 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b14ee9-ae9d-4b28-a792-1dd3e8fb74da None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:58:07.272240 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b14ee9-ae9d-4b28-a792-1dd3e8fb74da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:58:07.290859 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-98b14ee9-ae9d-4b28-a792-1dd3e8fb74da None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:58:07.292055 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-98b14ee9-ae9d-4b28-a792-1dd3e8fb74da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:58:07.300588 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 737/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 02:58:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:58:07.344102 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27161fdc-7d49-43ca-8676-40cde16e2ca2 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:58:07.361051 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27161fdc-7d49-43ca-8676-40cde16e2ca2 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:58:07.365130 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441bc70-1681-4b4b-a558-ddcfdb42dd07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:58:07.365763 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441bc70-1681-4b4b-a558-ddcfdb42dd07 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:58:07.366036 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441bc70-1681-4b4b-a558-ddcfdb42dd07 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:58:07.366301 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441bc70-1681-4b4b-a558-ddcfdb42dd07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:58:07.376612 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441bc70-1681-4b4b-a558-ddcfdb42dd07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:58:07.378138 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441bc70-1681-4b4b-a558-ddcfdb42dd07 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:58:07.387857 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 712/1449] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:58:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:58:09.780432 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35980680-f586-4322-95bb-d4cc2baead6c None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:58:09.781044 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35980680-f586-4322-95bb-d4cc2baead6c None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:58:09.781044 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35980680-f586-4322-95bb-d4cc2baead6c None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:58:09.782369 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 738/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 02:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:58:09.788426 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e02ae9-c85a-4d96-bb89-54e8b855b15d None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:58:09.789125 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e02ae9-c85a-4d96-bb89-54e8b855b15d None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:58:09.789251 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e02ae9-c85a-4d96-bb89-54e8b855b15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:58:09.810774 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-28e02ae9-c85a-4d96-bb89-54e8b855b15d None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:58:09.811977 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-28e02ae9-c85a-4d96-bb89-54e8b855b15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:58:09.821220 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 713/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 02:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:58:09.866757 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35980680-f586-4322-95bb-d4cc2baead6c None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:58:09.882210 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35980680-f586-4322-95bb-d4cc2baead6c None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:58:09.886718 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f7e54-af06-4086-ae94-bf05f1058cd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:58:09.887346 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f7e54-af06-4086-ae94-bf05f1058cd7 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:58:09.887616 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f7e54-af06-4086-ae94-bf05f1058cd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:58:09.887904 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f7e54-af06-4086-ae94-bf05f1058cd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:58:09.897475 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f7e54-af06-4086-ae94-bf05f1058cd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:58:09.898889 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f7e54-af06-4086-ae94-bf05f1058cd7 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:58:09.908519 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 739/1452] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:58:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:58:12.340048 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0130db4-cadf-4fbc-b2de-bbc1fe4827f7 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:58:12.340919 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0130db4-cadf-4fbc-b2de-bbc1fe4827f7 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:58:12.340919 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0130db4-cadf-4fbc-b2de-bbc1fe4827f7 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:58:12.343084 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 714/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 02:58:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:58:12.348864 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53382e-6754-407b-8a11-0eec3efc6014 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:58:12.349313 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53382e-6754-407b-8a11-0eec3efc6014 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:58:12.349313 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53382e-6754-407b-8a11-0eec3efc6014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:58:12.374412 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-0f53382e-6754-407b-8a11-0eec3efc6014 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:58:12.375683 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-0f53382e-6754-407b-8a11-0eec3efc6014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:58:12.385491 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 740/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 02:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:58:12.429756 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0130db4-cadf-4fbc-b2de-bbc1fe4827f7 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:58:12.445640 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0130db4-cadf-4fbc-b2de-bbc1fe4827f7 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:58:12.450124 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e45a2-068a-4ca6-bdf9-b4fcb28de27d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:58:12.450769 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e45a2-068a-4ca6-bdf9-b4fcb28de27d service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:58:12.451038 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e45a2-068a-4ca6-bdf9-b4fcb28de27d service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:58:12.451307 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e45a2-068a-4ca6-bdf9-b4fcb28de27d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:58:12.461046 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e45a2-068a-4ca6-bdf9-b4fcb28de27d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:58:12.462493 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e45a2-068a-4ca6-bdf9-b4fcb28de27d service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:58:12.472231 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 715/1455] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:58:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:58:14.841183 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f79078-5579-4a14-ad6a-95bdfb6d63ae None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:58:14.841842 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f79078-5579-4a14-ad6a-95bdfb6d63ae None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:58:14.841842 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f79078-5579-4a14-ad6a-95bdfb6d63ae None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:58:14.843058 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 741/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 02:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:58:14.849731 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d1d8b-9f01-4c0e-ad06-c478af7c4ef3 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:58:14.850509 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d1d8b-9f01-4c0e-ad06-c478af7c4ef3 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:58:14.850682 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d1d8b-9f01-4c0e-ad06-c478af7c4ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:58:14.872310 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-418d1d8b-9f01-4c0e-ad06-c478af7c4ef3 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:58:14.873428 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-418d1d8b-9f01-4c0e-ad06-c478af7c4ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:58:14.882530 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 716/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 02:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:58:14.920981 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f79078-5579-4a14-ad6a-95bdfb6d63ae None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:58:14.933218 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f79078-5579-4a14-ad6a-95bdfb6d63ae None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:58:14.937318 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefc40f-5301-4d3a-8a36-42d52eb648a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:58:14.938110 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefc40f-5301-4d3a-8a36-42d52eb648a6 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:58:14.938542 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefc40f-5301-4d3a-8a36-42d52eb648a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:58:14.938967 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefc40f-5301-4d3a-8a36-42d52eb648a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:58:14.948599 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceefc40f-5301-4d3a-8a36-42d52eb648a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:58:14.950026 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceefc40f-5301-4d3a-8a36-42d52eb648a6 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:58:14.960009 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 742/1458] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:58:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:58:17.294827 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee15d36-a09e-4970-b462-f43596426a5a None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:58:17.295496 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee15d36-a09e-4970-b462-f43596426a5a None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:58:17.295496 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee15d36-a09e-4970-b462-f43596426a5a None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:58:17.297540 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 717/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 02:58:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:58:17.304096 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccbaeb-9842-4237-922f-f5f97d0f7e58 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:58:17.304562 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccbaeb-9842-4237-922f-f5f97d0f7e58 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:58:17.304709 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccbaeb-9842-4237-922f-f5f97d0f7e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:58:17.330458 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-70ccbaeb-9842-4237-922f-f5f97d0f7e58 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:58:17.331649 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-70ccbaeb-9842-4237-922f-f5f97d0f7e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:58:17.341026 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 743/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 02:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:58:17.382085 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee15d36-a09e-4970-b462-f43596426a5a None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:58:17.393997 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee15d36-a09e-4970-b462-f43596426a5a None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:58:17.398030 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3e0e9-0717-4afc-b378-3f1d82706323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:58:17.398665 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3e0e9-0717-4afc-b378-3f1d82706323 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:58:17.398939 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3e0e9-0717-4afc-b378-3f1d82706323 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:58:17.399206 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3e0e9-0717-4afc-b378-3f1d82706323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:58:17.408702 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced3e0e9-0717-4afc-b378-3f1d82706323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:58:17.410143 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced3e0e9-0717-4afc-b378-3f1d82706323 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:58:17.419641 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 718/1461] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:58:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:58:19.831159 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104be32-5894-4547-9e11-94e1c5a99ee4 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:58:19.832086 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104be32-5894-4547-9e11-94e1c5a99ee4 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:58:19.832086 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104be32-5894-4547-9e11-94e1c5a99ee4 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:58:19.834222 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 744/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 02:58:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:58:19.842825 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384964c6-728e-4153-bfc9-7cdddf81aaf0 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:58:19.843259 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384964c6-728e-4153-bfc9-7cdddf81aaf0 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:58:19.843366 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384964c6-728e-4153-bfc9-7cdddf81aaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:58:19.862745 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-384964c6-728e-4153-bfc9-7cdddf81aaf0 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:58:19.863911 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-384964c6-728e-4153-bfc9-7cdddf81aaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:58:19.872747 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 719/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 02:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:58:19.914933 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104be32-5894-4547-9e11-94e1c5a99ee4 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:58:19.933299 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104be32-5894-4547-9e11-94e1c5a99ee4 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:58:19.939085 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74a38b-4314-4d9c-b76e-49df7e2959dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:58:19.939736 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74a38b-4314-4d9c-b76e-49df7e2959dc service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:58:19.940024 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74a38b-4314-4d9c-b76e-49df7e2959dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:58:19.940290 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74a38b-4314-4d9c-b76e-49df7e2959dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:58:19.954202 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a74a38b-4314-4d9c-b76e-49df7e2959dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:58:19.955639 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a74a38b-4314-4d9c-b76e-49df7e2959dc service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:58:19.969850 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 745/1464] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:58:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:58:22.279831 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d02d7-f07f-4a25-8c34-30d6a8f145e4 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:58:22.280722 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d02d7-f07f-4a25-8c34-30d6a8f145e4 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:58:22.281425 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d02d7-f07f-4a25-8c34-30d6a8f145e4 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:58:22.285279 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 720/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 02:58:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:58:22.293400 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0748a-5203-445a-b06d-596fbdb48a5a None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:58:22.293833 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0748a-5203-445a-b06d-596fbdb48a5a None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:58:22.293942 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0748a-5203-445a-b06d-596fbdb48a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:58:22.312114 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-c7c0748a-5203-445a-b06d-596fbdb48a5a None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:58:22.313322 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-c7c0748a-5203-445a-b06d-596fbdb48a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:58:22.321655 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 746/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 02:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 02:58:22.358870 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d02d7-f07f-4a25-8c34-30d6a8f145e4 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:58:22.371360 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d02d7-f07f-4a25-8c34-30d6a8f145e4 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:58:22.375749 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80872a45-6ef9-49c2-8ee3-272b6a7c3477 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:58:22.376411 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80872a45-6ef9-49c2-8ee3-272b6a7c3477 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:58:22.376688 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80872a45-6ef9-49c2-8ee3-272b6a7c3477 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:58:22.376958 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80872a45-6ef9-49c2-8ee3-272b6a7c3477 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:58:22.387261 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80872a45-6ef9-49c2-8ee3-272b6a7c3477 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:58:22.388785 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80872a45-6ef9-49c2-8ee3-272b6a7c3477 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:58:22.398688 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 721/1467] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:58:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:58:24.705000 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc20a10-28a9-499c-93df-a31b6617363a None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:58:24.705877 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc20a10-28a9-499c-93df-a31b6617363a None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:58:24.705877 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc20a10-28a9-499c-93df-a31b6617363a None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:58:24.708169 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 747/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 02:58:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:58:24.717201 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a08ccf-a5a6-4468-8e43-b844dc78746d None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:58:24.717890 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a08ccf-a5a6-4468-8e43-b844dc78746d None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:58:24.718153 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a08ccf-a5a6-4468-8e43-b844dc78746d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:58:24.743914 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-f5a08ccf-a5a6-4468-8e43-b844dc78746d None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:58:24.745107 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-f5a08ccf-a5a6-4468-8e43-b844dc78746d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:58:24.754046 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 722/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 02:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:58:24.792559 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc20a10-28a9-499c-93df-a31b6617363a None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:58:24.805057 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc20a10-28a9-499c-93df-a31b6617363a None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:58:24.809469 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0fda9-aa9b-4926-b14b-7f69fa113399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:58:24.810101 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0fda9-aa9b-4926-b14b-7f69fa113399 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:58:24.810370 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0fda9-aa9b-4926-b14b-7f69fa113399 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:58:24.810623 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0fda9-aa9b-4926-b14b-7f69fa113399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:58:24.819814 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0fda9-aa9b-4926-b14b-7f69fa113399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:58:24.821251 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0fda9-aa9b-4926-b14b-7f69fa113399 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:58:24.830963 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 748/1470] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:58:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:58:58.906066 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac2db3-e8b3-4ae8-8e3c-961455d42c76 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:58:58.906954 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac2db3-e8b3-4ae8-8e3c-961455d42c76 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:58:58.906954 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac2db3-e8b3-4ae8-8e3c-961455d42c76 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:58:58.908978 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 723/1471] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:58:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 02:58:58.915274 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a8550-a6d9-4018-ba2f-7adc1e28d156 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:58:58.915767 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a8550-a6d9-4018-ba2f-7adc1e28d156 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:58:58.915878 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a8550-a6d9-4018-ba2f-7adc1e28d156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:58:58.942827 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-a50a8550-a6d9-4018-ba2f-7adc1e28d156 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:58:58.944037 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-a50a8550-a6d9-4018-ba2f-7adc1e28d156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:58:58.953972 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 749/1472] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:58:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:58:59.002025 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05130836-9a7f-4531-b02a-8d2d5906b093 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:58:59.002433 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05130836-9a7f-4531-b02a-8d2d5906b093 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:58:59.002843 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05130836-9a7f-4531-b02a-8d2d5906b093 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:58:59.005082 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 724/1473] 10.222.0.32 () {54 vars in 961 bytes} [Tue Apr 12 02:58:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:58:59.010103 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5b59d-4141-41b7-9e2d-c102bd12adae None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:58:59.010417 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5b59d-4141-41b7-9e2d-c102bd12adae None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:58:59.010677 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5b59d-4141-41b7-9e2d-c102bd12adae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:58:59.029629 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-95d5b59d-4141-41b7-9e2d-c102bd12adae None None] MFA Rules not processed for user `828a6cffa8af470388d4b063c3c49849`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:58:59.030802 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-95d5b59d-4141-41b7-9e2d-c102bd12adae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:58:59.037585 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 750/1474] 10.222.0.32 () {58 vars in 1058 bytes} [Tue Apr 12 02:58:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 02:58:59.044713 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05130836-9a7f-4531-b02a-8d2d5906b093 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:58:59.059188 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05130836-9a7f-4531-b02a-8d2d5906b093 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:58:59.064868 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d707d-fe9c-4346-b7ad-020ca5959dcf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a6cffa8af470388d4b063c3c49849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:58:59.065512 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d707d-fe9c-4346-b7ad-020ca5959dcf service glance] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:58:59.065785 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d707d-fe9c-4346-b7ad-020ca5959dcf service glance] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:58:59.066049 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d707d-fe9c-4346-b7ad-020ca5959dcf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:58:59.079316 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d707d-fe9c-4346-b7ad-020ca5959dcf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:58:59.080801 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d707d-fe9c-4346-b7ad-020ca5959dcf service glance] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:58:59.090831 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 725/1475] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:58:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:59:01.486536 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d9cbd-f6d5-4c17-ab71-08ec03043638 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:59:01.487124 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d9cbd-f6d5-4c17-ab71-08ec03043638 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:59:01.487124 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d9cbd-f6d5-4c17-ab71-08ec03043638 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:59:01.488520 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 751/1476] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:59:01.494874 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24aea68-9c6e-46e3-908e-2ec4ae17d7f4 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:59:01.495645 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24aea68-9c6e-46e3-908e-2ec4ae17d7f4 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:59:01.495803 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24aea68-9c6e-46e3-908e-2ec4ae17d7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:59:01.520248 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-c24aea68-9c6e-46e3-908e-2ec4ae17d7f4 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:59:01.521448 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-c24aea68-9c6e-46e3-908e-2ec4ae17d7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:59:01.529663 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 726/1477] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:59:01.553070 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d9cbd-f6d5-4c17-ab71-08ec03043638 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:59:01.566543 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d9cbd-f6d5-4c17-ab71-08ec03043638 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:59:01.571481 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3c505-5b68-4472-97dd-8ff2d7cc58e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:59:01.572156 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3c505-5b68-4472-97dd-8ff2d7cc58e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:59:01.572429 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3c505-5b68-4472-97dd-8ff2d7cc58e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:59:01.572697 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3c505-5b68-4472-97dd-8ff2d7cc58e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:59:01.573425 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3c505-5b68-4472-97dd-8ff2d7cc58e3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:59:01.575186 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING py.warnings [None req-71a3c505-5b68-4472-97dd-8ff2d7cc58e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 02:59:01.575186 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: warnings.warn(msg) Apr 12 02:59:01.575186 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: Apr 12 02:59:01.576659 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3c505-5b68-4472-97dd-8ff2d7cc58e3 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:59:01.598608 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 752/1478] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 02:59:01 2022] GET /identity/v3/projects => generated 2553 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 02:59:03.906664 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b86917-aeac-4017-8079-597054574ab7 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:59:03.907513 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b86917-aeac-4017-8079-597054574ab7 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:59:03.907513 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b86917-aeac-4017-8079-597054574ab7 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:59:03.909496 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 727/1479] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:59:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:59:03.918439 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f44de-c045-4046-a219-40ad9817d3fe None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:59:03.918874 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f44de-c045-4046-a219-40ad9817d3fe None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:59:03.919004 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f44de-c045-4046-a219-40ad9817d3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:59:03.944449 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-879f44de-c045-4046-a219-40ad9817d3fe None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:59:03.945627 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-879f44de-c045-4046-a219-40ad9817d3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:59:03.955291 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 753/1480] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:59:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:59:04.000878 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b86917-aeac-4017-8079-597054574ab7 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:59:04.024955 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b86917-aeac-4017-8079-597054574ab7 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:59:04.033347 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ec079-d3ce-4197-b6cf-cdb26f03f7cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:59:04.034025 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ec079-d3ce-4197-b6cf-cdb26f03f7cb service nova] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:59:04.034334 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ec079-d3ce-4197-b6cf-cdb26f03f7cb service nova] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:59:04.034698 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ec079-d3ce-4197-b6cf-cdb26f03f7cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:59:04.042964 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ec079-d3ce-4197-b6cf-cdb26f03f7cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:59:04.044573 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ec079-d3ce-4197-b6cf-cdb26f03f7cb service nova] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:59:04.054065 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 728/1481] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:59:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:59:06.554859 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8166f-4b86-4835-938b-f7b0f0b4431b None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:59:06.555489 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8166f-4b86-4835-938b-f7b0f0b4431b None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:59:06.555489 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8166f-4b86-4835-938b-f7b0f0b4431b None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:59:06.556821 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 754/1482] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:59:06.563115 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618e5bd-e81d-4354-b35e-f0136ed066b2 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:59:06.563572 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618e5bd-e81d-4354-b35e-f0136ed066b2 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:59:06.563678 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618e5bd-e81d-4354-b35e-f0136ed066b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:59:06.586416 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-c618e5bd-e81d-4354-b35e-f0136ed066b2 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:59:06.587581 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-c618e5bd-e81d-4354-b35e-f0136ed066b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:59:06.599557 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 729/1483] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:59:06.632632 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8166f-4b86-4835-938b-f7b0f0b4431b None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:59:06.644577 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8166f-4b86-4835-938b-f7b0f0b4431b None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:59:06.648787 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75caeebb-3586-4d24-ae04-e95edf64c841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:59:06.649451 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75caeebb-3586-4d24-ae04-e95edf64c841 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:59:06.649710 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75caeebb-3586-4d24-ae04-e95edf64c841 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:59:06.649978 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75caeebb-3586-4d24-ae04-e95edf64c841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:59:06.659081 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75caeebb-3586-4d24-ae04-e95edf64c841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:59:06.660544 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75caeebb-3586-4d24-ae04-e95edf64c841 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:59:06.669678 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 755/1484] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:59:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:59:09.003340 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a879d-314e-413a-a3fa-a7ab76f25a5b None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:59:09.004288 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a879d-314e-413a-a3fa-a7ab76f25a5b None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:59:09.004288 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a879d-314e-413a-a3fa-a7ab76f25a5b None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:59:09.006442 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 730/1485] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:59:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:59:09.011922 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb705fee-7270-4e61-9dfe-261049692251 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:59:09.012372 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb705fee-7270-4e61-9dfe-261049692251 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:59:09.012482 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb705fee-7270-4e61-9dfe-261049692251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:59:09.037076 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-fb705fee-7270-4e61-9dfe-261049692251 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:59:09.038274 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-fb705fee-7270-4e61-9dfe-261049692251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:59:09.046908 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 756/1486] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:59:09.085827 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a879d-314e-413a-a3fa-a7ab76f25a5b None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:59:09.100659 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a879d-314e-413a-a3fa-a7ab76f25a5b None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:59:09.104977 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d89aef-e378-452f-8db3-945092378b6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:59:09.105615 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d89aef-e378-452f-8db3-945092378b6c service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:59:09.105889 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d89aef-e378-452f-8db3-945092378b6c service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:59:09.106153 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d89aef-e378-452f-8db3-945092378b6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:59:09.115669 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d89aef-e378-452f-8db3-945092378b6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:59:09.117159 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d89aef-e378-452f-8db3-945092378b6c service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:59:09.126903 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 731/1487] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:59:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:59:11.616451 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617a9aa-6297-462d-b4ab-1eaeb28a1438 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:59:11.617211 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617a9aa-6297-462d-b4ab-1eaeb28a1438 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:59:11.617484 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617a9aa-6297-462d-b4ab-1eaeb28a1438 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:59:11.619810 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 757/1488] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:59:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:59:11.627117 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de59b49-4f24-4ef5-90d3-49e4b9e0f06a None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:59:11.627552 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de59b49-4f24-4ef5-90d3-49e4b9e0f06a None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:59:11.627654 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de59b49-4f24-4ef5-90d3-49e4b9e0f06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:59:11.647105 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-9de59b49-4f24-4ef5-90d3-49e4b9e0f06a None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:59:11.648307 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-9de59b49-4f24-4ef5-90d3-49e4b9e0f06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:59:11.657209 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 732/1489] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 02:59:11.700791 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617a9aa-6297-462d-b4ab-1eaeb28a1438 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:59:11.719153 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617a9aa-6297-462d-b4ab-1eaeb28a1438 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:59:11.723407 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7c376-f0fb-40c1-9821-d55522a8b1d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:59:11.724101 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7c376-f0fb-40c1-9821-d55522a8b1d0 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:59:11.724372 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7c376-f0fb-40c1-9821-d55522a8b1d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:59:11.724639 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7c376-f0fb-40c1-9821-d55522a8b1d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:59:11.734493 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7c376-f0fb-40c1-9821-d55522a8b1d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:59:11.735967 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7c376-f0fb-40c1-9821-d55522a8b1d0 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:59:11.745765 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 758/1490] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:59:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 02:59:14.244846 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b98003-0e3c-41c4-aefe-3cf61af41fed None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:59:14.245442 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b98003-0e3c-41c4-aefe-3cf61af41fed None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:59:14.245442 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b98003-0e3c-41c4-aefe-3cf61af41fed None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:59:14.246760 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 733/1491] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 02:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 02:59:14.252197 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50eaba-2a76-4bf9-ac13-53a3a70e8253 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:59:14.252644 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50eaba-2a76-4bf9-ac13-53a3a70e8253 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:59:14.252750 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50eaba-2a76-4bf9-ac13-53a3a70e8253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:59:14.271565 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-5a50eaba-2a76-4bf9-ac13-53a3a70e8253 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 02:59:14.272774 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-5a50eaba-2a76-4bf9-ac13-53a3a70e8253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 02:59:14.281109 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 759/1492] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 02:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 02:59:14.321623 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b98003-0e3c-41c4-aefe-3cf61af41fed None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 02:59:14.334265 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b98003-0e3c-41c4-aefe-3cf61af41fed None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 02:59:14.338142 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6025f-b6f2-4852-a2fa-66566ce4cbf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 02:59:14.338775 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6025f-b6f2-4852-a2fa-66566ce4cbf2 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 02:59:14.339049 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6025f-b6f2-4852-a2fa-66566ce4cbf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 02:59:14.339317 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6025f-b6f2-4852-a2fa-66566ce4cbf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 02:59:14.348404 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c6025f-b6f2-4852-a2fa-66566ce4cbf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 02:59:14.349850 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c6025f-b6f2-4852-a2fa-66566ce4cbf2 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 02:59:14.359144 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 734/1493] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 02:59:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 03:01:05.218663 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f3b98-7cab-48f8-a0ed-78480d84ad52 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:01:05.219279 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f3b98-7cab-48f8-a0ed-78480d84ad52 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:01:05.219279 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f3b98-7cab-48f8-a0ed-78480d84ad52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:01:05.239021 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-368f3b98-7cab-48f8-a0ed-78480d84ad52 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:01:05.240210 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-368f3b98-7cab-48f8-a0ed-78480d84ad52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:01:05.249673 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 760/1494] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:01:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:01:05.261380 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa690d9-0523-4f22-9935-82683c86228f None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:01:05.261902 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa690d9-0523-4f22-9935-82683c86228f None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:01:05.262222 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa690d9-0523-4f22-9935-82683c86228f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:01:05.280495 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-2fa690d9-0523-4f22-9935-82683c86228f None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:01:05.281628 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-2fa690d9-0523-4f22-9935-82683c86228f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:01:05.289967 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 735/1495] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:01:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:01:05.294879 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f3b98-7cab-48f8-a0ed-78480d84ad52 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:01:05.304792 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f3b98-7cab-48f8-a0ed-78480d84ad52 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:01:05.310145 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a5fd0-d578-4833-9348-720a25fed3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:01:05.310794 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a5fd0-d578-4833-9348-720a25fed3b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:01:05.311069 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a5fd0-d578-4833-9348-720a25fed3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:01:05.311337 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a5fd0-d578-4833-9348-720a25fed3b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:01:05.312094 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a5fd0-d578-4833-9348-720a25fed3b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:01:05.312395 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a5fd0-d578-4833-9348-720a25fed3b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:01:05.313399 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING py.warnings [None req-332a5fd0-d578-4833-9348-720a25fed3b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 03:01:05.313399 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: warnings.warn(msg) Apr 12 03:01:05.313399 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: Apr 12 03:01:05.314276 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a5fd0-d578-4833-9348-720a25fed3b8 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:01:05.326812 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 761/1496] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 03:01:05.334970 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa690d9-0523-4f22-9935-82683c86228f None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:01:05.346706 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa690d9-0523-4f22-9935-82683c86228f None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:01:05.354294 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdbe29-31ed-49a8-b35d-abc1c2fe667c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:01:05.355219 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdbe29-31ed-49a8-b35d-abc1c2fe667c admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:01:05.355900 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdbe29-31ed-49a8-b35d-abc1c2fe667c admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:01:05.356227 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdbe29-31ed-49a8-b35d-abc1c2fe667c admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:01:05.357269 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebdbe29-31ed-49a8-b35d-abc1c2fe667c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:01:05.359624 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING py.warnings [None req-aebdbe29-31ed-49a8-b35d-abc1c2fe667c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 03:01:05.359624 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: warnings.warn(msg) Apr 12 03:01:05.359624 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: Apr 12 03:01:05.361263 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebdbe29-31ed-49a8-b35d-abc1c2fe667c admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:01:05.403515 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 736/1497] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:01:05 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:01:05.409297 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a5fd0-d578-4833-9348-720a25fed3b8 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:01:05.422001 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a5fd0-d578-4833-9348-720a25fed3b8 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:01:05.480094 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642626c-3161-4e5e-a8f6-264e383f6055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:01:05.480923 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642626c-3161-4e5e-a8f6-264e383f6055 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:01:05.481199 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642626c-3161-4e5e-a8f6-264e383f6055 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:01:05.481468 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642626c-3161-4e5e-a8f6-264e383f6055 admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:01:05.482165 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642626c-3161-4e5e-a8f6-264e383f6055 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:01:05.483177 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING py.warnings [None req-c642626c-3161-4e5e-a8f6-264e383f6055 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 03:01:05.483177 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: warnings.warn(msg) Apr 12 03:01:05.483177 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: Apr 12 03:01:05.484426 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642626c-3161-4e5e-a8f6-264e383f6055 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:01:05.504358 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 762/1498] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:01:05 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:01:05.510744 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdbe29-31ed-49a8-b35d-abc1c2fe667c admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:01:05.522910 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdbe29-31ed-49a8-b35d-abc1c2fe667c admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:01:05.528533 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e9191-fa50-4675-a24d-bd19d97ebabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:01:05.529192 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e9191-fa50-4675-a24d-bd19d97ebabc admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:01:05.529468 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e9191-fa50-4675-a24d-bd19d97ebabc admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:01:05.529738 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e9191-fa50-4675-a24d-bd19d97ebabc admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:01:05.530449 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e9191-fa50-4675-a24d-bd19d97ebabc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:01:05.531474 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING py.warnings [None req-f59e9191-fa50-4675-a24d-bd19d97ebabc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 03:01:05.531474 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: warnings.warn(msg) Apr 12 03:01:05.531474 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: Apr 12 03:01:05.532385 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e9191-fa50-4675-a24d-bd19d97ebabc admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:01:05.546007 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 737/1499] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:01:05.551937 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642626c-3161-4e5e-a8f6-264e383f6055 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:01:05.562034 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642626c-3161-4e5e-a8f6-264e383f6055 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:01:05.567344 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c43a5-7b3a-426d-b4f9-21d43076cef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:01:05.568058 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c43a5-7b3a-426d-b4f9-21d43076cef6 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:01:05.568333 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c43a5-7b3a-426d-b4f9-21d43076cef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:01:05.568602 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c43a5-7b3a-426d-b4f9-21d43076cef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:01:05.569354 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c43a5-7b3a-426d-b4f9-21d43076cef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:01:05.570361 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING py.warnings [None req-294c43a5-7b3a-426d-b4f9-21d43076cef6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 03:01:05.570361 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: warnings.warn(msg) Apr 12 03:01:05.570361 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: Apr 12 03:01:05.571273 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c43a5-7b3a-426d-b4f9-21d43076cef6 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:01:05.585154 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 763/1500] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:01:05.589592 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e9191-fa50-4675-a24d-bd19d97ebabc admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:01:05.602304 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e9191-fa50-4675-a24d-bd19d97ebabc admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:01:05.609176 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70634a4e-f528-4df9-ae97-6f959637b43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:01:05.610476 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70634a4e-f528-4df9-ae97-6f959637b43b admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:01:05.610812 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70634a4e-f528-4df9-ae97-6f959637b43b admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:01:05.611071 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70634a4e-f528-4df9-ae97-6f959637b43b admin admin] PATH_INFO: `/v3/projects/a4f58ce29e1a418791db3c8054c5b3ad/users/8667573cc04c40adbcf0d97e1d26bb02/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:01:05.629301 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70634a4e-f528-4df9-ae97-6f959637b43b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4f58ce29e1a418791db3c8054c5b3ad, user_id=8667573cc04c40adbcf0d97e1d26bb02, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:01:05.630328 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING py.warnings [None req-70634a4e-f528-4df9-ae97-6f959637b43b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 03:01:05.630328 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: warnings.warn(msg) Apr 12 03:01:05.630328 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: Apr 12 03:01:05.632281 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70634a4e-f528-4df9-ae97-6f959637b43b admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:01:05.647938 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 738/1501] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:01:05 2022] PUT /identity/v3/projects/a4f58ce29e1a418791db3c8054c5b3ad/users/8667573cc04c40adbcf0d97e1d26bb02/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:01:05.659741 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf40b3-d542-48d5-8b3b-dd727b4b7721 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:01:05.660048 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf40b3-d542-48d5-8b3b-dd727b4b7721 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:01:05.660317 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf40b3-d542-48d5-8b3b-dd727b4b7721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:01:05.686696 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-6acf40b3-d542-48d5-8b3b-dd727b4b7721 None None] MFA Rules not processed for user `8667573cc04c40adbcf0d97e1d26bb02`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:01:05.687905 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-6acf40b3-d542-48d5-8b3b-dd727b4b7721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:01:05.754312 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 764/1502] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:01:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:01:05.766598 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70634a4e-f528-4df9-ae97-6f959637b43b admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:01:05.842106 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70634a4e-f528-4df9-ae97-6f959637b43b admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:01:05.848830 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286c994-b747-4654-83e9-09d930e0f03a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:01:05.849473 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286c994-b747-4654-83e9-09d930e0f03a service nova] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:01:05.849745 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286c994-b747-4654-83e9-09d930e0f03a service nova] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:01:05.849996 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286c994-b747-4654-83e9-09d930e0f03a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:01:05.860803 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286c994-b747-4654-83e9-09d930e0f03a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:01:05.862406 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286c994-b747-4654-83e9-09d930e0f03a service nova] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:01:05.871583 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 739/1503] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:01:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:01:05.951307 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41493a7-2cb6-4e23-bf6e-f82a6ab27530 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:01:05.951589 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41493a7-2cb6-4e23-bf6e-f82a6ab27530 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:01:05.951881 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41493a7-2cb6-4e23-bf6e-f82a6ab27530 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:01:05.953186 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 765/1504] 10.222.0.32 () {52 vars in 829 bytes} [Tue Apr 12 03:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 03:01:05.957365 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286c994-b747-4654-83e9-09d930e0f03a service nova] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:01:06.021597 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286c994-b747-4654-83e9-09d930e0f03a service nova] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:01:06.026416 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91171e93-119c-47af-8c53-7e611cb8d5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:01:06.027580 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91171e93-119c-47af-8c53-7e611cb8d5b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:01:06.027911 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91171e93-119c-47af-8c53-7e611cb8d5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:01:06.028179 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91171e93-119c-47af-8c53-7e611cb8d5b9 admin admin] PATH_INFO: `/v3/users/8667573cc04c40adbcf0d97e1d26bb02` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:01:06.029387 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91171e93-119c-47af-8c53-7e611cb8d5b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8667573cc04c40adbcf0d97e1d26bb02)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:01:06.030399 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING py.warnings [None req-91171e93-119c-47af-8c53-7e611cb8d5b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 03:01:06.030399 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: warnings.warn(msg) Apr 12 03:01:06.030399 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: Apr 12 03:01:06.031575 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91171e93-119c-47af-8c53-7e611cb8d5b9 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:01:06.100181 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-91171e93-119c-47af-8c53-7e611cb8d5b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8667573cc04c40adbcf0d97e1d26bb02'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:01:06.100781 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-91171e93-119c-47af-8c53-7e611cb8d5b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8667573cc04c40adbcf0d97e1d26bb02'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:01:06.118946 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-91171e93-119c-47af-8c53-7e611cb8d5b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8667573cc04c40adbcf0d97e1d26bb02'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:01:06.119715 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-91171e93-119c-47af-8c53-7e611cb8d5b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8667573cc04c40adbcf0d97e1d26bb02'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:01:06.133795 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-91171e93-119c-47af-8c53-7e611cb8d5b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8667573cc04c40adbcf0d97e1d26bb02'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:01:06.153619 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 740/1505] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:01:05 2022] DELETE /identity/v3/users/8667573cc04c40adbcf0d97e1d26bb02 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:01:06.160452 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e0046-47ae-4105-a7f5-11abe99ce70f None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:01:06.160841 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e0046-47ae-4105-a7f5-11abe99ce70f None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:01:06.161240 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e0046-47ae-4105-a7f5-11abe99ce70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:01:06.185471 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-307e0046-47ae-4105-a7f5-11abe99ce70f None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:01:06.186674 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-307e0046-47ae-4105-a7f5-11abe99ce70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:01:06.250495 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 766/1506] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:01:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:01:06.260750 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91171e93-119c-47af-8c53-7e611cb8d5b9 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:01:06.262200 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-91171e93-119c-47af-8c53-7e611cb8d5b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:01:06.318585 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91171e93-119c-47af-8c53-7e611cb8d5b9 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:01:06.322960 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0a820-23ad-4bcf-a5b2-221afc7b0048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:01:06.323627 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0a820-23ad-4bcf-a5b2-221afc7b0048 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:01:06.323918 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0a820-23ad-4bcf-a5b2-221afc7b0048 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:01:06.324183 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0a820-23ad-4bcf-a5b2-221afc7b0048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:01:06.334567 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0a820-23ad-4bcf-a5b2-221afc7b0048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:01:06.336048 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0a820-23ad-4bcf-a5b2-221afc7b0048 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:01:06.345481 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 741/1507] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:01:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:01:06.686333 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e0046-47ae-4105-a7f5-11abe99ce70f None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:01:06.687862 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-307e0046-47ae-4105-a7f5-11abe99ce70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:01:06.700610 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e0046-47ae-4105-a7f5-11abe99ce70f None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:01:06.706442 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc44271-cdb6-451c-8d56-3b0131155178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:01:06.707318 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc44271-cdb6-451c-8d56-3b0131155178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:01:06.707592 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc44271-cdb6-451c-8d56-3b0131155178 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:01:06.707900 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc44271-cdb6-451c-8d56-3b0131155178 admin admin] PATH_INFO: `/v3/projects/a4f58ce29e1a418791db3c8054c5b3ad` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:01:06.709181 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc44271-cdb6-451c-8d56-3b0131155178 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4f58ce29e1a418791db3c8054c5b3ad)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:01:06.710205 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING py.warnings [None req-3fc44271-cdb6-451c-8d56-3b0131155178 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 03:01:06.710205 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: warnings.warn(msg) Apr 12 03:01:06.710205 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: Apr 12 03:01:06.711372 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc44271-cdb6-451c-8d56-3b0131155178 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:01:06.780155 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-3fc44271-cdb6-451c-8d56-3b0131155178 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4f58ce29e1a418791db3c8054c5b3ad', 'request_id': 'req-3fc44271-cdb6-451c-8d56-3b0131155178'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:01:06.790763 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-3fc44271-cdb6-451c-8d56-3b0131155178 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4f58ce29e1a418791db3c8054c5b3ad', 'request_id': 'req-3fc44271-cdb6-451c-8d56-3b0131155178'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:01:06.804786 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-3fc44271-cdb6-451c-8d56-3b0131155178 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4f58ce29e1a418791db3c8054c5b3ad', 'request_id': 'req-3fc44271-cdb6-451c-8d56-3b0131155178'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:01:06.818152 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-3fc44271-cdb6-451c-8d56-3b0131155178 admin admin] The token cache is being invalidate because project a4f58ce29e1a418791db3c8054c5b3ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:01:06.818431 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-3fc44271-cdb6-451c-8d56-3b0131155178 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:01:06.819277 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-3fc44271-cdb6-451c-8d56-3b0131155178 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:01:06.821110 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 767/1508] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:01:06 2022] DELETE /identity/v3/projects/a4f58ce29e1a418791db3c8054c5b3ad => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:02:45.929216 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3526a5-54ce-45c0-a6a1-3bd75f392fc9 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:02:45.930128 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3526a5-54ce-45c0-a6a1-3bd75f392fc9 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:02:45.930128 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3526a5-54ce-45c0-a6a1-3bd75f392fc9 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:02:45.932315 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 742/1509] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 03:02:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 03:02:45.937483 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87998917-ed87-447c-b80d-017d19456c23 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:02:45.937975 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87998917-ed87-447c-b80d-017d19456c23 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:02:45.937975 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87998917-ed87-447c-b80d-017d19456c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:02:45.956940 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-87998917-ed87-447c-b80d-017d19456c23 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:02:45.958124 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-87998917-ed87-447c-b80d-017d19456c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:02:46.022438 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 768/1510] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 03:02:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:02:46.183543 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3526a5-54ce-45c0-a6a1-3bd75f392fc9 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:02:46.185429 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-8a3526a5-54ce-45c0-a6a1-3bd75f392fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:02:46.260709 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3526a5-54ce-45c0-a6a1-3bd75f392fc9 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:02:46.266795 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f493f-a825-4195-bcde-dea87300d42a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:02:46.267433 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f493f-a825-4195-bcde-dea87300d42a service nova] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:02:46.267709 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f493f-a825-4195-bcde-dea87300d42a service nova] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:02:46.268017 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f493f-a825-4195-bcde-dea87300d42a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:02:46.276546 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f493f-a825-4195-bcde-dea87300d42a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:02:46.278144 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f493f-a825-4195-bcde-dea87300d42a service nova] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:02:46.287523 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 743/1511] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:02:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 03:02:46.670110 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11672b8a-26ce-4f51-9ae1-1889e16fa3ee None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:02:46.670544 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11672b8a-26ce-4f51-9ae1-1889e16fa3ee None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:02:46.670879 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11672b8a-26ce-4f51-9ae1-1889e16fa3ee None None] PATH_INFO: `/v3` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:02:46.672553 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 769/1512] 10.222.0.25 () {54 vars in 925 bytes} [Tue Apr 12 03:02:46 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:02:46.679442 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbce399-7478-4bda-b15c-6dbd19d95717 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:02:46.679833 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbce399-7478-4bda-b15c-6dbd19d95717 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:02:46.680175 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbce399-7478-4bda-b15c-6dbd19d95717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:02:46.700209 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-dfbce399-7478-4bda-b15c-6dbd19d95717 None None] MFA Rules not processed for user `c2a88ae51543497382d34573afc2bde3`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:02:46.701624 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-dfbce399-7478-4bda-b15c-6dbd19d95717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:02:46.766205 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 744/1513] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Apr 12 03:02:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:02:47.567698 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32488f4f-c9a7-46f6-bf52-d7294f76e796 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:02:47.568662 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32488f4f-c9a7-46f6-bf52-d7294f76e796 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:02:47.568662 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32488f4f-c9a7-46f6-bf52-d7294f76e796 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:02:47.570795 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 770/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 03:02:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 03:02:47.577247 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350fe6f-3d50-47b0-b65c-6682f8403d48 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:02:47.577966 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350fe6f-3d50-47b0-b65c-6682f8403d48 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:02:47.578144 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350fe6f-3d50-47b0-b65c-6682f8403d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:02:47.601606 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-d350fe6f-3d50-47b0-b65c-6682f8403d48 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:02:47.602672 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-d350fe6f-3d50-47b0-b65c-6682f8403d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:02:47.612182 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 745/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 03:02:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:02:47.765727 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32488f4f-c9a7-46f6-bf52-d7294f76e796 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:02:47.791362 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32488f4f-c9a7-46f6-bf52-d7294f76e796 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:02:47.798695 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9ef1e-144a-483b-aa7c-1adaf38f6dba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:02:47.799336 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9ef1e-144a-483b-aa7c-1adaf38f6dba service nova] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:02:47.799613 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9ef1e-144a-483b-aa7c-1adaf38f6dba service nova] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:02:47.799910 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9ef1e-144a-483b-aa7c-1adaf38f6dba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:02:47.808785 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9ef1e-144a-483b-aa7c-1adaf38f6dba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:02:47.810397 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9ef1e-144a-483b-aa7c-1adaf38f6dba service nova] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:02:47.820432 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 771/1516] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:02:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:02:50.831948 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8709ab6-1890-4b90-b2b9-93620fd8c0b5 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:02:50.832840 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8709ab6-1890-4b90-b2b9-93620fd8c0b5 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:02:50.832840 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8709ab6-1890-4b90-b2b9-93620fd8c0b5 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:02:50.835058 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 746/1517] 10.222.0.32 () {54 vars in 960 bytes} [Tue Apr 12 03:02:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 03:02:50.841214 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa461fb-7e87-4f95-847c-e3a6d177cc93 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:02:50.841985 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa461fb-7e87-4f95-847c-e3a6d177cc93 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:02:50.842145 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa461fb-7e87-4f95-847c-e3a6d177cc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:02:50.864642 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-aaa461fb-7e87-4f95-847c-e3a6d177cc93 None None] MFA Rules not processed for user `c2a88ae51543497382d34573afc2bde3`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:02:50.865746 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-aaa461fb-7e87-4f95-847c-e3a6d177cc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:02:50.876086 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 772/1518] 10.222.0.32 () {58 vars in 1057 bytes} [Tue Apr 12 03:02:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:02:50.887559 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8709ab6-1890-4b90-b2b9-93620fd8c0b5 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:02:50.902900 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8709ab6-1890-4b90-b2b9-93620fd8c0b5 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:02:50.908875 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950fbc7c-7f35-4af0-9fc8-f4c10c3387ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a88ae51543497382d34573afc2bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:02:50.909471 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fbc7c-7f35-4af0-9fc8-f4c10c3387ae service placement] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:02:50.909736 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fbc7c-7f35-4af0-9fc8-f4c10c3387ae service placement] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:02:50.909970 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fbc7c-7f35-4af0-9fc8-f4c10c3387ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:02:50.918227 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950fbc7c-7f35-4af0-9fc8-f4c10c3387ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:02:50.919844 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950fbc7c-7f35-4af0-9fc8-f4c10c3387ae service placement] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:02:50.929177 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 747/1519] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:02:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:02:59.541128 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c94107-999c-476a-ad8c-cd18b034b8be None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:02:59.541713 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c94107-999c-476a-ad8c-cd18b034b8be None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:02:59.541713 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c94107-999c-476a-ad8c-cd18b034b8be None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:02:59.543059 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 773/1520] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 03:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 03:02:59.549519 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8cceac-dacd-4bb0-82a3-27a22f4336bb None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:02:59.550257 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8cceac-dacd-4bb0-82a3-27a22f4336bb None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:02:59.550405 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8cceac-dacd-4bb0-82a3-27a22f4336bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:02:59.580200 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-ee8cceac-dacd-4bb0-82a3-27a22f4336bb None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:02:59.581895 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-ee8cceac-dacd-4bb0-82a3-27a22f4336bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:02:59.594942 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 748/1521] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 03:02:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:02:59.749666 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c94107-999c-476a-ad8c-cd18b034b8be None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:02:59.766416 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c94107-999c-476a-ad8c-cd18b034b8be None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:02:59.773613 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58a2e8-35b5-4ab9-9b5a-5fa0a47b7b4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:02:59.774245 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58a2e8-35b5-4ab9-9b5a-5fa0a47b7b4e service nova] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:02:59.774539 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58a2e8-35b5-4ab9-9b5a-5fa0a47b7b4e service nova] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:02:59.774801 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58a2e8-35b5-4ab9-9b5a-5fa0a47b7b4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:02:59.783578 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58a2e8-35b5-4ab9-9b5a-5fa0a47b7b4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:02:59.785172 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58a2e8-35b5-4ab9-9b5a-5fa0a47b7b4e service nova] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:02:59.794809 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 774/1522] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:02:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 03:03:01.067293 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22687b13-c486-4035-9ed4-757359619a4c None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:03:01.068222 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22687b13-c486-4035-9ed4-757359619a4c None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:03:01.068222 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22687b13-c486-4035-9ed4-757359619a4c None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:03:01.070383 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 749/1523] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 03:03:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 03:03:01.079472 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc2a17-2aed-4500-9e3d-ef0493374366 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:03:01.079957 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc2a17-2aed-4500-9e3d-ef0493374366 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:03:01.080052 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc2a17-2aed-4500-9e3d-ef0493374366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:03:01.103268 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-b1bc2a17-2aed-4500-9e3d-ef0493374366 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:03:01.104483 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-b1bc2a17-2aed-4500-9e3d-ef0493374366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:03:01.114523 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 775/1524] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 03:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:03:01.282090 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22687b13-c486-4035-9ed4-757359619a4c None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:03:01.303277 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22687b13-c486-4035-9ed4-757359619a4c None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:03:01.309342 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45441c2-7ec3-4646-8e52-89c5cbde1bf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:03:01.310119 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45441c2-7ec3-4646-8e52-89c5cbde1bf9 service nova] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:03:01.310400 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45441c2-7ec3-4646-8e52-89c5cbde1bf9 service nova] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:03:01.310670 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45441c2-7ec3-4646-8e52-89c5cbde1bf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:03:01.319274 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45441c2-7ec3-4646-8e52-89c5cbde1bf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:03:01.320837 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45441c2-7ec3-4646-8e52-89c5cbde1bf9 service nova] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:03:01.331023 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 750/1525] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:03:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:03:05.743450 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1cd59-08c6-4a63-93c7-94499dbfcd30 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:03:05.744357 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1cd59-08c6-4a63-93c7-94499dbfcd30 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:03:05.744510 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1cd59-08c6-4a63-93c7-94499dbfcd30 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:03:05.746540 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 776/1526] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 03:03:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 03:03:05.755664 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4791a-383d-41cd-a646-90932c6afeaa None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:03:05.756113 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4791a-383d-41cd-a646-90932c6afeaa None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:03:05.756390 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4791a-383d-41cd-a646-90932c6afeaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:03:05.777981 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-77e4791a-383d-41cd-a646-90932c6afeaa None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:03:05.779151 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-77e4791a-383d-41cd-a646-90932c6afeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:03:05.787577 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 751/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 03:03:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:03:05.825417 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1cd59-08c6-4a63-93c7-94499dbfcd30 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:03:05.827743 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-e3c1cd59-08c6-4a63-93c7-94499dbfcd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:03:05.895879 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1cd59-08c6-4a63-93c7-94499dbfcd30 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:03:05.900789 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcded48a-31d2-4c05-8922-ea5029f133cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:03:05.901424 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcded48a-31d2-4c05-8922-ea5029f133cb service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:03:05.901696 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcded48a-31d2-4c05-8922-ea5029f133cb service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:03:05.901985 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcded48a-31d2-4c05-8922-ea5029f133cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:03:05.912962 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcded48a-31d2-4c05-8922-ea5029f133cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:03:05.914384 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcded48a-31d2-4c05-8922-ea5029f133cb service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:03:05.924693 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 777/1528] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:03:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:03:08.213726 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47193a2-7b27-4515-9918-8e642ab8586c None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:03:08.214582 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47193a2-7b27-4515-9918-8e642ab8586c None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:03:08.214582 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47193a2-7b27-4515-9918-8e642ab8586c None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:03:08.216423 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 752/1529] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 03:03:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 03:03:08.222768 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2469d22-d510-40fd-a35f-37490f9a3431 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:03:08.223217 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2469d22-d510-40fd-a35f-37490f9a3431 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:03:08.223362 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2469d22-d510-40fd-a35f-37490f9a3431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:03:08.250008 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-e2469d22-d510-40fd-a35f-37490f9a3431 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:03:08.251210 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-e2469d22-d510-40fd-a35f-37490f9a3431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:03:08.259467 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 778/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 03:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:03:08.297827 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47193a2-7b27-4515-9918-8e642ab8586c None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:03:08.314194 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47193a2-7b27-4515-9918-8e642ab8586c None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:03:08.318687 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f9a09-8589-48ee-9576-f76b302c21c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:03:08.319330 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f9a09-8589-48ee-9576-f76b302c21c5 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:03:08.319598 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f9a09-8589-48ee-9576-f76b302c21c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:03:08.319885 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f9a09-8589-48ee-9576-f76b302c21c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:03:08.329798 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f9a09-8589-48ee-9576-f76b302c21c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:03:08.331233 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f9a09-8589-48ee-9576-f76b302c21c5 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:03:08.341060 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 753/1531] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:03:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:03:12.119733 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14c9d0-2e99-46d1-b0b3-db03abc762b0 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:03:12.120361 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14c9d0-2e99-46d1-b0b3-db03abc762b0 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:03:12.120361 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14c9d0-2e99-46d1-b0b3-db03abc762b0 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:03:12.121694 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 779/1532] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 03:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 03:03:12.127910 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f0d26-3c51-4da7-b40b-0637baece14e None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:03:12.128634 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f0d26-3c51-4da7-b40b-0637baece14e None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:03:12.128803 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f0d26-3c51-4da7-b40b-0637baece14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:03:12.157271 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-578f0d26-3c51-4da7-b40b-0637baece14e None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:03:12.158436 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-578f0d26-3c51-4da7-b40b-0637baece14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:03:12.167701 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 754/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 03:03:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:03:12.443026 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14c9d0-2e99-46d1-b0b3-db03abc762b0 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:03:12.446221 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-5d14c9d0-2e99-46d1-b0b3-db03abc762b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:03:12.507538 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14c9d0-2e99-46d1-b0b3-db03abc762b0 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:03:12.512107 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2a6cd-38c7-4975-92d4-4bffec12ba68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:03:12.512813 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2a6cd-38c7-4975-92d4-4bffec12ba68 service cinder] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:03:12.513195 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2a6cd-38c7-4975-92d4-4bffec12ba68 service cinder] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:03:12.513475 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2a6cd-38c7-4975-92d4-4bffec12ba68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:03:12.523023 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a2a6cd-38c7-4975-92d4-4bffec12ba68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:03:12.524482 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a2a6cd-38c7-4975-92d4-4bffec12ba68 service cinder] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:03:12.534064 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 780/1534] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:03:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:03:14.876593 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a498f7-19b3-44b5-9f66-54675158227a None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:03:14.877143 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a498f7-19b3-44b5-9f66-54675158227a None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:03:14.877143 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a498f7-19b3-44b5-9f66-54675158227a None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:03:14.878434 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 755/1535] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 03:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 03:03:14.884552 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cffa8-7142-4db1-a560-91451166debf None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:03:14.885228 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cffa8-7142-4db1-a560-91451166debf None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:03:14.885348 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cffa8-7142-4db1-a560-91451166debf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:03:14.904562 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-128cffa8-7142-4db1-a560-91451166debf None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:03:14.905736 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-128cffa8-7142-4db1-a560-91451166debf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:03:14.914048 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 781/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 03:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:03:15.190602 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45c26b-a3e1-4bdd-9f20-da337f5b4d01 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:03:15.190887 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45c26b-a3e1-4bdd-9f20-da337f5b4d01 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:03:15.191156 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45c26b-a3e1-4bdd-9f20-da337f5b4d01 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:03:15.192562 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 756/1537] 10.222.0.32 () {54 vars in 962 bytes} [Tue Apr 12 03:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 03:03:15.197591 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03058cef-6d7d-432d-8eab-a259d462304d None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:03:15.197869 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03058cef-6d7d-432d-8eab-a259d462304d None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:03:15.198134 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03058cef-6d7d-432d-8eab-a259d462304d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:03:15.219975 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-03058cef-6d7d-432d-8eab-a259d462304d None None] MFA Rules not processed for user `44248c51c2cb497b85a68dce0496a225`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:03:15.221144 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-03058cef-6d7d-432d-8eab-a259d462304d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:03:15.228068 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 782/1538] 10.222.0.32 () {58 vars in 1059 bytes} [Tue Apr 12 03:03:15 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:03:15.236065 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45c26b-a3e1-4bdd-9f20-da337f5b4d01 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:03:15.253612 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45c26b-a3e1-4bdd-9f20-da337f5b4d01 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:03:15.258467 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5266488-fda3-445c-aa5c-b05718e243f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:03:15.259104 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5266488-fda3-445c-aa5c-b05718e243f5 service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:03:15.259379 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5266488-fda3-445c-aa5c-b05718e243f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:03:15.259646 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5266488-fda3-445c-aa5c-b05718e243f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:03:15.269475 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5266488-fda3-445c-aa5c-b05718e243f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:03:15.270915 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5266488-fda3-445c-aa5c-b05718e243f5 service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:03:15.280543 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 757/1539] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:03:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:04:44.504438 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890332b-7804-41de-8e13-e236243391f7 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:44.505102 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890332b-7804-41de-8e13-e236243391f7 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:44.505102 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890332b-7804-41de-8e13-e236243391f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:44.544161 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-b890332b-7804-41de-8e13-e236243391f7 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:44.545401 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-b890332b-7804-41de-8e13-e236243391f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:44.563013 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 783/1540] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:04:44.564565 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e8d07-8a1c-4fa3-8946-466280aff3d0 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:44.565089 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e8d07-8a1c-4fa3-8946-466280aff3d0 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:44.565089 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e8d07-8a1c-4fa3-8946-466280aff3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:44.575985 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a2de9-054c-4ff5-9e9c-51add78e1b9d None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:44.576338 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a2de9-054c-4ff5-9e9c-51add78e1b9d None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:44.576515 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a2de9-054c-4ff5-9e9c-51add78e1b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:44.594908 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-c68e8d07-8a1c-4fa3-8946-466280aff3d0 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:44.596055 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-c68e8d07-8a1c-4fa3-8946-466280aff3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:44.609135 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-288a2de9-054c-4ff5-9e9c-51add78e1b9d None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:44.610364 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-288a2de9-054c-4ff5-9e9c-51add78e1b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:44.612748 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 758/1541] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:04:44.620412 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04c4d4-9618-4686-b89c-332e48d7153e None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:44.620760 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04c4d4-9618-4686-b89c-332e48d7153e None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:44.621028 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04c4d4-9618-4686-b89c-332e48d7153e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:44.635631 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 784/1542] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:04:44.637529 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5d906-90bc-43de-910b-aa5796932851 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:44.637813 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5d906-90bc-43de-910b-aa5796932851 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:44.638080 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5d906-90bc-43de-910b-aa5796932851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:44.652975 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-ce04c4d4-9618-4686-b89c-332e48d7153e None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:44.654188 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-ce04c4d4-9618-4686-b89c-332e48d7153e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:44.668100 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 759/1543] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:04:44.669439 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04c4d4-9618-4686-b89c-332e48d7153e None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:44.679735 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04c4d4-9618-4686-b89c-332e48d7153e None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:44.689909 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac3f0c-ddf2-4a67-9b9b-c5c1d32ac353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:44.690799 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac3f0c-ddf2-4a67-9b9b-c5c1d32ac353 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:44.691002 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac3f0c-ddf2-4a67-9b9b-c5c1d32ac353 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:44.691246 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac3f0c-ddf2-4a67-9b9b-c5c1d32ac353 admin admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:44.692003 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac3f0c-ddf2-4a67-9b9b-c5c1d32ac353 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:04:44.692305 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac3f0c-ddf2-4a67-9b9b-c5c1d32ac353 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:44.692866 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-01b5d906-90bc-43de-910b-aa5796932851 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:44.693354 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING py.warnings [None req-29ac3f0c-ddf2-4a67-9b9b-c5c1d32ac353 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 03:04:44.693354 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: warnings.warn(msg) Apr 12 03:04:44.693354 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: Apr 12 03:04:44.694260 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac3f0c-ddf2-4a67-9b9b-c5c1d32ac353 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:44.694374 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-01b5d906-90bc-43de-910b-aa5796932851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:44.713803 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 760/1544] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:04:44.715111 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bba5a0-45ee-432e-a609-67b2e1638c17 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:44.715394 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bba5a0-45ee-432e-a609-67b2e1638c17 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:44.715795 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bba5a0-45ee-432e-a609-67b2e1638c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:44.725413 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 785/1545] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:04:44.726598 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af032f-925a-4b0e-99e3-eac749fdd9c0 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:44.726876 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af032f-925a-4b0e-99e3-eac749fdd9c0 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:44.727138 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af032f-925a-4b0e-99e3-eac749fdd9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:44.754731 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-b6bba5a0-45ee-432e-a609-67b2e1638c17 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:44.755992 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-b6bba5a0-45ee-432e-a609-67b2e1638c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:44.764984 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 761/1546] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:04:44.765916 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bba5a0-45ee-432e-a609-67b2e1638c17 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:44.773558 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-02af032f-925a-4b0e-99e3-eac749fdd9c0 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:44.774721 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-02af032f-925a-4b0e-99e3-eac749fdd9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:44.777852 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bba5a0-45ee-432e-a609-67b2e1638c17 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:44.783705 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc98da-fa0c-411e-a817-945a373d397f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:44.784380 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc98da-fa0c-411e-a817-945a373d397f admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:44.784867 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 786/1547] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:04:44.784990 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc98da-fa0c-411e-a817-945a373d397f admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:44.784990 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc98da-fa0c-411e-a817-945a373d397f admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:44.785351 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af032f-925a-4b0e-99e3-eac749fdd9c0 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:44.785697 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc98da-fa0c-411e-a817-945a373d397f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:44.787628 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc98da-fa0c-411e-a817-945a373d397f admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:44.795339 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af032f-925a-4b0e-99e3-eac749fdd9c0 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:44.800197 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac4e3d-0571-4545-978c-5c289f9d12d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:44.800855 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac4e3d-0571-4545-978c-5c289f9d12d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:44.801128 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac4e3d-0571-4545-978c-5c289f9d12d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:44.801391 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac4e3d-0571-4545-978c-5c289f9d12d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:44.802104 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac4e3d-0571-4545-978c-5c289f9d12d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:04:44.802397 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac4e3d-0571-4545-978c-5c289f9d12d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:44.804737 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac4e3d-0571-4545-978c-5c289f9d12d5 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:44.819770 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 787/1548] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:04:44.821096 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d3da3-aca3-4d7b-81de-362b99fc32d2 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:44.821373 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d3da3-aca3-4d7b-81de-362b99fc32d2 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:44.821638 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d3da3-aca3-4d7b-81de-362b99fc32d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:44.822948 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 762/1549] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:04:44 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:04:44.825863 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d310b11-d58c-42dc-9fea-a2d584c3f3b5 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:44.826386 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d310b11-d58c-42dc-9fea-a2d584c3f3b5 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:44.827328 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d310b11-d58c-42dc-9fea-a2d584c3f3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:44.841135 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-8c7d3da3-aca3-4d7b-81de-362b99fc32d2 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:44.842626 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-8c7d3da3-aca3-4d7b-81de-362b99fc32d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:44.848541 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-4d310b11-d58c-42dc-9fea-a2d584c3f3b5 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:44.849966 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-4d310b11-d58c-42dc-9fea-a2d584c3f3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:44.900625 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 788/1550] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:04:44.901502 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d3da3-aca3-4d7b-81de-362b99fc32d2 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:44.910561 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d3da3-aca3-4d7b-81de-362b99fc32d2 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:44.918963 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 763/1551] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:04:44.918963 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e12d2a-17bd-42d3-9620-1d8685abe089 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:44.918963 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e12d2a-17bd-42d3-9620-1d8685abe089 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:44.919330 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e15cf0-008c-43ba-9741-7e29c901411c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:44.919425 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e12d2a-17bd-42d3-9620-1d8685abe089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:44.919504 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e15cf0-008c-43ba-9741-7e29c901411c admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:44.919504 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e15cf0-008c-43ba-9741-7e29c901411c admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:44.919504 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e15cf0-008c-43ba-9741-7e29c901411c admin admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:44.919504 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e15cf0-008c-43ba-9741-7e29c901411c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:04:44.919504 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e15cf0-008c-43ba-9741-7e29c901411c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:44.919504 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e15cf0-008c-43ba-9741-7e29c901411c admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:44.930278 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 789/1552] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:04:44.931090 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e15cf0-008c-43ba-9741-7e29c901411c admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:44.936998 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-f8e12d2a-17bd-42d3-9620-1d8685abe089 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:44.938316 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-f8e12d2a-17bd-42d3-9620-1d8685abe089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:44.940460 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e15cf0-008c-43ba-9741-7e29c901411c admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:44.944743 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b2df7-c8f1-4792-bc8f-45db9e733c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:44.945375 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b2df7-c8f1-4792-bc8f-45db9e733c4d admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:44.945642 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b2df7-c8f1-4792-bc8f-45db9e733c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:44.945907 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b2df7-c8f1-4792-bc8f-45db9e733c4d admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:44.946057 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 764/1553] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:04:44.946577 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b2df7-c8f1-4792-bc8f-45db9e733c4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:44.946722 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e12d2a-17bd-42d3-9620-1d8685abe089 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:44.948670 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b2df7-c8f1-4792-bc8f-45db9e733c4d admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:44.956924 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e12d2a-17bd-42d3-9620-1d8685abe089 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:44.961684 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15e153-eab2-41a7-9ebc-2f4f626dc1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:44.962368 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15e153-eab2-41a7-9ebc-2f4f626dc1b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:44.962645 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15e153-eab2-41a7-9ebc-2f4f626dc1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:44.962908 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15e153-eab2-41a7-9ebc-2f4f626dc1b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:44.963636 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15e153-eab2-41a7-9ebc-2f4f626dc1b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:44.965857 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15e153-eab2-41a7-9ebc-2f4f626dc1b8 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:44.969617 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 790/1554] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:04:44 2022] POST /identity/v3/users => generated 294 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:04:44.970929 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f006721-2204-4faa-844f-4b7b1aa9fbe3 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:44.971219 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f006721-2204-4faa-844f-4b7b1aa9fbe3 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:44.971484 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f006721-2204-4faa-844f-4b7b1aa9fbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:44.990018 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-0f006721-2204-4faa-844f-4b7b1aa9fbe3 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:44.991211 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-0f006721-2204-4faa-844f-4b7b1aa9fbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:44.991483 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 765/1555] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:04:44 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:04:44.992783 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fb8f5-02ef-4653-8c2c-9e68174a9e64 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:44.993098 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fb8f5-02ef-4653-8c2c-9e68174a9e64 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:44.993338 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fb8f5-02ef-4653-8c2c-9e68174a9e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:45.011238 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-2f2fb8f5-02ef-4653-8c2c-9e68174a9e64 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:45.012462 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-2f2fb8f5-02ef-4653-8c2c-9e68174a9e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:45.050540 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 791/1556] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:04:45.051889 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b579a48-f1ae-4720-9a91-97e88ee709a5 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:45.052166 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b579a48-f1ae-4720-9a91-97e88ee709a5 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:45.052431 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b579a48-f1ae-4720-9a91-97e88ee709a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:45.069775 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-6b579a48-f1ae-4720-9a91-97e88ee709a5 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:45.069981 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 766/1557] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:04:45.070934 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-6b579a48-f1ae-4720-9a91-97e88ee709a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:45.071364 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12de0b2-5651-4f19-b3a1-dd45ee797a94 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:45.071741 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12de0b2-5651-4f19-b3a1-dd45ee797a94 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:45.072121 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12de0b2-5651-4f19-b3a1-dd45ee797a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:45.085341 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 792/1558] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:04:45.086127 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b579a48-f1ae-4720-9a91-97e88ee709a5 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:45.093350 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-e12de0b2-5651-4f19-b3a1-dd45ee797a94 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:45.094584 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-e12de0b2-5651-4f19-b3a1-dd45ee797a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:45.095537 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b579a48-f1ae-4720-9a91-97e88ee709a5 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:45.100076 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ca7ba-54f5-43eb-bf93-9897290aca81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:45.100624 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ca7ba-54f5-43eb-bf93-9897290aca81 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:45.100908 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ca7ba-54f5-43eb-bf93-9897290aca81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:45.101170 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ca7ba-54f5-43eb-bf93-9897290aca81 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:45.101840 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ca7ba-54f5-43eb-bf93-9897290aca81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:45.102552 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 767/1559] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:04:45.102845 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING py.warnings [None req-cb8ca7ba-54f5-43eb-bf93-9897290aca81 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 03:04:45.102845 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: warnings.warn(msg) Apr 12 03:04:45.102845 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: Apr 12 03:04:45.103329 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12de0b2-5651-4f19-b3a1-dd45ee797a94 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:45.104056 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ca7ba-54f5-43eb-bf93-9897290aca81 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:45.112487 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12de0b2-5651-4f19-b3a1-dd45ee797a94 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:45.117028 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5d423-3001-48e2-a447-9d5234b4db8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:45.117667 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5d423-3001-48e2-a447-9d5234b4db8b admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:45.117948 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5d423-3001-48e2-a447-9d5234b4db8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:45.118219 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5d423-3001-48e2-a447-9d5234b4db8b admin admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:45.118924 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5d423-3001-48e2-a447-9d5234b4db8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:04:45.119291 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5d423-3001-48e2-a447-9d5234b4db8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:45.121330 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5d423-3001-48e2-a447-9d5234b4db8b admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:45.130539 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 793/1560] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:04:45 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:04:45.131500 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ca7ba-54f5-43eb-bf93-9897290aca81 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:45.133234 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 768/1561] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:04:45.133878 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5d423-3001-48e2-a447-9d5234b4db8b admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:45.143571 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5d423-3001-48e2-a447-9d5234b4db8b admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:45.198544 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ca7ba-54f5-43eb-bf93-9897290aca81 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:45.199147 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb219ae-fb94-4e6c-8a6c-57db94779acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:45.200112 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb219ae-fb94-4e6c-8a6c-57db94779acb admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:45.200961 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb219ae-fb94-4e6c-8a6c-57db94779acb admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:45.201221 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb219ae-fb94-4e6c-8a6c-57db94779acb admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:45.201991 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb219ae-fb94-4e6c-8a6c-57db94779acb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:45.203158 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING py.warnings [None req-cbb219ae-fb94-4e6c-8a6c-57db94779acb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 03:04:45.203158 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: warnings.warn(msg) Apr 12 03:04:45.203158 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: Apr 12 03:04:45.204757 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb219ae-fb94-4e6c-8a6c-57db94779acb admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:45.205306 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bdcb8e-9f97-4a3d-ab49-5758cac909e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:45.206161 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdcb8e-9f97-4a3d-ab49-5758cac909e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:45.206470 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdcb8e-9f97-4a3d-ab49-5758cac909e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:45.206860 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdcb8e-9f97-4a3d-ab49-5758cac909e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:45.207807 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bdcb8e-9f97-4a3d-ab49-5758cac909e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:45.209524 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bdcb8e-9f97-4a3d-ab49-5758cac909e9 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:45.223916 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 794/1562] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:04:45.223916 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ce77c-2f0c-4640-91cd-60866b019497 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:45.223916 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ce77c-2f0c-4640-91cd-60866b019497 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:45.223916 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ce77c-2f0c-4640-91cd-60866b019497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:45.228058 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 769/1563] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:04:45 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:04:45.229403 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ee7f0-5dba-4885-aa94-58741f953fb9 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:45.229820 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ee7f0-5dba-4885-aa94-58741f953fb9 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:45.230267 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ee7f0-5dba-4885-aa94-58741f953fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:45.243487 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-366ce77c-2f0c-4640-91cd-60866b019497 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:45.244963 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-366ce77c-2f0c-4640-91cd-60866b019497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:45.248796 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-d54ee7f0-5dba-4885-aa94-58741f953fb9 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:45.249943 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-d54ee7f0-5dba-4885-aa94-58741f953fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:45.253021 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 795/1564] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:04:45.256731 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ce77c-2f0c-4640-91cd-60866b019497 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:45.262298 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 770/1565] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:04:45.263079 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ee7f0-5dba-4885-aa94-58741f953fb9 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:45.269579 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ce77c-2f0c-4640-91cd-60866b019497 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:45.272423 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ee7f0-5dba-4885-aa94-58741f953fb9 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:45.274221 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d4d51-4f63-4a79-8c68-b2c3b53b5c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:45.274875 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d4d51-4f63-4a79-8c68-b2c3b53b5c48 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:45.275203 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d4d51-4f63-4a79-8c68-b2c3b53b5c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:45.275415 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d4d51-4f63-4a79-8c68-b2c3b53b5c48 admin admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:45.276368 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d4d51-4f63-4a79-8c68-b2c3b53b5c48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:04:45.276887 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d4d51-4f63-4a79-8c68-b2c3b53b5c48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:45.277427 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2bf56c-cfbc-46dd-9995-a78b73e2850b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:45.278061 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bf56c-cfbc-46dd-9995-a78b73e2850b admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:45.278334 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bf56c-cfbc-46dd-9995-a78b73e2850b admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:45.278576 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d4d51-4f63-4a79-8c68-b2c3b53b5c48 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:45.278682 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bf56c-cfbc-46dd-9995-a78b73e2850b admin admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:45.279324 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2bf56c-cfbc-46dd-9995-a78b73e2850b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:04:45.279622 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2bf56c-cfbc-46dd-9995-a78b73e2850b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:45.281248 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2bf56c-cfbc-46dd-9995-a78b73e2850b admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:45.289882 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 796/1566] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:04:45.290718 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d4d51-4f63-4a79-8c68-b2c3b53b5c48 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:45.297807 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 771/1567] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:04:45.297807 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2bf56c-cfbc-46dd-9995-a78b73e2850b admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:45.302841 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d4d51-4f63-4a79-8c68-b2c3b53b5c48 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:45.306607 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2bf56c-cfbc-46dd-9995-a78b73e2850b admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:45.308287 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade5136-8cbd-42b8-afa9-4651749f8ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:45.308946 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade5136-8cbd-42b8-afa9-4651749f8ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:45.309220 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade5136-8cbd-42b8-afa9-4651749f8ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:45.309487 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade5136-8cbd-42b8-afa9-4651749f8ca1 admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:45.310157 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade5136-8cbd-42b8-afa9-4651749f8ca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:45.311306 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59ee7a-9248-4636-96c9-6e0c23e6ed50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:45.311993 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59ee7a-9248-4636-96c9-6e0c23e6ed50 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:45.312118 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade5136-8cbd-42b8-afa9-4651749f8ca1 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:45.312259 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59ee7a-9248-4636-96c9-6e0c23e6ed50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:45.312518 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59ee7a-9248-4636-96c9-6e0c23e6ed50 admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:45.313178 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59ee7a-9248-4636-96c9-6e0c23e6ed50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:45.315079 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59ee7a-9248-4636-96c9-6e0c23e6ed50 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:45.333931 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 797/1568] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:04:45 2022] POST /identity/v3/users => generated 284 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:04:45.338387 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade5136-8cbd-42b8-afa9-4651749f8ca1 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:45.342479 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 772/1569] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:04:45 2022] POST /identity/v3/projects => generated 389 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:04:45.343577 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59ee7a-9248-4636-96c9-6e0c23e6ed50 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:45.348893 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade5136-8cbd-42b8-afa9-4651749f8ca1 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:45.402920 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59ee7a-9248-4636-96c9-6e0c23e6ed50 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:45.404152 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f8db4-b420-4b04-8de8-a50d0a1481bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:45.404827 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f8db4-b420-4b04-8de8-a50d0a1481bf admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:45.405100 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f8db4-b420-4b04-8de8-a50d0a1481bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:45.405366 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f8db4-b420-4b04-8de8-a50d0a1481bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:45.406084 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f8db4-b420-4b04-8de8-a50d0a1481bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:45.407649 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5cd770-dc99-42d3-be54-abe2c7ca85c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:45.407801 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f8db4-b420-4b04-8de8-a50d0a1481bf admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:45.408340 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cd770-dc99-42d3-be54-abe2c7ca85c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:45.408611 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cd770-dc99-42d3-be54-abe2c7ca85c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:45.408880 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cd770-dc99-42d3-be54-abe2c7ca85c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:45.409595 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5cd770-dc99-42d3-be54-abe2c7ca85c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:45.411204 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5cd770-dc99-42d3-be54-abe2c7ca85c5 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:45.417655 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 798/1570] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:04:45.420899 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f8db4-b420-4b04-8de8-a50d0a1481bf admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:45.421517 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 773/1571] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:04:45.422384 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5cd770-dc99-42d3-be54-abe2c7ca85c5 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:45.430328 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f8db4-b420-4b04-8de8-a50d0a1481bf admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:45.432147 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5cd770-dc99-42d3-be54-abe2c7ca85c5 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:45.435356 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4001ed-d36d-4f95-8cda-6356a24dbfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:45.436096 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4001ed-d36d-4f95-8cda-6356a24dbfbd admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:45.436435 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4001ed-d36d-4f95-8cda-6356a24dbfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:45.436754 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4001ed-d36d-4f95-8cda-6356a24dbfbd admin admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:45.437069 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631348f-e0ac-41ce-beb1-125bd5db0da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:45.437593 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4001ed-d36d-4f95-8cda-6356a24dbfbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:04:45.437713 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631348f-e0ac-41ce-beb1-125bd5db0da0 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:45.438025 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4001ed-d36d-4f95-8cda-6356a24dbfbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:45.438137 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631348f-e0ac-41ce-beb1-125bd5db0da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:45.438334 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631348f-e0ac-41ce-beb1-125bd5db0da0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:45.439037 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631348f-e0ac-41ce-beb1-125bd5db0da0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:04:45.439354 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631348f-e0ac-41ce-beb1-125bd5db0da0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:45.439944 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4001ed-d36d-4f95-8cda-6356a24dbfbd admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:45.440974 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631348f-e0ac-41ce-beb1-125bd5db0da0 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:45.452549 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 799/1572] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:04:45.458991 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4001ed-d36d-4f95-8cda-6356a24dbfbd admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:45.459161 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 774/1573] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:04:45.459161 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631348f-e0ac-41ce-beb1-125bd5db0da0 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:45.469567 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4001ed-d36d-4f95-8cda-6356a24dbfbd admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:45.470116 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631348f-e0ac-41ce-beb1-125bd5db0da0 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:45.474271 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506fdf9a-237f-4be0-a151-42050d4fb83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:45.474643 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db023bc-f30d-4a8f-bbed-5bb3fc3780f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:45.474917 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fdf9a-237f-4be0-a151-42050d4fb83b admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:45.475194 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fdf9a-237f-4be0-a151-42050d4fb83b admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:45.475295 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db023bc-f30d-4a8f-bbed-5bb3fc3780f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:45.475459 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fdf9a-237f-4be0-a151-42050d4fb83b admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:45.475563 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db023bc-f30d-4a8f-bbed-5bb3fc3780f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:45.475821 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db023bc-f30d-4a8f-bbed-5bb3fc3780f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:45.476175 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506fdf9a-237f-4be0-a151-42050d4fb83b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:45.476497 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db023bc-f30d-4a8f-bbed-5bb3fc3780f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:45.478069 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506fdf9a-237f-4be0-a151-42050d4fb83b admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:45.478372 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db023bc-f30d-4a8f-bbed-5bb3fc3780f2 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:45.508706 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 800/1574] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:04:45 2022] POST /identity/v3/projects => generated 405 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:04:45.509350 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 775/1575] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:04:45 2022] POST /identity/v3/projects => generated 405 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:04:45.509489 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506fdf9a-237f-4be0-a151-42050d4fb83b admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:45.509603 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db023bc-f30d-4a8f-bbed-5bb3fc3780f2 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:45.570743 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506fdf9a-237f-4be0-a151-42050d4fb83b admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:45.574509 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db023bc-f30d-4a8f-bbed-5bb3fc3780f2 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:45.576004 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4019f7-66ab-4d78-acda-7132e43344b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:45.576668 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4019f7-66ab-4d78-acda-7132e43344b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:45.576938 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4019f7-66ab-4d78-acda-7132e43344b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:45.577198 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4019f7-66ab-4d78-acda-7132e43344b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:45.577910 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4019f7-66ab-4d78-acda-7132e43344b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:45.579501 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4019f7-66ab-4d78-acda-7132e43344b5 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:45.579896 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848fa837-8105-4f3b-81ed-92afaf18ee4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:45.580568 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fa837-8105-4f3b-81ed-92afaf18ee4d admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:45.580837 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fa837-8105-4f3b-81ed-92afaf18ee4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:45.581108 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fa837-8105-4f3b-81ed-92afaf18ee4d admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:45.581778 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848fa837-8105-4f3b-81ed-92afaf18ee4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:45.583700 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848fa837-8105-4f3b-81ed-92afaf18ee4d admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:45.589675 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 801/1576] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:04:45.590665 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4019f7-66ab-4d78-acda-7132e43344b5 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:45.602501 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4019f7-66ab-4d78-acda-7132e43344b5 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:45.607836 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc6061-a22d-4070-9cd2-c54313f13b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:45.608759 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc6061-a22d-4070-9cd2-c54313f13b39 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:45.609032 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc6061-a22d-4070-9cd2-c54313f13b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:45.609293 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc6061-a22d-4070-9cd2-c54313f13b39 admin admin] PATH_INFO: `/v3/projects/aa116ee72616411e95552f4f7f6fdf9a/users/569824a5ffb846f1a447f1195bb9c017/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:45.613900 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 776/1577] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:04:45 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:04:45.613900 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848fa837-8105-4f3b-81ed-92afaf18ee4d admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:45.625480 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848fa837-8105-4f3b-81ed-92afaf18ee4d admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:45.626209 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc6061-a22d-4070-9cd2-c54313f13b39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa116ee72616411e95552f4f7f6fdf9a, user_id=569824a5ffb846f1a447f1195bb9c017, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:45.627274 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING py.warnings [None req-33cc6061-a22d-4070-9cd2-c54313f13b39 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 03:04:45.627274 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: warnings.warn(msg) Apr 12 03:04:45.627274 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: Apr 12 03:04:45.629381 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc6061-a22d-4070-9cd2-c54313f13b39 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:45.630695 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53966939-db97-409d-897e-b0de65ba6c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:45.631391 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53966939-db97-409d-897e-b0de65ba6c4f admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:45.631667 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53966939-db97-409d-897e-b0de65ba6c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:45.632004 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53966939-db97-409d-897e-b0de65ba6c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:45.632726 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53966939-db97-409d-897e-b0de65ba6c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:45.634384 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53966939-db97-409d-897e-b0de65ba6c4f admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:45.645754 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 802/1578] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:04:45 2022] PUT /identity/v3/projects/aa116ee72616411e95552f4f7f6fdf9a/users/569824a5ffb846f1a447f1195bb9c017/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:04:45.646642 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc6061-a22d-4070-9cd2-c54313f13b39 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:45.647083 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 777/1579] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:04:45.647873 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53966939-db97-409d-897e-b0de65ba6c4f admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:45.660547 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53966939-db97-409d-897e-b0de65ba6c4f admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:45.713384 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc6061-a22d-4070-9cd2-c54313f13b39 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:45.719046 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18ff18-b0b4-455c-bced-efb0dca6e1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:45.719983 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18ff18-b0b4-455c-bced-efb0dca6e1c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:45.720268 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18ff18-b0b4-455c-bced-efb0dca6e1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:45.720538 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18ff18-b0b4-455c-bced-efb0dca6e1c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:45.721258 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18ff18-b0b4-455c-bced-efb0dca6e1c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:45.723261 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18ff18-b0b4-455c-bced-efb0dca6e1c4 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:45.728219 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae50998-9eee-4223-8a44-4fb26b3c2eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:45.729252 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae50998-9eee-4223-8a44-4fb26b3c2eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:45.729727 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae50998-9eee-4223-8a44-4fb26b3c2eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:45.730236 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae50998-9eee-4223-8a44-4fb26b3c2eb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:45.731178 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae50998-9eee-4223-8a44-4fb26b3c2eb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:45.734433 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae50998-9eee-4223-8a44-4fb26b3c2eb5 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:45.754173 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 803/1580] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:04:45 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:04:45.754173 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18ff18-b0b4-455c-bced-efb0dca6e1c4 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:45.772524 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 778/1581] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:04:45 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:04:45.772524 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae50998-9eee-4223-8a44-4fb26b3c2eb5 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:45.816122 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18ff18-b0b4-455c-bced-efb0dca6e1c4 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:45.833376 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae50998-9eee-4223-8a44-4fb26b3c2eb5 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:45.838139 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe93e1-bfe7-4bb3-b668-82873e610029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:45.838961 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe93e1-bfe7-4bb3-b668-82873e610029 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:45.839298 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe93e1-bfe7-4bb3-b668-82873e610029 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:45.839646 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe93e1-bfe7-4bb3-b668-82873e610029 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:45.840409 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe93e1-bfe7-4bb3-b668-82873e610029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:45.842472 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe93e1-bfe7-4bb3-b668-82873e610029 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:45.862104 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 779/1582] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:04:45 2022] POST /identity/v3/users => generated 303 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:04:45.862925 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe93e1-bfe7-4bb3-b668-82873e610029 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:45.869292 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d904323-a326-476d-8304-87e70118de49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:45.870025 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d904323-a326-476d-8304-87e70118de49 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:45.870302 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d904323-a326-476d-8304-87e70118de49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:45.870604 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d904323-a326-476d-8304-87e70118de49 admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:45.871259 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d904323-a326-476d-8304-87e70118de49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:45.872749 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe93e1-bfe7-4bb3-b668-82873e610029 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:45.873219 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d904323-a326-476d-8304-87e70118de49 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:45.878922 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315aafc-f249-462a-89f6-179d6543da09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:45.879590 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315aafc-f249-462a-89f6-179d6543da09 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:45.879898 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315aafc-f249-462a-89f6-179d6543da09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:45.880169 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315aafc-f249-462a-89f6-179d6543da09 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:45.880912 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315aafc-f249-462a-89f6-179d6543da09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:45.882721 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315aafc-f249-462a-89f6-179d6543da09 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:45.894246 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 780/1583] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:04:45.894957 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 804/1584] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:04:45 2022] POST /identity/v3/users => generated 303 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:04:45.896814 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315aafc-f249-462a-89f6-179d6543da09 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:45.898029 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7db2a9-b6a5-4970-bd00-4271948b6d85 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:45.898360 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7db2a9-b6a5-4970-bd00-4271948b6d85 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:45.898659 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7db2a9-b6a5-4970-bd00-4271948b6d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:45.907221 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315aafc-f249-462a-89f6-179d6543da09 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:45.912725 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f522b-62f2-4e9e-b8a3-abde0b5d99d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:45.913496 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f522b-62f2-4e9e-b8a3-abde0b5d99d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:45.913967 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f522b-62f2-4e9e-b8a3-abde0b5d99d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:45.914265 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f522b-62f2-4e9e-b8a3-abde0b5d99d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:45.915547 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f522b-62f2-4e9e-b8a3-abde0b5d99d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:45.918074 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f522b-62f2-4e9e-b8a3-abde0b5d99d0 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:45.919113 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-4f7db2a9-b6a5-4970-bd00-4271948b6d85 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:45.921279 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-4f7db2a9-b6a5-4970-bd00-4271948b6d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:45.929214 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 781/1585] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:04:45.929728 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 805/1586] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:04:45.930522 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7db2a9-b6a5-4970-bd00-4271948b6d85 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:45.932848 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f522b-62f2-4e9e-b8a3-abde0b5d99d0 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:45.940919 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7db2a9-b6a5-4970-bd00-4271948b6d85 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:45.942642 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f522b-62f2-4e9e-b8a3-abde0b5d99d0 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:45.946124 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de383fa4-ae19-4c15-8a48-045b10d35eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:45.946798 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de383fa4-ae19-4c15-8a48-045b10d35eab admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:45.947072 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de383fa4-ae19-4c15-8a48-045b10d35eab admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:45.947176 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51176f-fb19-4ca7-8018-a4d7972839e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:45.947363 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de383fa4-ae19-4c15-8a48-045b10d35eab admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:45.948122 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51176f-fb19-4ca7-8018-a4d7972839e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:45.948351 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de383fa4-ae19-4c15-8a48-045b10d35eab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:45.948539 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51176f-fb19-4ca7-8018-a4d7972839e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:45.948713 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51176f-fb19-4ca7-8018-a4d7972839e2 admin admin] PATH_INFO: `/v3/projects/e9ed2cca6cce43c599fc86b60cfafda6/users/4ded28c2ffe345ccbefde50585023857/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:45.950644 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de383fa4-ae19-4c15-8a48-045b10d35eab admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:45.963519 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51176f-fb19-4ca7-8018-a4d7972839e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9ed2cca6cce43c599fc86b60cfafda6, user_id=4ded28c2ffe345ccbefde50585023857, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:45.966319 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51176f-fb19-4ca7-8018-a4d7972839e2 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:45.972394 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 806/1587] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:04:45 2022] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:04:45.973216 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de383fa4-ae19-4c15-8a48-045b10d35eab admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:45.978969 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 782/1588] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:04:45 2022] PUT /identity/v3/projects/e9ed2cca6cce43c599fc86b60cfafda6/users/4ded28c2ffe345ccbefde50585023857/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:04:45.979887 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51176f-fb19-4ca7-8018-a4d7972839e2 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:45.983239 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de383fa4-ae19-4c15-8a48-045b10d35eab admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:46.045898 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b48a26-1d65-4af3-86c8-3e001c482023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:46.046134 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51176f-fb19-4ca7-8018-a4d7972839e2 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:46.046570 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b48a26-1d65-4af3-86c8-3e001c482023 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:46.046843 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b48a26-1d65-4af3-86c8-3e001c482023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:46.047106 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b48a26-1d65-4af3-86c8-3e001c482023 admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:46.047910 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b48a26-1d65-4af3-86c8-3e001c482023 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:46.049951 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b48a26-1d65-4af3-86c8-3e001c482023 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:46.050688 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4425b1-712c-4e2e-a1ce-49d081765c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:46.051372 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4425b1-712c-4e2e-a1ce-49d081765c74 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:46.051648 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4425b1-712c-4e2e-a1ce-49d081765c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:46.051954 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4425b1-712c-4e2e-a1ce-49d081765c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:46.052672 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4425b1-712c-4e2e-a1ce-49d081765c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:46.054296 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4425b1-712c-4e2e-a1ce-49d081765c74 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:46.065387 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 783/1589] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:04:46.068086 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4425b1-712c-4e2e-a1ce-49d081765c74 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:46.074203 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 807/1590] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:04:45 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:04:46.075049 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b48a26-1d65-4af3-86c8-3e001c482023 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:46.076222 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4425b1-712c-4e2e-a1ce-49d081765c74 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:46.080827 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66bd644-3c6d-45cc-8ab8-49c924a57856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:46.081713 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bd644-3c6d-45cc-8ab8-49c924a57856 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:46.082016 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bd644-3c6d-45cc-8ab8-49c924a57856 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:46.082527 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bd644-3c6d-45cc-8ab8-49c924a57856 admin admin] PATH_INFO: `/v3/projects/6e829d30ff584a2da0cb9ab3d40cbcdd/users/2131e6cb76d7423dab452a69b1b60f44/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:46.085677 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b48a26-1d65-4af3-86c8-3e001c482023 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:46.092109 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225bbfe-8f24-4f12-b298-86e1901e96e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:46.092832 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225bbfe-8f24-4f12-b298-86e1901e96e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:46.093113 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225bbfe-8f24-4f12-b298-86e1901e96e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:46.093386 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225bbfe-8f24-4f12-b298-86e1901e96e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:46.094110 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225bbfe-8f24-4f12-b298-86e1901e96e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:46.095754 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225bbfe-8f24-4f12-b298-86e1901e96e6 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:46.100068 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66bd644-3c6d-45cc-8ab8-49c924a57856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e829d30ff584a2da0cb9ab3d40cbcdd, user_id=2131e6cb76d7423dab452a69b1b60f44, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:46.104311 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66bd644-3c6d-45cc-8ab8-49c924a57856 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:46.106288 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 808/1591] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:04:46.107116 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225bbfe-8f24-4f12-b298-86e1901e96e6 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:46.118530 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 784/1592] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:04:46 2022] PUT /identity/v3/projects/6e829d30ff584a2da0cb9ab3d40cbcdd/users/2131e6cb76d7423dab452a69b1b60f44/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:04:46.119374 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66bd644-3c6d-45cc-8ab8-49c924a57856 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:46.120611 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225bbfe-8f24-4f12-b298-86e1901e96e6 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:46.188821 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66bd644-3c6d-45cc-8ab8-49c924a57856 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:46.192555 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d76b89-e4a8-4ee1-bf8b-e03dc09ba4d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:46.192891 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87278177-2987-438e-98d6-533530c8b278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:46.193246 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d76b89-e4a8-4ee1-bf8b-e03dc09ba4d7 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:46.193517 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d76b89-e4a8-4ee1-bf8b-e03dc09ba4d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:46.193781 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d76b89-e4a8-4ee1-bf8b-e03dc09ba4d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:46.194136 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87278177-2987-438e-98d6-533530c8b278 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:46.194607 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87278177-2987-438e-98d6-533530c8b278 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:46.195036 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87278177-2987-438e-98d6-533530c8b278 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:46.196321 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87278177-2987-438e-98d6-533530c8b278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:46.198290 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87278177-2987-438e-98d6-533530c8b278 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:46.208195 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d76b89-e4a8-4ee1-bf8b-e03dc09ba4d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:46.209707 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d76b89-e4a8-4ee1-bf8b-e03dc09ba4d7 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:46.212901 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 809/1593] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:04:46.217090 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87278177-2987-438e-98d6-533530c8b278 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:46.220523 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 785/1594] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:04:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:04:46.221851 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020d4f0-2288-4abc-9df5-49f2d8ac82ad None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:46.222282 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020d4f0-2288-4abc-9df5-49f2d8ac82ad None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:46.222422 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020d4f0-2288-4abc-9df5-49f2d8ac82ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:46.227460 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87278177-2987-438e-98d6-533530c8b278 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:46.235401 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591bb1f7-2626-4459-aee2-fdf327570bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:46.236727 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bb1f7-2626-4459-aee2-fdf327570bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:46.236894 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bb1f7-2626-4459-aee2-fdf327570bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:46.237189 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bb1f7-2626-4459-aee2-fdf327570bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:46.237909 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591bb1f7-2626-4459-aee2-fdf327570bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:46.240456 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591bb1f7-2626-4459-aee2-fdf327570bd1 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:46.240572 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-c020d4f0-2288-4abc-9df5-49f2d8ac82ad None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:46.241765 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-c020d4f0-2288-4abc-9df5-49f2d8ac82ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:46.250367 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 786/1595] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:04:46.251284 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020d4f0-2288-4abc-9df5-49f2d8ac82ad None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:46.256561 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 810/1596] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:04:46.257933 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591bb1f7-2626-4459-aee2-fdf327570bd1 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:46.261494 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020d4f0-2288-4abc-9df5-49f2d8ac82ad None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:46.266965 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d5aff-61d0-4a24-8147-8bfd6d6966ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:46.267181 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d5aff-61d0-4a24-8147-8bfd6d6966ee admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:46.267461 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d5aff-61d0-4a24-8147-8bfd6d6966ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:46.267892 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d5aff-61d0-4a24-8147-8bfd6d6966ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:46.268587 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d5aff-61d0-4a24-8147-8bfd6d6966ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:46.270188 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d5aff-61d0-4a24-8147-8bfd6d6966ee admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:46.271114 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591bb1f7-2626-4459-aee2-fdf327570bd1 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:46.277965 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5fde79-9e92-4d6b-98c7-055db3f09965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:46.279195 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fde79-9e92-4d6b-98c7-055db3f09965 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:46.279698 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fde79-9e92-4d6b-98c7-055db3f09965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:46.280165 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fde79-9e92-4d6b-98c7-055db3f09965 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:46.280973 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5fde79-9e92-4d6b-98c7-055db3f09965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:46.282733 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 787/1597] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:04:46.282876 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5fde79-9e92-4d6b-98c7-055db3f09965 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:46.283371 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d5aff-61d0-4a24-8147-8bfd6d6966ee admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:46.293309 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d5aff-61d0-4a24-8147-8bfd6d6966ee admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:46.296646 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 811/1598] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:04:46.298231 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bf04a-3441-4395-ad73-61a0c4cb03a1 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:46.298386 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87100c88-51b1-4ade-961c-a1c0c104d118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:46.298621 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bf04a-3441-4395-ad73-61a0c4cb03a1 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:46.298738 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87100c88-51b1-4ade-961c-a1c0c104d118 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:46.298965 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87100c88-51b1-4ade-961c-a1c0c104d118 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:46.299070 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bf04a-3441-4395-ad73-61a0c4cb03a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:46.299229 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87100c88-51b1-4ade-961c-a1c0c104d118 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:46.299975 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87100c88-51b1-4ade-961c-a1c0c104d118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:46.301606 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87100c88-51b1-4ade-961c-a1c0c104d118 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:46.316998 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 788/1599] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:04:46.316998 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87100c88-51b1-4ade-961c-a1c0c104d118 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:46.331433 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-844bf04a-3441-4395-ad73-61a0c4cb03a1 None None] MFA Rules not processed for user `2131e6cb76d7423dab452a69b1b60f44`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:46.332879 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87100c88-51b1-4ade-961c-a1c0c104d118 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:46.333037 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-844bf04a-3441-4395-ad73-61a0c4cb03a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:46.339762 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411a956-43bb-4639-b246-6a25347f2e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:46.340799 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411a956-43bb-4639-b246-6a25347f2e8e admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:46.341133 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411a956-43bb-4639-b246-6a25347f2e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:46.341551 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411a956-43bb-4639-b246-6a25347f2e8e admin admin] PATH_INFO: `/v3/projects/52b2d02e7570468daabac047ad3a7fa5/users/c22f5695481341419674da058685a2d5/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:46.360201 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411a956-43bb-4639-b246-6a25347f2e8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b2d02e7570468daabac047ad3a7fa5, user_id=c22f5695481341419674da058685a2d5, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:46.363097 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411a956-43bb-4639-b246-6a25347f2e8e admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:46.379785 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 789/1600] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:04:46 2022] PUT /identity/v3/projects/52b2d02e7570468daabac047ad3a7fa5/users/c22f5695481341419674da058685a2d5/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:04:46.381435 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411a956-43bb-4639-b246-6a25347f2e8e admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:46.428106 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 812/1601] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:04:46.429227 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844bf04a-3441-4395-ad73-61a0c4cb03a1 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:46.442483 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844bf04a-3441-4395-ad73-61a0c4cb03a1 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:46.473602 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411a956-43bb-4639-b246-6a25347f2e8e admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:46.480215 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83ba0b-ebf3-429c-afc3-9c1bd7d5c8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:46.481646 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83ba0b-ebf3-429c-afc3-9c1bd7d5c8dc admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:46.481924 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83ba0b-ebf3-429c-afc3-9c1bd7d5c8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:46.482190 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83ba0b-ebf3-429c-afc3-9c1bd7d5c8dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:46.483598 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83ba0b-ebf3-429c-afc3-9c1bd7d5c8dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:46.486575 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83ba0b-ebf3-429c-afc3-9c1bd7d5c8dc admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:46.500683 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 790/1602] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:04:46.501649 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83ba0b-ebf3-429c-afc3-9c1bd7d5c8dc admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:46.504552 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e338d0-43dc-4600-b418-3452949aa9e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:46.505409 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e338d0-43dc-4600-b418-3452949aa9e2 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:46.505848 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e338d0-43dc-4600-b418-3452949aa9e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:46.506117 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e338d0-43dc-4600-b418-3452949aa9e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:46.514064 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83ba0b-ebf3-429c-afc3-9c1bd7d5c8dc admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:46.516706 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e338d0-43dc-4600-b418-3452949aa9e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:46.518787 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e338d0-43dc-4600-b418-3452949aa9e2 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:46.521068 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a093f2-8e51-4c7a-bd60-99327a9e1c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:46.522582 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a093f2-8e51-4c7a-bd60-99327a9e1c88 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:46.523048 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a093f2-8e51-4c7a-bd60-99327a9e1c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:46.523358 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a093f2-8e51-4c7a-bd60-99327a9e1c88 admin admin] PATH_INFO: `/v3/projects/1bfa2e50a0ff463ba5bb50c6edc5407f/users/d0f3167fe02a4341bc0a8471ed569296/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:46.531633 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 813/1603] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:04:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:04:46.532773 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e338d0-43dc-4600-b418-3452949aa9e2 service neutron] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:46.545819 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e338d0-43dc-4600-b418-3452949aa9e2 service neutron] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:46.548521 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a093f2-8e51-4c7a-bd60-99327a9e1c88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bfa2e50a0ff463ba5bb50c6edc5407f, user_id=d0f3167fe02a4341bc0a8471ed569296, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:46.550911 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82ca03-abb6-4c5d-adad-c27cb0b26d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:46.551388 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a093f2-8e51-4c7a-bd60-99327a9e1c88 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:46.552906 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82ca03-abb6-4c5d-adad-c27cb0b26d7e admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:46.553336 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82ca03-abb6-4c5d-adad-c27cb0b26d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:46.553597 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82ca03-abb6-4c5d-adad-c27cb0b26d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:46.555185 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82ca03-abb6-4c5d-adad-c27cb0b26d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:46.557753 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82ca03-abb6-4c5d-adad-c27cb0b26d7e admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:46.572638 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 791/1604] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:04:46 2022] PUT /identity/v3/projects/1bfa2e50a0ff463ba5bb50c6edc5407f/users/d0f3167fe02a4341bc0a8471ed569296/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:04:46.573913 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a093f2-8e51-4c7a-bd60-99327a9e1c88 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:46.583909 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 814/1605] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:04:46.585473 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464db76-4ac3-431d-ae32-dbf8ece202e3 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:46.585850 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464db76-4ac3-431d-ae32-dbf8ece202e3 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:46.586207 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464db76-4ac3-431d-ae32-dbf8ece202e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:46.614733 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-e464db76-4ac3-431d-ae32-dbf8ece202e3 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:46.616530 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-e464db76-4ac3-431d-ae32-dbf8ece202e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:46.667433 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a093f2-8e51-4c7a-bd60-99327a9e1c88 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:46.674250 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db030dc9-01fb-48d3-a664-851868bcd985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:46.675715 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db030dc9-01fb-48d3-a664-851868bcd985 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:46.676210 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db030dc9-01fb-48d3-a664-851868bcd985 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:46.676712 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db030dc9-01fb-48d3-a664-851868bcd985 admin admin] PATH_INFO: `/v3/projects/b51230fa3e9e4ec48777641734b066ce/users/0c8aa4dc32064d7d85685c1c60231172/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:46.701137 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db030dc9-01fb-48d3-a664-851868bcd985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b51230fa3e9e4ec48777641734b066ce, user_id=0c8aa4dc32064d7d85685c1c60231172, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:46.704611 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db030dc9-01fb-48d3-a664-851868bcd985 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:46.709003 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 815/1606] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:04:46.710208 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464db76-4ac3-431d-ae32-dbf8ece202e3 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:46.724275 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464db76-4ac3-431d-ae32-dbf8ece202e3 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:46.728013 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 792/1607] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:04:46 2022] PUT /identity/v3/projects/b51230fa3e9e4ec48777641734b066ce/users/0c8aa4dc32064d7d85685c1c60231172/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:04:46.729389 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db030dc9-01fb-48d3-a664-851868bcd985 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:46.812342 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70cbf4-e1e0-4f11-84dc-fa1251691bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:46.813363 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70cbf4-e1e0-4f11-84dc-fa1251691bd0 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:46.813690 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70cbf4-e1e0-4f11-84dc-fa1251691bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:46.814029 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70cbf4-e1e0-4f11-84dc-fa1251691bd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:46.814990 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70cbf4-e1e0-4f11-84dc-fa1251691bd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:46.818869 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70cbf4-e1e0-4f11-84dc-fa1251691bd0 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:46.825201 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db030dc9-01fb-48d3-a664-851868bcd985 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:46.832406 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44ed43-5771-4681-a87f-c48fe65121fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:46.833510 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44ed43-5771-4681-a87f-c48fe65121fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:46.834005 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44ed43-5771-4681-a87f-c48fe65121fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:46.834335 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44ed43-5771-4681-a87f-c48fe65121fc admin admin] PATH_INFO: `/v3/projects/82496cc7388048ccb95596e852280502/users/42d4c3f4a3d548bda06b450a63074b04/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:46.853431 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa44ed43-5771-4681-a87f-c48fe65121fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=82496cc7388048ccb95596e852280502, user_id=42d4c3f4a3d548bda06b450a63074b04, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:46.856348 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 816/1608] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:04:46 2022] POST /identity/v3/projects => generated 367 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:04:46.858475 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff1761-b778-4e3d-9478-7000fc26255f None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:46.858821 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff1761-b778-4e3d-9478-7000fc26255f None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:46.859180 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff1761-b778-4e3d-9478-7000fc26255f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:46.860165 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa44ed43-5771-4681-a87f-c48fe65121fc admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:46.882139 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-5dff1761-b778-4e3d-9478-7000fc26255f None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:46.883759 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-5dff1761-b778-4e3d-9478-7000fc26255f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:46.885613 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 793/1609] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:04:46 2022] PUT /identity/v3/projects/82496cc7388048ccb95596e852280502/users/42d4c3f4a3d548bda06b450a63074b04/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:04:46.886887 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44ed43-5771-4681-a87f-c48fe65121fc admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:46.977629 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 817/1610] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:04:46.978486 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff1761-b778-4e3d-9478-7000fc26255f None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:46.999238 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44ed43-5771-4681-a87f-c48fe65121fc admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:47.005496 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f47a57-c2fa-43ac-815e-b7a206c14fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:47.006409 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f47a57-c2fa-43ac-815e-b7a206c14fa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:47.006923 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f47a57-c2fa-43ac-815e-b7a206c14fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:47.007191 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f47a57-c2fa-43ac-815e-b7a206c14fa4 admin admin] PATH_INFO: `/v3/projects/e1e5d1d0e5ee459d9a29175e6dfae245/users/d452c4f1c0ac4646ac7869552de56b96/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:47.029477 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f47a57-c2fa-43ac-815e-b7a206c14fa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1e5d1d0e5ee459d9a29175e6dfae245, user_id=d452c4f1c0ac4646ac7869552de56b96, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:47.033272 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f47a57-c2fa-43ac-815e-b7a206c14fa4 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:47.056442 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 794/1611] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:04:46 2022] PUT /identity/v3/projects/e1e5d1d0e5ee459d9a29175e6dfae245/users/d452c4f1c0ac4646ac7869552de56b96/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:04:47.057945 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d51b1-c92f-43b3-ab19-51e8e3179e64 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:47.058230 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d51b1-c92f-43b3-ab19-51e8e3179e64 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:47.058496 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d51b1-c92f-43b3-ab19-51e8e3179e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:47.060170 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff1761-b778-4e3d-9478-7000fc26255f None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:47.089206 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-452d51b1-c92f-43b3-ab19-51e8e3179e64 None None] MFA Rules not processed for user `0c8aa4dc32064d7d85685c1c60231172`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:47.091468 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-452d51b1-c92f-43b3-ab19-51e8e3179e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:47.141611 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d5a41-10c2-49c7-b516-a6905e0acd5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:47.142316 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d5a41-10c2-49c7-b516-a6905e0acd5e service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:47.142596 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d5a41-10c2-49c7-b516-a6905e0acd5e service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:47.142934 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d5a41-10c2-49c7-b516-a6905e0acd5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:47.167981 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 795/1612] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:47 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:04:47.169018 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d51b1-c92f-43b3-ab19-51e8e3179e64 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:47.232996 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d5a41-10c2-49c7-b516-a6905e0acd5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:47.234831 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d5a41-10c2-49c7-b516-a6905e0acd5e service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:47.247295 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 818/1613] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:04:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:04:47.249114 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d09cb-4469-421f-a049-541945804661 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:47.250224 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d09cb-4469-421f-a049-541945804661 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:47.250493 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d09cb-4469-421f-a049-541945804661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:47.268228 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d51b1-c92f-43b3-ab19-51e8e3179e64 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:47.270625 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-aa7d09cb-4469-421f-a049-541945804661 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:47.272351 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-aa7d09cb-4469-421f-a049-541945804661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:47.282772 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 819/1614] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:04:47.283432 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d09cb-4469-421f-a049-541945804661 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:47.284947 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-aa7d09cb-4469-421f-a049-541945804661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:47.287791 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b382dd3-3caa-4a19-aa47-00c471cb4444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:47.289775 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b382dd3-3caa-4a19-aa47-00c471cb4444 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:47.289775 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b382dd3-3caa-4a19-aa47-00c471cb4444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:47.289775 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b382dd3-3caa-4a19-aa47-00c471cb4444 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:47.290270 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b382dd3-3caa-4a19-aa47-00c471cb4444 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:47.292323 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b382dd3-3caa-4a19-aa47-00c471cb4444 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:47.305886 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d09cb-4469-421f-a049-541945804661 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:47.311186 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cca89b-b9cf-499d-9574-e689f62617f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:47.312626 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cca89b-b9cf-499d-9574-e689f62617f5 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:47.312944 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cca89b-b9cf-499d-9574-e689f62617f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:47.313158 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cca89b-b9cf-499d-9574-e689f62617f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:47.322299 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 796/1615] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:04:47 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:04:47.324285 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e5d1f-706b-4b2c-9e5c-444a38720ab8 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:47.324807 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e5d1f-706b-4b2c-9e5c-444a38720ab8 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:47.325746 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e5d1f-706b-4b2c-9e5c-444a38720ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:47.325941 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cca89b-b9cf-499d-9574-e689f62617f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:47.328382 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cca89b-b9cf-499d-9574-e689f62617f5 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:47.342775 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 820/1616] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:04:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:04:47.344795 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cca89b-b9cf-499d-9574-e689f62617f5 service neutron] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:47.346822 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-446e5d1f-706b-4b2c-9e5c-444a38720ab8 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:47.348302 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-446e5d1f-706b-4b2c-9e5c-444a38720ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:47.358094 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 797/1617] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:04:47.359313 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e5d1f-706b-4b2c-9e5c-444a38720ab8 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:47.363367 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cca89b-b9cf-499d-9574-e689f62617f5 service neutron] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:47.371364 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e5d1f-706b-4b2c-9e5c-444a38720ab8 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:47.371973 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903b338-89a9-4634-9453-6244cd609ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:47.372785 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903b338-89a9-4634-9453-6244cd609ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:47.373113 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903b338-89a9-4634-9453-6244cd609ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:47.373390 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903b338-89a9-4634-9453-6244cd609ef8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:47.374176 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903b338-89a9-4634-9453-6244cd609ef8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:47.376698 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903b338-89a9-4634-9453-6244cd609ef8 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:47.378733 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84906fa0-99d8-4fa9-87ee-6e077f56b0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:47.379686 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84906fa0-99d8-4fa9-87ee-6e077f56b0da admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:47.380219 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84906fa0-99d8-4fa9-87ee-6e077f56b0da admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:47.380740 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84906fa0-99d8-4fa9-87ee-6e077f56b0da admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:47.381662 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84906fa0-99d8-4fa9-87ee-6e077f56b0da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:47.383697 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84906fa0-99d8-4fa9-87ee-6e077f56b0da admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:47.396665 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 798/1618] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:04:47.398093 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84906fa0-99d8-4fa9-87ee-6e077f56b0da admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:47.410444 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84906fa0-99d8-4fa9-87ee-6e077f56b0da admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:47.414561 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 821/1619] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:04:47 2022] POST /identity/v3/projects => generated 405 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:04:47.414865 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ebf2c-e24c-4dbb-94ad-3926fc7ad2ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:47.415634 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ebf2c-e24c-4dbb-94ad-3926fc7ad2ba service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:47.416053 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ebf2c-e24c-4dbb-94ad-3926fc7ad2ba service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:47.416557 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ebf2c-e24c-4dbb-94ad-3926fc7ad2ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:47.424474 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903b338-89a9-4634-9453-6244cd609ef8 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:47.443010 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ebf2c-e24c-4dbb-94ad-3926fc7ad2ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:47.445050 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ebf2c-e24c-4dbb-94ad-3926fc7ad2ba service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:47.458337 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 799/1620] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:04:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:04:47.459755 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ebf2c-e24c-4dbb-94ad-3926fc7ad2ba service neutron] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:47.483881 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ebf2c-e24c-4dbb-94ad-3926fc7ad2ba service neutron] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:47.512920 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903b338-89a9-4634-9453-6244cd609ef8 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:47.519409 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d485972-4e5c-47e9-aa46-16f79391dd95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:47.520173 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d485972-4e5c-47e9-aa46-16f79391dd95 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:47.520480 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d485972-4e5c-47e9-aa46-16f79391dd95 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:47.520719 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d485972-4e5c-47e9-aa46-16f79391dd95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:47.583736 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c460e-59c7-4a14-9fcd-6ec3db33db65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:47.584867 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c460e-59c7-4a14-9fcd-6ec3db33db65 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:47.585615 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c460e-59c7-4a14-9fcd-6ec3db33db65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:47.586513 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c460e-59c7-4a14-9fcd-6ec3db33db65 admin admin] PATH_INFO: `/v3/projects/77dd7860d12644818e5110014bd6b574/users/388562179881468d91af03f35307be35/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:47.606998 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c460e-59c7-4a14-9fcd-6ec3db33db65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77dd7860d12644818e5110014bd6b574, user_id=388562179881468d91af03f35307be35, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:47.610831 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c460e-59c7-4a14-9fcd-6ec3db33db65 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:47.624772 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d485972-4e5c-47e9-aa46-16f79391dd95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:47.626700 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d485972-4e5c-47e9-aa46-16f79391dd95 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:47.633638 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 800/1621] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:04:47 2022] PUT /identity/v3/projects/77dd7860d12644818e5110014bd6b574/users/388562179881468d91af03f35307be35/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:04:47.634736 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c460e-59c7-4a14-9fcd-6ec3db33db65 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:47.643147 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 822/1622] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:04:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:04:47.644069 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d485972-4e5c-47e9-aa46-16f79391dd95 service neutron] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:47.654551 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d485972-4e5c-47e9-aa46-16f79391dd95 service neutron] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:47.727329 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c460e-59c7-4a14-9fcd-6ec3db33db65 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:47.734363 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e667a-13da-4b4f-b503-81a743752b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:47.734984 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e667a-13da-4b4f-b503-81a743752b60 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:47.735261 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e667a-13da-4b4f-b503-81a743752b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:47.735541 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e667a-13da-4b4f-b503-81a743752b60 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:47.736554 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e667a-13da-4b4f-b503-81a743752b60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:47.740399 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e667a-13da-4b4f-b503-81a743752b60 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:47.774749 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 801/1623] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:04:47 2022] POST /identity/v3/users => generated 309 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:04:47.777045 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e667a-13da-4b4f-b503-81a743752b60 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:47.790716 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e667a-13da-4b4f-b503-81a743752b60 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:47.793934 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b2f25-e69f-4078-b1fe-3f32a33249c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:47.794701 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b2f25-e69f-4078-b1fe-3f32a33249c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:47.794982 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b2f25-e69f-4078-b1fe-3f32a33249c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:47.795247 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b2f25-e69f-4078-b1fe-3f32a33249c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:47.796193 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b2f25-e69f-4078-b1fe-3f32a33249c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:47.798034 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d73d3-0beb-455f-a9ff-e2d5beaa0bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:47.798196 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b2f25-e69f-4078-b1fe-3f32a33249c8 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:47.798825 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d73d3-0beb-455f-a9ff-e2d5beaa0bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:47.799109 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d73d3-0beb-455f-a9ff-e2d5beaa0bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:47.799635 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d73d3-0beb-455f-a9ff-e2d5beaa0bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:47.800408 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d73d3-0beb-455f-a9ff-e2d5beaa0bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:47.802622 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d73d3-0beb-455f-a9ff-e2d5beaa0bb0 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:47.820947 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 823/1624] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:04:47.824876 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 802/1625] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:04:47.825073 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b2f25-e69f-4078-b1fe-3f32a33249c8 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:47.826869 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d73d3-0beb-455f-a9ff-e2d5beaa0bb0 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:47.839797 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d73d3-0beb-455f-a9ff-e2d5beaa0bb0 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:47.843300 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b2f25-e69f-4078-b1fe-3f32a33249c8 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:47.845594 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b6cd8-0722-4fb8-b8c2-bb3cc2a4dcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:47.846508 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b6cd8-0722-4fb8-b8c2-bb3cc2a4dcf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:47.846785 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b6cd8-0722-4fb8-b8c2-bb3cc2a4dcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:47.847172 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b6cd8-0722-4fb8-b8c2-bb3cc2a4dcf9 admin admin] PATH_INFO: `/v3/projects/77dd7860d12644818e5110014bd6b574/users/388562179881468d91af03f35307be35/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:47.849165 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7516f83-5611-4e62-9223-44dd07ffd7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:47.849467 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886b6cd8-0722-4fb8-b8c2-bb3cc2a4dcf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77dd7860d12644818e5110014bd6b574, user_id=388562179881468d91af03f35307be35, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:47.850059 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7516f83-5611-4e62-9223-44dd07ffd7b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:47.850330 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7516f83-5611-4e62-9223-44dd07ffd7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:47.850594 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7516f83-5611-4e62-9223-44dd07ffd7b7 admin admin] PATH_INFO: `/v3/projects/ed8889e4ef064eaa8ceceb856d439862/users/4ba76eba6a3043ef924d39f44b54b9bd/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:47.852308 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886b6cd8-0722-4fb8-b8c2-bb3cc2a4dcf9 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:47.876130 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 803/1626] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:04:47 2022] PUT /identity/v3/projects/77dd7860d12644818e5110014bd6b574/users/388562179881468d91af03f35307be35/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:04:47.888626 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c10fa-7360-4f01-bf47-61a53079701b None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:47.889220 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c10fa-7360-4f01-bf47-61a53079701b None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:47.889783 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c10fa-7360-4f01-bf47-61a53079701b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:47.891537 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7516f83-5611-4e62-9223-44dd07ffd7b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed8889e4ef064eaa8ceceb856d439862, user_id=4ba76eba6a3043ef924d39f44b54b9bd, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:47.894265 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7516f83-5611-4e62-9223-44dd07ffd7b7 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:47.926831 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 824/1627] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:04:47 2022] PUT /identity/v3/projects/ed8889e4ef064eaa8ceceb856d439862/users/4ba76eba6a3043ef924d39f44b54b9bd/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:04:47.931553 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7516f83-5611-4e62-9223-44dd07ffd7b7 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:47.936794 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-dd0c10fa-7360-4f01-bf47-61a53079701b None None] MFA Rules not processed for user `388562179881468d91af03f35307be35`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:47.938191 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-dd0c10fa-7360-4f01-bf47-61a53079701b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:48.018316 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7516f83-5611-4e62-9223-44dd07ffd7b7 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:48.023990 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6cc07-3ae0-44b9-aae0-411c9d99d02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:48.025411 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6cc07-3ae0-44b9-aae0-411c9d99d02a admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:48.025411 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6cc07-3ae0-44b9-aae0-411c9d99d02a admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:48.025670 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6cc07-3ae0-44b9-aae0-411c9d99d02a admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:48.026515 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6cc07-3ae0-44b9-aae0-411c9d99d02a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:48.028726 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6cc07-3ae0-44b9-aae0-411c9d99d02a admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:48.036615 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 804/1628] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:47 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:04:48.040621 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 825/1629] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:04:48.048702 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c10fa-7360-4f01-bf47-61a53079701b None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:48.048938 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6cc07-3ae0-44b9-aae0-411c9d99d02a admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:48.065990 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c10fa-7360-4f01-bf47-61a53079701b None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:48.075968 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad12967-4637-4a8d-b3b5-d4a022469481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:48.077032 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad12967-4637-4a8d-b3b5-d4a022469481 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:48.077482 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad12967-4637-4a8d-b3b5-d4a022469481 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:48.077850 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad12967-4637-4a8d-b3b5-d4a022469481 admin admin] PATH_INFO: `/v3/projects/ed8889e4ef064eaa8ceceb856d439862/users/4ba76eba6a3043ef924d39f44b54b9bd/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:48.082202 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad12967-4637-4a8d-b3b5-d4a022469481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed8889e4ef064eaa8ceceb856d439862, user_id=4ba76eba6a3043ef924d39f44b54b9bd, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:48.085379 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad12967-4637-4a8d-b3b5-d4a022469481 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:48.118572 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 805/1630] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:04:48 2022] PUT /identity/v3/projects/ed8889e4ef064eaa8ceceb856d439862/users/4ba76eba6a3043ef924d39f44b54b9bd/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:04:48.120621 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064b1b2-e122-4b4e-9703-58446ebf38dd None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:48.121010 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064b1b2-e122-4b4e-9703-58446ebf38dd None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:48.121403 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064b1b2-e122-4b4e-9703-58446ebf38dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:48.194132 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-d064b1b2-e122-4b4e-9703-58446ebf38dd None None] MFA Rules not processed for user `4ba76eba6a3043ef924d39f44b54b9bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:48.194660 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6cc07-3ae0-44b9-aae0-411c9d99d02a admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:48.198506 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-d064b1b2-e122-4b4e-9703-58446ebf38dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:48.283388 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46fded-bc91-4756-af78-5b6bf9a0544c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:48.289752 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46fded-bc91-4756-af78-5b6bf9a0544c service cinder] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:48.290115 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46fded-bc91-4756-af78-5b6bf9a0544c service cinder] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:48.290313 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46fded-bc91-4756-af78-5b6bf9a0544c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:48.306529 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 806/1631] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:48 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:04:48.326197 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064b1b2-e122-4b4e-9703-58446ebf38dd None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:48.350693 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064b1b2-e122-4b4e-9703-58446ebf38dd None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:48.356771 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667f5b5-c056-4cc1-9473-d24387a3c57d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:48.357786 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667f5b5-c056-4cc1-9473-d24387a3c57d service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:48.358361 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667f5b5-c056-4cc1-9473-d24387a3c57d service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:48.358799 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667f5b5-c056-4cc1-9473-d24387a3c57d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:48.371893 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667f5b5-c056-4cc1-9473-d24387a3c57d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:48.373726 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667f5b5-c056-4cc1-9473-d24387a3c57d service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:48.380861 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46fded-bc91-4756-af78-5b6bf9a0544c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:48.382735 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46fded-bc91-4756-af78-5b6bf9a0544c service cinder] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:48.401262 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 807/1632] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:04:48 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 03:04:48.424565 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 826/1633] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:04:48 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:04:48.504167 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667f5b5-c056-4cc1-9473-d24387a3c57d service cinder] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:48.523254 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667f5b5-c056-4cc1-9473-d24387a3c57d service cinder] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:48.535210 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfefd7-234a-4c90-bd6b-fdfd2700de38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:48.536049 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfefd7-234a-4c90-bd6b-fdfd2700de38 service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:48.536394 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfefd7-234a-4c90-bd6b-fdfd2700de38 service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:48.536716 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfefd7-234a-4c90-bd6b-fdfd2700de38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:48.651697 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfefd7-234a-4c90-bd6b-fdfd2700de38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:48.653611 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfefd7-234a-4c90-bd6b-fdfd2700de38 service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:48.676034 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 808/1634] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:04:48 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:04:48.813383 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46fded-bc91-4756-af78-5b6bf9a0544c service cinder] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:48.944009 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46fded-bc91-4756-af78-5b6bf9a0544c service cinder] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:48.950644 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c71b2-8e47-404b-9159-742ba09dabb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:48.951964 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c71b2-8e47-404b-9159-742ba09dabb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:48.952562 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c71b2-8e47-404b-9159-742ba09dabb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:48.952689 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c71b2-8e47-404b-9159-742ba09dabb2 admin admin] PATH_INFO: `/v3/users/0c8aa4dc32064d7d85685c1c60231172` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:48.954129 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c71b2-8e47-404b-9159-742ba09dabb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c8aa4dc32064d7d85685c1c60231172)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:48.955302 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: WARNING py.warnings [None req-8d2c71b2-8e47-404b-9159-742ba09dabb2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 03:04:48.955302 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: warnings.warn(msg) Apr 12 03:04:48.955302 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: Apr 12 03:04:48.956878 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c71b2-8e47-404b-9159-742ba09dabb2 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:49.063436 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-8d2c71b2-8e47-404b-9159-742ba09dabb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c8aa4dc32064d7d85685c1c60231172'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:49.093197 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-8d2c71b2-8e47-404b-9159-742ba09dabb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c8aa4dc32064d7d85685c1c60231172'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:49.095501 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-8d2c71b2-8e47-404b-9159-742ba09dabb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c8aa4dc32064d7d85685c1c60231172'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:49.096654 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-8d2c71b2-8e47-404b-9159-742ba09dabb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c8aa4dc32064d7d85685c1c60231172'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:49.131664 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-8d2c71b2-8e47-404b-9159-742ba09dabb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c8aa4dc32064d7d85685c1c60231172'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:49.157959 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 827/1635] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:04:48 2022] DELETE /identity/v3/users/0c8aa4dc32064d7d85685c1c60231172 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:04:49.160464 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e800b-e328-4835-b690-c341e25f7a45 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:49.160961 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e800b-e328-4835-b690-c341e25f7a45 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:49.161076 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e800b-e328-4835-b690-c341e25f7a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:49.198624 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-d73e800b-e328-4835-b690-c341e25f7a45 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:49.202537 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-d73e800b-e328-4835-b690-c341e25f7a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:49.343036 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 809/1636] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:04:49.371240 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c71b2-8e47-404b-9159-742ba09dabb2 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:49.373477 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-8d2c71b2-8e47-404b-9159-742ba09dabb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:49.511215 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c71b2-8e47-404b-9159-742ba09dabb2 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:49.516038 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0397c6-85b1-4b14-ba98-57baf3ba989d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:49.517256 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0397c6-85b1-4b14-ba98-57baf3ba989d service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:49.517891 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0397c6-85b1-4b14-ba98-57baf3ba989d service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:49.518982 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0397c6-85b1-4b14-ba98-57baf3ba989d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:49.536706 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0397c6-85b1-4b14-ba98-57baf3ba989d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:49.538813 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0397c6-85b1-4b14-ba98-57baf3ba989d service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:49.564537 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 828/1637] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:04:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:04:50.016107 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd22cbf-dd35-443e-8fa4-d72d6dcf4d40 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:50.016107 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd22cbf-dd35-443e-8fa4-d72d6dcf4d40 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:50.016107 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd22cbf-dd35-443e-8fa4-d72d6dcf4d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:50.060866 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-7dd22cbf-dd35-443e-8fa4-d72d6dcf4d40 None None] MFA Rules not processed for user `d0f3167fe02a4341bc0a8471ed569296`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:50.062961 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-7dd22cbf-dd35-443e-8fa4-d72d6dcf4d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:50.143078 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 810/1638] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:50 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:04:50.144322 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0397c6-85b1-4b14-ba98-57baf3ba989d service neutron] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:50.145761 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-9d0397c6-85b1-4b14-ba98-57baf3ba989d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:50.158566 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0397c6-85b1-4b14-ba98-57baf3ba989d service neutron] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:50.164286 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd953d1-8aab-4e1a-8040-ead76bc5e485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:50.164456 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd953d1-8aab-4e1a-8040-ead76bc5e485 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:50.164662 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd953d1-8aab-4e1a-8040-ead76bc5e485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:50.164961 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd953d1-8aab-4e1a-8040-ead76bc5e485 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:50.165731 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd953d1-8aab-4e1a-8040-ead76bc5e485 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:50.167929 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd953d1-8aab-4e1a-8040-ead76bc5e485 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:50.202396 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 829/1639] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:04:50 2022] POST /identity/v3/projects => generated 405 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:04:50.203698 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd22cbf-dd35-443e-8fa4-d72d6dcf4d40 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:50.221223 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd22cbf-dd35-443e-8fa4-d72d6dcf4d40 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:50.300954 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0252d2-b6b5-4785-8899-a0138c4fbf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:50.302040 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0252d2-b6b5-4785-8899-a0138c4fbf21 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:50.302386 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0252d2-b6b5-4785-8899-a0138c4fbf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:50.302913 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0252d2-b6b5-4785-8899-a0138c4fbf21 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:50.303695 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0252d2-b6b5-4785-8899-a0138c4fbf21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:50.306216 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0252d2-b6b5-4785-8899-a0138c4fbf21 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:50.336917 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 811/1640] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:04:50 2022] POST /identity/v3/users => generated 309 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:04:50.340807 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd953d1-8aab-4e1a-8040-ead76bc5e485 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:50.356936 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd953d1-8aab-4e1a-8040-ead76bc5e485 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:50.364351 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13037f85-b570-4d32-a2fb-dbc40ad3c6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:50.365240 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13037f85-b570-4d32-a2fb-dbc40ad3c6fb admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:50.365638 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13037f85-b570-4d32-a2fb-dbc40ad3c6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:50.365965 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13037f85-b570-4d32-a2fb-dbc40ad3c6fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:50.367109 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13037f85-b570-4d32-a2fb-dbc40ad3c6fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:50.369182 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13037f85-b570-4d32-a2fb-dbc40ad3c6fb admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:50.398359 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 830/1641] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:04:50.403260 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0252d2-b6b5-4785-8899-a0138c4fbf21 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:50.418817 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0252d2-b6b5-4785-8899-a0138c4fbf21 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:50.433576 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415473e-7406-4c38-abc7-7cccee18a8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:50.433576 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415473e-7406-4c38-abc7-7cccee18a8be admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:50.433576 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415473e-7406-4c38-abc7-7cccee18a8be admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:50.433576 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415473e-7406-4c38-abc7-7cccee18a8be admin admin] PATH_INFO: `/v3/projects/47496f242a894d35af65db36502cdbc1/users/32d77d88082f4ffc8f1e9bc67fae6107/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:50.476332 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415473e-7406-4c38-abc7-7cccee18a8be admin admin] RBAC: Authorizing `identity:create_grant(project_id=47496f242a894d35af65db36502cdbc1, user_id=32d77d88082f4ffc8f1e9bc67fae6107, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:50.479640 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415473e-7406-4c38-abc7-7cccee18a8be admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:50.510204 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 812/1642] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:04:50 2022] PUT /identity/v3/projects/47496f242a894d35af65db36502cdbc1/users/32d77d88082f4ffc8f1e9bc67fae6107/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:04:50.514474 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13037f85-b570-4d32-a2fb-dbc40ad3c6fb admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:50.531157 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13037f85-b570-4d32-a2fb-dbc40ad3c6fb admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:50.590102 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb845f85-00db-4621-9de4-34192bd5190c None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:50.590300 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb845f85-00db-4621-9de4-34192bd5190c None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:50.590570 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb845f85-00db-4621-9de4-34192bd5190c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:50.626715 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369089a0-04bf-4ff6-8e0d-f6b6cd0f8e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:50.628712 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369089a0-04bf-4ff6-8e0d-f6b6cd0f8e89 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:50.629187 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369089a0-04bf-4ff6-8e0d-f6b6cd0f8e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:50.630291 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369089a0-04bf-4ff6-8e0d-f6b6cd0f8e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:50.634277 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-bb845f85-00db-4621-9de4-34192bd5190c None None] MFA Rules not processed for user `42d4c3f4a3d548bda06b450a63074b04`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:50.635888 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369089a0-04bf-4ff6-8e0d-f6b6cd0f8e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:50.636669 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-bb845f85-00db-4621-9de4-34192bd5190c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:50.639378 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369089a0-04bf-4ff6-8e0d-f6b6cd0f8e89 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:50.678584 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 831/1643] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:04:50.683052 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369089a0-04bf-4ff6-8e0d-f6b6cd0f8e89 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:50.694719 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369089a0-04bf-4ff6-8e0d-f6b6cd0f8e89 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:50.700870 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997989d1-1d93-4088-b296-40feec286752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:50.701973 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997989d1-1d93-4088-b296-40feec286752 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:50.702388 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997989d1-1d93-4088-b296-40feec286752 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:50.702747 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997989d1-1d93-4088-b296-40feec286752 admin admin] PATH_INFO: `/v3/projects/47496f242a894d35af65db36502cdbc1/users/32d77d88082f4ffc8f1e9bc67fae6107/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:50.705042 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997989d1-1d93-4088-b296-40feec286752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47496f242a894d35af65db36502cdbc1, user_id=32d77d88082f4ffc8f1e9bc67fae6107, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:50.708405 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997989d1-1d93-4088-b296-40feec286752 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:50.725044 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 832/1644] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:04:50 2022] PUT /identity/v3/projects/47496f242a894d35af65db36502cdbc1/users/32d77d88082f4ffc8f1e9bc67fae6107/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:04:50.750616 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 813/1645] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:04:50.763427 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232fca8-51c9-4bba-8fc2-fae889cdbc26 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:50.763815 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232fca8-51c9-4bba-8fc2-fae889cdbc26 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:50.764026 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232fca8-51c9-4bba-8fc2-fae889cdbc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:50.788070 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-9232fca8-51c9-4bba-8fc2-fae889cdbc26 None None] MFA Rules not processed for user `42d4c3f4a3d548bda06b450a63074b04`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:50.790486 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-9232fca8-51c9-4bba-8fc2-fae889cdbc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:50.872053 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 833/1646] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:04:50.887410 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb4e6b-b103-41db-b1e5-1e25a5c3e513 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:50.888269 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb4e6b-b103-41db-b1e5-1e25a5c3e513 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:50.888986 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb4e6b-b103-41db-b1e5-1e25a5c3e513 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:50.891639 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 814/1647] 10.222.0.32 () {54 vars in 960 bytes} [Tue Apr 12 03:04:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 03:04:50.897595 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98d582-1d19-42dc-82a4-f2f450c7723b None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:50.898516 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98d582-1d19-42dc-82a4-f2f450c7723b None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:50.899010 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98d582-1d19-42dc-82a4-f2f450c7723b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:50.920965 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-8b98d582-1d19-42dc-82a4-f2f450c7723b None None] MFA Rules not processed for user `43ee5cb310fd4538910e40ea7082708c`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:50.922656 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-8b98d582-1d19-42dc-82a4-f2f450c7723b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:51.081450 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 834/1648] 10.222.0.32 () {58 vars in 1057 bytes} [Tue Apr 12 03:04:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:04:51.090150 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb4e6b-b103-41db-b1e5-1e25a5c3e513 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:51.138281 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb4e6b-b103-41db-b1e5-1e25a5c3e513 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:51.156461 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61022ed-65b7-40f5-9626-a9e317b2f5f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:51.157686 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61022ed-65b7-40f5-9626-a9e317b2f5f9 service nova] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:51.158175 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61022ed-65b7-40f5-9626-a9e317b2f5f9 service nova] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:51.158663 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61022ed-65b7-40f5-9626-a9e317b2f5f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:51.177195 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61022ed-65b7-40f5-9626-a9e317b2f5f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:51.179556 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61022ed-65b7-40f5-9626-a9e317b2f5f9 service nova] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:51.218621 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 815/1649] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:04:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:04:51.599685 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb07fc-8cc9-4284-b10b-463b7255a94d None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:51.600262 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb07fc-8cc9-4284-b10b-463b7255a94d None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:51.600262 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb07fc-8cc9-4284-b10b-463b7255a94d None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:51.601706 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 835/1650] 10.222.0.32 () {54 vars in 912 bytes} [Tue Apr 12 03:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 03:04:51.610450 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325dfd47-d9a1-492c-bc48-0ad584e60e18 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:51.610726 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325dfd47-d9a1-492c-bc48-0ad584e60e18 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:51.610992 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325dfd47-d9a1-492c-bc48-0ad584e60e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:51.646941 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-325dfd47-d9a1-492c-bc48-0ad584e60e18 None None] MFA Rules not processed for user `43ee5cb310fd4538910e40ea7082708c`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:51.648200 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-325dfd47-d9a1-492c-bc48-0ad584e60e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:51.670505 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 816/1651] 10.222.0.32 () {58 vars in 1009 bytes} [Tue Apr 12 03:04:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:04:51.691708 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb07fc-8cc9-4284-b10b-463b7255a94d None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:51.695080 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-2aeb07fc-8cc9-4284-b10b-463b7255a94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:51.878055 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb07fc-8cc9-4284-b10b-463b7255a94d None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:51.882925 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258dcdd-3ba3-4d3e-bb1e-d6a65544d64b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a6cffa8af470388d4b063c3c49849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:51.884044 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258dcdd-3ba3-4d3e-bb1e-d6a65544d64b service glance] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:51.884350 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258dcdd-3ba3-4d3e-bb1e-d6a65544d64b service glance] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:51.893421 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258dcdd-3ba3-4d3e-bb1e-d6a65544d64b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:51.919688 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258dcdd-3ba3-4d3e-bb1e-d6a65544d64b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:51.921297 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258dcdd-3ba3-4d3e-bb1e-d6a65544d64b service glance] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:51.960289 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 836/1652] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:04:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:04:52.291173 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325dfd47-d9a1-492c-bc48-0ad584e60e18 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:52.292783 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-325dfd47-d9a1-492c-bc48-0ad584e60e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:52.400303 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325dfd47-d9a1-492c-bc48-0ad584e60e18 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:52.405668 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ac1d9-aa9c-4bbc-b576-ad8a84c90c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:52.406546 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ac1d9-aa9c-4bbc-b576-ad8a84c90c2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:52.406814 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ac1d9-aa9c-4bbc-b576-ad8a84c90c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:52.407522 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ac1d9-aa9c-4bbc-b576-ad8a84c90c2f admin admin] PATH_INFO: `/v3/projects/b51230fa3e9e4ec48777641734b066ce` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:52.408582 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ac1d9-aa9c-4bbc-b576-ad8a84c90c2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b51230fa3e9e4ec48777641734b066ce)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:52.409631 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: WARNING py.warnings [None req-a65ac1d9-aa9c-4bbc-b576-ad8a84c90c2f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 03:04:52.409631 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: warnings.warn(msg) Apr 12 03:04:52.409631 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: Apr 12 03:04:52.411226 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ac1d9-aa9c-4bbc-b576-ad8a84c90c2f admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:52.481836 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-a65ac1d9-aa9c-4bbc-b576-ad8a84c90c2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b51230fa3e9e4ec48777641734b066ce', 'request_id': 'req-a65ac1d9-aa9c-4bbc-b576-ad8a84c90c2f'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:52.494447 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-a65ac1d9-aa9c-4bbc-b576-ad8a84c90c2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b51230fa3e9e4ec48777641734b066ce', 'request_id': 'req-a65ac1d9-aa9c-4bbc-b576-ad8a84c90c2f'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:52.520619 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-a65ac1d9-aa9c-4bbc-b576-ad8a84c90c2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b51230fa3e9e4ec48777641734b066ce', 'request_id': 'req-a65ac1d9-aa9c-4bbc-b576-ad8a84c90c2f'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:52.537018 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-a65ac1d9-aa9c-4bbc-b576-ad8a84c90c2f admin admin] The token cache is being invalidate because project b51230fa3e9e4ec48777641734b066ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:04:52.537412 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-a65ac1d9-aa9c-4bbc-b576-ad8a84c90c2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:52.539303 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-a65ac1d9-aa9c-4bbc-b576-ad8a84c90c2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:52.542872 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 817/1653] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:04:52 2022] DELETE /identity/v3/projects/b51230fa3e9e4ec48777641734b066ce => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:04:52.547343 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258dcdd-3ba3-4d3e-bb1e-d6a65544d64b service glance] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:52.558082 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b7010-145b-4775-9766-85aa207bf683 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:52.558407 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b7010-145b-4775-9766-85aa207bf683 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:52.558647 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b7010-145b-4775-9766-85aa207bf683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:52.561878 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258dcdd-3ba3-4d3e-bb1e-d6a65544d64b service glance] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:52.634812 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-4b9b7010-145b-4775-9766-85aa207bf683 None None] MFA Rules not processed for user `32d77d88082f4ffc8f1e9bc67fae6107`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:52.637135 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-4b9b7010-145b-4775-9766-85aa207bf683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:52.712706 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44c07f-45cc-47fe-814f-9b3017d88096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:52.716249 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44c07f-45cc-47fe-814f-9b3017d88096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:52.716534 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44c07f-45cc-47fe-814f-9b3017d88096 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:52.716806 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44c07f-45cc-47fe-814f-9b3017d88096 admin admin] PATH_INFO: `/v3/users/4ba76eba6a3043ef924d39f44b54b9bd` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:52.722765 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44c07f-45cc-47fe-814f-9b3017d88096 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ba76eba6a3043ef924d39f44b54b9bd)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:52.724176 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 818/1654] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:52 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:04:52.728161 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44c07f-45cc-47fe-814f-9b3017d88096 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:52.791207 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-8e44c07f-45cc-47fe-814f-9b3017d88096 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ba76eba6a3043ef924d39f44b54b9bd'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:52.802362 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-8e44c07f-45cc-47fe-814f-9b3017d88096 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ba76eba6a3043ef924d39f44b54b9bd'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:52.804034 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-8e44c07f-45cc-47fe-814f-9b3017d88096 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ba76eba6a3043ef924d39f44b54b9bd'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:52.805285 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-8e44c07f-45cc-47fe-814f-9b3017d88096 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ba76eba6a3043ef924d39f44b54b9bd'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:52.854291 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-8e44c07f-45cc-47fe-814f-9b3017d88096 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ba76eba6a3043ef924d39f44b54b9bd'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:52.886996 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262396f-f3a3-4191-8b8f-8327291e208a None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:52.887566 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 837/1655] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:04:52 2022] DELETE /identity/v3/users/4ba76eba6a3043ef924d39f44b54b9bd => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:04:52.889016 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262396f-f3a3-4191-8b8f-8327291e208a None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:52.889714 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262396f-f3a3-4191-8b8f-8327291e208a None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:52.893081 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 819/1656] 10.222.0.32 () {54 vars in 912 bytes} [Tue Apr 12 03:04:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 03:04:52.898197 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40b477-2fda-409f-abdd-d45168aea8bf None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:52.898958 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40b477-2fda-409f-abdd-d45168aea8bf None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:52.899251 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40b477-2fda-409f-abdd-d45168aea8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:52.968189 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-8f40b477-2fda-409f-abdd-d45168aea8bf None None] MFA Rules not processed for user `8f516943aec14608b5c9d343418a2677`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:52.971239 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-8f40b477-2fda-409f-abdd-d45168aea8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:53.162686 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 838/1657] 10.222.0.32 () {58 vars in 1009 bytes} [Tue Apr 12 03:04:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:04:53.195492 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262396f-f3a3-4191-8b8f-8327291e208a None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:53.197302 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-b262396f-f3a3-4191-8b8f-8327291e208a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:53.218877 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262396f-f3a3-4191-8b8f-8327291e208a None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:53.256232 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6b31e-520d-47de-a2b3-95821fbce4a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:53.256960 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6b31e-520d-47de-a2b3-95821fbce4a8 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:53.257203 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6b31e-520d-47de-a2b3-95821fbce4a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:53.257468 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6b31e-520d-47de-a2b3-95821fbce4a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:53.288281 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6b31e-520d-47de-a2b3-95821fbce4a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:53.297232 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6b31e-520d-47de-a2b3-95821fbce4a8 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:53.332458 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 820/1658] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:04:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:04:53.737535 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40b477-2fda-409f-abdd-d45168aea8bf None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:53.740084 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-8f40b477-2fda-409f-abdd-d45168aea8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:53.893524 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40b477-2fda-409f-abdd-d45168aea8bf None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:53.904992 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65384b-31b4-4f99-9d6c-fffc60c97d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:53.905883 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65384b-31b4-4f99-9d6c-fffc60c97d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:53.906154 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65384b-31b4-4f99-9d6c-fffc60c97d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:53.906421 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65384b-31b4-4f99-9d6c-fffc60c97d2d admin admin] PATH_INFO: `/v3/projects/ed8889e4ef064eaa8ceceb856d439862` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:53.907618 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65384b-31b4-4f99-9d6c-fffc60c97d2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed8889e4ef064eaa8ceceb856d439862)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:53.909562 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65384b-31b4-4f99-9d6c-fffc60c97d2d admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:54.003131 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6b31e-520d-47de-a2b3-95821fbce4a8 service neutron] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:54.004663 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-59f6b31e-520d-47de-a2b3-95821fbce4a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:54.027248 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6b31e-520d-47de-a2b3-95821fbce4a8 service neutron] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:54.029858 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-fe65384b-31b4-4f99-9d6c-fffc60c97d2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed8889e4ef064eaa8ceceb856d439862', 'request_id': 'req-fe65384b-31b4-4f99-9d6c-fffc60c97d2d'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:54.044453 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-fe65384b-31b4-4f99-9d6c-fffc60c97d2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed8889e4ef064eaa8ceceb856d439862', 'request_id': 'req-fe65384b-31b4-4f99-9d6c-fffc60c97d2d'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:54.052616 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-fe65384b-31b4-4f99-9d6c-fffc60c97d2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed8889e4ef064eaa8ceceb856d439862', 'request_id': 'req-fe65384b-31b4-4f99-9d6c-fffc60c97d2d'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:54.078413 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-fe65384b-31b4-4f99-9d6c-fffc60c97d2d admin admin] The token cache is being invalidate because project ed8889e4ef064eaa8ceceb856d439862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:04:54.078751 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-fe65384b-31b4-4f99-9d6c-fffc60c97d2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:54.081034 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-fe65384b-31b4-4f99-9d6c-fffc60c97d2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:54.085412 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 839/1659] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:04:53 2022] DELETE /identity/v3/projects/ed8889e4ef064eaa8ceceb856d439862 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:04:54.091058 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555763d-54d5-41a8-bda7-1f62fac31884 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:54.091343 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555763d-54d5-41a8-bda7-1f62fac31884 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:54.091603 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555763d-54d5-41a8-bda7-1f62fac31884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:54.122762 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-3555763d-54d5-41a8-bda7-1f62fac31884 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:54.124042 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-3555763d-54d5-41a8-bda7-1f62fac31884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:54.127358 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7dc47-bf94-4c6e-8abc-d822d1aa916a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:54.128331 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7dc47-bf94-4c6e-8abc-d822d1aa916a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:54.128601 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7dc47-bf94-4c6e-8abc-d822d1aa916a admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:54.128862 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7dc47-bf94-4c6e-8abc-d822d1aa916a admin admin] PATH_INFO: `/v3/users/2131e6cb76d7423dab452a69b1b60f44` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:54.130893 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7dc47-bf94-4c6e-8abc-d822d1aa916a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2131e6cb76d7423dab452a69b1b60f44)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:54.132912 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7dc47-bf94-4c6e-8abc-d822d1aa916a admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:54.142398 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 840/1660] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:04:54.150016 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9924c92-c15c-46fe-97ad-758097147adb None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:54.150412 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9924c92-c15c-46fe-97ad-758097147adb None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:54.150938 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9924c92-c15c-46fe-97ad-758097147adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:54.184130 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-e9924c92-c15c-46fe-97ad-758097147adb None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:54.186049 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-e9924c92-c15c-46fe-97ad-758097147adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:54.204619 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 841/1661] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:04:54.216884 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9924c92-c15c-46fe-97ad-758097147adb None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:54.230116 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-a4d7dc47-bf94-4c6e-8abc-d822d1aa916a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2131e6cb76d7423dab452a69b1b60f44'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:54.230805 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-a4d7dc47-bf94-4c6e-8abc-d822d1aa916a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2131e6cb76d7423dab452a69b1b60f44'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:54.236196 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9924c92-c15c-46fe-97ad-758097147adb None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:54.252103 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb62e26-b5ad-4b88-bc9d-33466edd10cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:54.254882 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb62e26-b5ad-4b88-bc9d-33466edd10cb admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:54.255154 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb62e26-b5ad-4b88-bc9d-33466edd10cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:54.259213 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb62e26-b5ad-4b88-bc9d-33466edd10cb admin admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:54.260279 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb62e26-b5ad-4b88-bc9d-33466edd10cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:04:54.264018 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb62e26-b5ad-4b88-bc9d-33466edd10cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:54.271210 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-a4d7dc47-bf94-4c6e-8abc-d822d1aa916a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2131e6cb76d7423dab452a69b1b60f44'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:54.272194 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-a4d7dc47-bf94-4c6e-8abc-d822d1aa916a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2131e6cb76d7423dab452a69b1b60f44'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:54.272762 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb62e26-b5ad-4b88-bc9d-33466edd10cb admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:54.291965 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-a4d7dc47-bf94-4c6e-8abc-d822d1aa916a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2131e6cb76d7423dab452a69b1b60f44'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:54.302564 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 842/1662] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:04:54.314391 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb62e26-b5ad-4b88-bc9d-33466edd10cb admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:54.314887 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-3cb62e26-b5ad-4b88-bc9d-33466edd10cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:54.323178 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 821/1663] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:04:54 2022] DELETE /identity/v3/users/2131e6cb76d7423dab452a69b1b60f44 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:04:54.329098 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80708d-bb43-489f-b37e-12994eb31bf2 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:54.329597 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80708d-bb43-489f-b37e-12994eb31bf2 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:54.330166 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80708d-bb43-489f-b37e-12994eb31bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:54.344589 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb62e26-b5ad-4b88-bc9d-33466edd10cb admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:54.366438 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-5d80708d-bb43-489f-b37e-12994eb31bf2 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:54.369096 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-5d80708d-bb43-489f-b37e-12994eb31bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:54.496592 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e21cb6-48e7-494f-87a3-f835f06b1be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:54.498430 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e21cb6-48e7-494f-87a3-f835f06b1be5 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:54.499167 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e21cb6-48e7-494f-87a3-f835f06b1be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:54.500110 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e21cb6-48e7-494f-87a3-f835f06b1be5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:54.500928 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e21cb6-48e7-494f-87a3-f835f06b1be5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:54.503039 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e21cb6-48e7-494f-87a3-f835f06b1be5 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:54.506834 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 822/1664] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:04:54.562519 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 843/1665] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:04:54 2022] POST /identity/v3/projects => generated 365 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 03:04:54.567301 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80708d-bb43-489f-b37e-12994eb31bf2 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:54.591494 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80708d-bb43-489f-b37e-12994eb31bf2 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:54.695503 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe86dd-b56b-4d29-9bb7-56021d4fcf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:54.695503 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe86dd-b56b-4d29-9bb7-56021d4fcf9f admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:54.695503 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe86dd-b56b-4d29-9bb7-56021d4fcf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:54.695503 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe86dd-b56b-4d29-9bb7-56021d4fcf9f admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:54.696078 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe86dd-b56b-4d29-9bb7-56021d4fcf9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:54.703196 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe86dd-b56b-4d29-9bb7-56021d4fcf9f admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:54.766358 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 823/1666] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:04:54 2022] POST /identity/v3/users => generated 283 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:04:54.766625 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e21cb6-48e7-494f-87a3-f835f06b1be5 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:54.789270 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e21cb6-48e7-494f-87a3-f835f06b1be5 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:54.806615 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841325f-9f8f-4ff9-9e18-606274cc0977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:54.807456 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841325f-9f8f-4ff9-9e18-606274cc0977 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:54.807934 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841325f-9f8f-4ff9-9e18-606274cc0977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:54.808213 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841325f-9f8f-4ff9-9e18-606274cc0977 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:54.809437 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4841325f-9f8f-4ff9-9e18-606274cc0977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:54.811097 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4841325f-9f8f-4ff9-9e18-606274cc0977 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:54.850972 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 844/1667] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:04:54.852562 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe86dd-b56b-4d29-9bb7-56021d4fcf9f admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:54.864708 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe86dd-b56b-4d29-9bb7-56021d4fcf9f admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:54.875674 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82ee45-c588-403b-8b16-5e8d6ff22c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:54.876661 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82ee45-c588-403b-8b16-5e8d6ff22c4a admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:54.878109 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82ee45-c588-403b-8b16-5e8d6ff22c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:54.878510 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82ee45-c588-403b-8b16-5e8d6ff22c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:54.879414 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82ee45-c588-403b-8b16-5e8d6ff22c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:54.892325 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82ee45-c588-403b-8b16-5e8d6ff22c4a admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:54.898065 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841325f-9f8f-4ff9-9e18-606274cc0977 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:54.900025 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-4841325f-9f8f-4ff9-9e18-606274cc0977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:54.912239 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 824/1668] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:04:54.914165 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82ee45-c588-403b-8b16-5e8d6ff22c4a admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:54.949622 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82ee45-c588-403b-8b16-5e8d6ff22c4a admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:54.967144 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93a52a-8db8-4e47-bac1-5b4742d06144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:54.969580 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93a52a-8db8-4e47-bac1-5b4742d06144 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:54.969856 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93a52a-8db8-4e47-bac1-5b4742d06144 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:54.970121 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93a52a-8db8-4e47-bac1-5b4742d06144 admin admin] PATH_INFO: `/v3/projects/76175f7c31674a2b8de79d06af74a02e/users/1fb807dc43f84f4aa9c2083d8d2be56c/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:55.020133 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93a52a-8db8-4e47-bac1-5b4742d06144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76175f7c31674a2b8de79d06af74a02e, user_id=1fb807dc43f84f4aa9c2083d8d2be56c, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:55.022838 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93a52a-8db8-4e47-bac1-5b4742d06144 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:55.065736 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 825/1669] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:04:54 2022] PUT /identity/v3/projects/76175f7c31674a2b8de79d06af74a02e/users/1fb807dc43f84f4aa9c2083d8d2be56c/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:04:55.067317 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2370bb-0145-416e-9a8b-b4387b6e0f5d None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:55.067600 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2370bb-0145-416e-9a8b-b4387b6e0f5d None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:55.068058 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2370bb-0145-416e-9a8b-b4387b6e0f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:55.083517 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841325f-9f8f-4ff9-9e18-606274cc0977 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:55.123391 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-2c2370bb-0145-416e-9a8b-b4387b6e0f5d None None] MFA Rules not processed for user `1fb807dc43f84f4aa9c2083d8d2be56c`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:55.126772 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-2c2370bb-0145-416e-9a8b-b4387b6e0f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:55.222465 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272a224-d460-444d-92d3-495d52c4a744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:55.222971 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272a224-d460-444d-92d3-495d52c4a744 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:55.223323 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272a224-d460-444d-92d3-495d52c4a744 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:55.223772 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272a224-d460-444d-92d3-495d52c4a744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:55.285477 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 826/1670] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:55 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:04:55.292990 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2370bb-0145-416e-9a8b-b4387b6e0f5d None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:55.349834 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7272a224-d460-444d-92d3-495d52c4a744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:55.351303 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7272a224-d460-444d-92d3-495d52c4a744 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:55.377333 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 845/1671] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:04:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:04:55.429463 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2370bb-0145-416e-9a8b-b4387b6e0f5d None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:55.439039 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96f622-6bb7-4c8c-b6e3-6af3d8d8b492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:55.439755 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96f622-6bb7-4c8c-b6e3-6af3d8d8b492 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:55.440023 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96f622-6bb7-4c8c-b6e3-6af3d8d8b492 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:55.440301 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96f622-6bb7-4c8c-b6e3-6af3d8d8b492 admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:55.440979 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96f622-6bb7-4c8c-b6e3-6af3d8d8b492 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:55.444930 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff422438-d3ae-4b87-a356-358cd5f777b1 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:55.445210 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff422438-d3ae-4b87-a356-358cd5f777b1 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:55.445477 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff422438-d3ae-4b87-a356-358cd5f777b1 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:55.447239 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 846/1672] 10.222.0.32 () {54 vars in 960 bytes} [Tue Apr 12 03:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 03:04:55.452018 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96f622-6bb7-4c8c-b6e3-6af3d8d8b492 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:55.454873 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11228c55-8729-493b-b62f-bad66582e353 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:55.455152 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11228c55-8729-493b-b62f-bad66582e353 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:55.455415 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11228c55-8729-493b-b62f-bad66582e353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:55.498467 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-11228c55-8729-493b-b62f-bad66582e353 None None] MFA Rules not processed for user `c2a88ae51543497382d34573afc2bde3`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:55.499697 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-11228c55-8729-493b-b62f-bad66582e353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:55.536271 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 827/1673] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:04:55 2022] POST /identity/v3/projects => generated 363 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:04:55.540028 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96f622-6bb7-4c8c-b6e3-6af3d8d8b492 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:55.720625 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 847/1674] 10.222.0.32 () {58 vars in 1057 bytes} [Tue Apr 12 03:04:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:04:55.730109 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11228c55-8729-493b-b62f-bad66582e353 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:55.748847 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96f622-6bb7-4c8c-b6e3-6af3d8d8b492 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:55.756510 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11228c55-8729-493b-b62f-bad66582e353 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:55.770578 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ec43c-15b3-4766-a9b3-ce4b6b8e0a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:55.771266 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ec43c-15b3-4766-a9b3-ce4b6b8e0a4c admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:55.771540 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ec43c-15b3-4766-a9b3-ce4b6b8e0a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:55.771841 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ec43c-15b3-4766-a9b3-ce4b6b8e0a4c admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:55.772530 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ec43c-15b3-4766-a9b3-ce4b6b8e0a4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:55.787544 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ec43c-15b3-4766-a9b3-ce4b6b8e0a4c admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:55.856864 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 828/1675] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:04:55 2022] POST /identity/v3/users => generated 288 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:04:55.866523 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ec43c-15b3-4766-a9b3-ce4b6b8e0a4c admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:55.903738 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ec43c-15b3-4766-a9b3-ce4b6b8e0a4c admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:55.925493 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9588bf5-57ae-4a64-926d-e846ad2b80a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:55.926235 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9588bf5-57ae-4a64-926d-e846ad2b80a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:55.926510 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9588bf5-57ae-4a64-926d-e846ad2b80a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:55.926909 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9588bf5-57ae-4a64-926d-e846ad2b80a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:55.927701 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9588bf5-57ae-4a64-926d-e846ad2b80a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:55.935122 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9588bf5-57ae-4a64-926d-e846ad2b80a4 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:55.977478 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 829/1676] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:04:55.980627 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93222921-6fd5-42f4-9aa6-389e0396c4b4 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:55.980902 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93222921-6fd5-42f4-9aa6-389e0396c4b4 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:55.981171 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93222921-6fd5-42f4-9aa6-389e0396c4b4 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:55.989756 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 830/1677] 10.222.0.32 () {54 vars in 960 bytes} [Tue Apr 12 03:04:55 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 03:04:55.990938 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93222921-6fd5-42f4-9aa6-389e0396c4b4 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:56.002208 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155e386-9f7d-411e-ad1e-75fd416d6fc6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a88ae51543497382d34573afc2bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:56.003632 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155e386-9f7d-411e-ad1e-75fd416d6fc6 service placement] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:56.006697 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155e386-9f7d-411e-ad1e-75fd416d6fc6 service placement] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:56.007185 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155e386-9f7d-411e-ad1e-75fd416d6fc6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:56.014324 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-0155e386-9f7d-411e-ad1e-75fd416d6fc6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:56.024541 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93222921-6fd5-42f4-9aa6-389e0396c4b4 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:56.032457 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9871369-afdf-4805-81f8-6152dc2a37bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:56.033362 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9871369-afdf-4805-81f8-6152dc2a37bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:56.033635 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9871369-afdf-4805-81f8-6152dc2a37bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:56.033899 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9871369-afdf-4805-81f8-6152dc2a37bc admin admin] PATH_INFO: `/v3/projects/98768e17488845bca25b5fec380fa8ac/users/d6347047fbc74e178a1b439229a4740a/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:56.042691 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155e386-9f7d-411e-ad1e-75fd416d6fc6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:56.044668 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155e386-9f7d-411e-ad1e-75fd416d6fc6 service placement] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:56.069465 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9871369-afdf-4805-81f8-6152dc2a37bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=98768e17488845bca25b5fec380fa8ac, user_id=d6347047fbc74e178a1b439229a4740a, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:56.071229 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 848/1678] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:04:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:04:56.072405 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9871369-afdf-4805-81f8-6152dc2a37bc admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:56.075898 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12627457-e17b-4407-b1aa-2f5c2589c961 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:56.076454 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12627457-e17b-4407-b1aa-2f5c2589c961 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:56.076919 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12627457-e17b-4407-b1aa-2f5c2589c961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:56.109288 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 831/1679] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:04:55 2022] PUT /identity/v3/projects/98768e17488845bca25b5fec380fa8ac/users/d6347047fbc74e178a1b439229a4740a/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:04:56.110294 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9871369-afdf-4805-81f8-6152dc2a37bc admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:56.132983 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-12627457-e17b-4407-b1aa-2f5c2589c961 None None] MFA Rules not processed for user `43ee5cb310fd4538910e40ea7082708c`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:56.138102 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-12627457-e17b-4407-b1aa-2f5c2589c961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:56.311089 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9871369-afdf-4805-81f8-6152dc2a37bc admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:56.313268 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 849/1680] 10.222.0.32 () {58 vars in 1057 bytes} [Tue Apr 12 03:04:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:04:56.321246 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd241f8-2755-4bd6-8cf3-b894e209bc91 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:56.321525 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd241f8-2755-4bd6-8cf3-b894e209bc91 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:56.321898 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd241f8-2755-4bd6-8cf3-b894e209bc91 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:56.324007 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 850/1681] 10.222.0.32 () {54 vars in 912 bytes} [Tue Apr 12 03:04:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 03:04:56.331492 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae322e7-a611-4692-9c1b-57d52b4700a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:56.332566 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae322e7-a611-4692-9c1b-57d52b4700a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:56.332893 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae322e7-a611-4692-9c1b-57d52b4700a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:56.333095 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae322e7-a611-4692-9c1b-57d52b4700a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:56.333334 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ab567-9aad-48c1-9d33-9bc922671627 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:56.333732 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ab567-9aad-48c1-9d33-9bc922671627 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:56.333836 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae322e7-a611-4692-9c1b-57d52b4700a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:56.334134 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ab567-9aad-48c1-9d33-9bc922671627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:56.341954 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae322e7-a611-4692-9c1b-57d52b4700a9 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:56.356274 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 832/1682] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:04:56.361477 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae322e7-a611-4692-9c1b-57d52b4700a9 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:56.379198 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae322e7-a611-4692-9c1b-57d52b4700a9 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:56.385131 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-397ab567-9aad-48c1-9d33-9bc922671627 None None] MFA Rules not processed for user `43ee5cb310fd4538910e40ea7082708c`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:56.386026 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b54a6-426c-4ab9-9953-3292e4b72204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:56.387030 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b54a6-426c-4ab9-9953-3292e4b72204 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:56.387301 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b54a6-426c-4ab9-9953-3292e4b72204 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:56.387564 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b54a6-426c-4ab9-9953-3292e4b72204 admin admin] PATH_INFO: `/v3/projects/98768e17488845bca25b5fec380fa8ac/users/d6347047fbc74e178a1b439229a4740a/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:56.389857 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b54a6-426c-4ab9-9953-3292e4b72204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98768e17488845bca25b5fec380fa8ac, user_id=d6347047fbc74e178a1b439229a4740a, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:56.390589 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-397ab567-9aad-48c1-9d33-9bc922671627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:56.392831 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b54a6-426c-4ab9-9953-3292e4b72204 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:56.416489 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 833/1683] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:04:56 2022] PUT /identity/v3/projects/98768e17488845bca25b5fec380fa8ac/users/d6347047fbc74e178a1b439229a4740a/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:04:56.418116 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b6a3a-7957-4066-9f08-d3b2eed7e535 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:56.418398 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b6a3a-7957-4066-9f08-d3b2eed7e535 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:56.418665 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b6a3a-7957-4066-9f08-d3b2eed7e535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:56.453625 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-f07b6a3a-7957-4066-9f08-d3b2eed7e535 None None] MFA Rules not processed for user `d6347047fbc74e178a1b439229a4740a`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:56.455373 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-f07b6a3a-7957-4066-9f08-d3b2eed7e535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:56.551868 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 834/1684] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:56 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:04:56.567742 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b6a3a-7957-4066-9f08-d3b2eed7e535 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:56.569747 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-f07b6a3a-7957-4066-9f08-d3b2eed7e535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:56.593967 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 851/1685] 10.222.0.32 () {58 vars in 1009 bytes} [Tue Apr 12 03:04:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:04:56.638993 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ab567-9aad-48c1-9d33-9bc922671627 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:56.707769 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b6a3a-7957-4066-9f08-d3b2eed7e535 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:56.720331 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279ba1e-3936-4b84-8b4b-799f9313838a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:56.721031 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279ba1e-3936-4b84-8b4b-799f9313838a service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:56.721302 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279ba1e-3936-4b84-8b4b-799f9313838a service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:56.721568 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279ba1e-3936-4b84-8b4b-799f9313838a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:56.740406 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279ba1e-3936-4b84-8b4b-799f9313838a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:56.742975 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279ba1e-3936-4b84-8b4b-799f9313838a service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:56.748071 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ab567-9aad-48c1-9d33-9bc922671627 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:56.758709 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f48c6-53a3-4b95-8319-4589eb0fe3b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:56.759420 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f48c6-53a3-4b95-8319-4589eb0fe3b0 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:56.759746 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f48c6-53a3-4b95-8319-4589eb0fe3b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:56.765348 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 835/1686] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:04:56 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 03:04:56.766005 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f48c6-53a3-4b95-8319-4589eb0fe3b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:56.786213 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f48c6-53a3-4b95-8319-4589eb0fe3b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:56.787671 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f48c6-53a3-4b95-8319-4589eb0fe3b0 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:56.815571 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 852/1687] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:04:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:04:57.072113 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279ba1e-3936-4b84-8b4b-799f9313838a service cinder] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:57.073812 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-6279ba1e-3936-4b84-8b4b-799f9313838a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:57.233847 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279ba1e-3936-4b84-8b4b-799f9313838a service cinder] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:57.238864 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c8f05-e242-4641-8165-837904d5a811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:57.239775 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c8f05-e242-4641-8165-837904d5a811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:57.240071 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c8f05-e242-4641-8165-837904d5a811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:57.240336 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c8f05-e242-4641-8165-837904d5a811 admin admin] PATH_INFO: `/v3/projects/6e829d30ff584a2da0cb9ab3d40cbcdd` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:57.242205 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c8f05-e242-4641-8165-837904d5a811 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e829d30ff584a2da0cb9ab3d40cbcdd)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:57.244767 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c8f05-e242-4641-8165-837904d5a811 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:57.311421 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-811c8f05-e242-4641-8165-837904d5a811 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e829d30ff584a2da0cb9ab3d40cbcdd', 'request_id': 'req-811c8f05-e242-4641-8165-837904d5a811'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:57.321791 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-811c8f05-e242-4641-8165-837904d5a811 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e829d30ff584a2da0cb9ab3d40cbcdd', 'request_id': 'req-811c8f05-e242-4641-8165-837904d5a811'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:57.341531 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-811c8f05-e242-4641-8165-837904d5a811 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e829d30ff584a2da0cb9ab3d40cbcdd', 'request_id': 'req-811c8f05-e242-4641-8165-837904d5a811'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:57.381440 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-811c8f05-e242-4641-8165-837904d5a811 admin admin] The token cache is being invalidate because project 6e829d30ff584a2da0cb9ab3d40cbcdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:04:57.381440 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-811c8f05-e242-4641-8165-837904d5a811 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:57.382404 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-811c8f05-e242-4641-8165-837904d5a811 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:57.385842 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 836/1688] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:04:57 2022] DELETE /identity/v3/projects/6e829d30ff584a2da0cb9ab3d40cbcdd => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:04:57.389947 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f48c6-53a3-4b95-8319-4589eb0fe3b0 service neutron] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:57.406098 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f48c6-53a3-4b95-8319-4589eb0fe3b0 service neutron] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:57.589854 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a883f-8535-4d54-8df7-d3ab8c5db85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:57.591387 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a883f-8535-4d54-8df7-d3ab8c5db85e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:57.591858 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a883f-8535-4d54-8df7-d3ab8c5db85e admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:57.592255 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a883f-8535-4d54-8df7-d3ab8c5db85e admin admin] PATH_INFO: `/v3/users/388562179881468d91af03f35307be35` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:57.595656 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a883f-8535-4d54-8df7-d3ab8c5db85e admin admin] RBAC: Authorizing `identity:delete_user(user_id=388562179881468d91af03f35307be35)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:57.603359 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a883f-8535-4d54-8df7-d3ab8c5db85e admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:57.722930 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-bf7a883f-8535-4d54-8df7-d3ab8c5db85e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '388562179881468d91af03f35307be35'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:57.740039 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c8f05-e242-4641-8165-837904d5a811 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:57.740792 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-811c8f05-e242-4641-8165-837904d5a811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:57.759058 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c8f05-e242-4641-8165-837904d5a811 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:57.761988 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-bf7a883f-8535-4d54-8df7-d3ab8c5db85e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '388562179881468d91af03f35307be35'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:57.763080 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-bf7a883f-8535-4d54-8df7-d3ab8c5db85e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '388562179881468d91af03f35307be35'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:57.764303 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c275dc4-d8a1-4bb1-905b-5a983007b1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:57.765252 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c275dc4-d8a1-4bb1-905b-5a983007b1d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:57.765526 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c275dc4-d8a1-4bb1-905b-5a983007b1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:57.765790 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c275dc4-d8a1-4bb1-905b-5a983007b1d4 admin admin] PATH_INFO: `/v3/users/1fb807dc43f84f4aa9c2083d8d2be56c` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:57.766047 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-bf7a883f-8535-4d54-8df7-d3ab8c5db85e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '388562179881468d91af03f35307be35'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:57.767168 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c275dc4-d8a1-4bb1-905b-5a983007b1d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fb807dc43f84f4aa9c2083d8d2be56c)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:57.769195 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c275dc4-d8a1-4bb1-905b-5a983007b1d4 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:57.802364 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-bf7a883f-8535-4d54-8df7-d3ab8c5db85e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '388562179881468d91af03f35307be35'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:57.844198 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 853/1689] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:04:57 2022] DELETE /identity/v3/users/388562179881468d91af03f35307be35 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:04:57.855214 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-5c275dc4-d8a1-4bb1-905b-5a983007b1d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fb807dc43f84f4aa9c2083d8d2be56c'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:57.856216 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-5c275dc4-d8a1-4bb1-905b-5a983007b1d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fb807dc43f84f4aa9c2083d8d2be56c'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:57.871509 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-5c275dc4-d8a1-4bb1-905b-5a983007b1d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fb807dc43f84f4aa9c2083d8d2be56c'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:57.872588 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-5c275dc4-d8a1-4bb1-905b-5a983007b1d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fb807dc43f84f4aa9c2083d8d2be56c'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:57.880636 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-5c275dc4-d8a1-4bb1-905b-5a983007b1d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fb807dc43f84f4aa9c2083d8d2be56c'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:04:57.905915 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099ac7b-d854-4a56-9237-6694ac0dfdf4 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:57.906190 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099ac7b-d854-4a56-9237-6694ac0dfdf4 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:57.906686 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099ac7b-d854-4a56-9237-6694ac0dfdf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:57.908420 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 837/1690] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:04:57 2022] DELETE /identity/v3/users/1fb807dc43f84f4aa9c2083d8d2be56c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:04:57.942396 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-b099ac7b-d854-4a56-9237-6694ac0dfdf4 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:57.947222 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-b099ac7b-d854-4a56-9237-6694ac0dfdf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:58.094043 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 854/1691] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:04:58.111699 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c275dc4-d8a1-4bb1-905b-5a983007b1d4 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:58.113612 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-5c275dc4-d8a1-4bb1-905b-5a983007b1d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:58.198322 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c275dc4-d8a1-4bb1-905b-5a983007b1d4 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:58.209802 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075a0bf-ea5f-4d72-93ee-3f827888bfb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:58.211027 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075a0bf-ea5f-4d72-93ee-3f827888bfb8 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:58.211524 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075a0bf-ea5f-4d72-93ee-3f827888bfb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:58.212170 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075a0bf-ea5f-4d72-93ee-3f827888bfb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:58.236767 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075a0bf-ea5f-4d72-93ee-3f827888bfb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:58.239827 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075a0bf-ea5f-4d72-93ee-3f827888bfb8 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:58.256540 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 838/1692] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:04:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:04:59.459966 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a2a41-9d7e-4b99-9d62-aea8c588a551 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:59.460429 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a2a41-9d7e-4b99-9d62-aea8c588a551 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:59.460429 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a2a41-9d7e-4b99-9d62-aea8c588a551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:59.475649 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41371a79-5017-442e-8130-3400ecb79ca8 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:59.476555 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41371a79-5017-442e-8130-3400ecb79ca8 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:59.476968 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41371a79-5017-442e-8130-3400ecb79ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:59.517096 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-41371a79-5017-442e-8130-3400ecb79ca8 None None] MFA Rules not processed for user `83115653901749f6ade6638593fb54e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:59.518336 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-41371a79-5017-442e-8130-3400ecb79ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:59.522239 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-569a2a41-9d7e-4b99-9d62-aea8c588a551 None None] MFA Rules not processed for user `c22f5695481341419674da058685a2d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:59.524379 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-569a2a41-9d7e-4b99-9d62-aea8c588a551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:59.655100 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 839/1693] 10.222.0.32 () {58 vars in 1009 bytes} [Tue Apr 12 03:04:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:04:59.718851 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 855/1694] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:04:59.721099 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c17b6-0f1a-4562-b6fd-2f561f6e0ad9 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:59.721377 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c17b6-0f1a-4562-b6fd-2f561f6e0ad9 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:59.721708 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c17b6-0f1a-4562-b6fd-2f561f6e0ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:59.755613 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-654c17b6-0f1a-4562-b6fd-2f561f6e0ad9 None None] MFA Rules not processed for user `c22f5695481341419674da058685a2d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:04:59.756877 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-654c17b6-0f1a-4562-b6fd-2f561f6e0ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:59.775403 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 840/1695] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:04:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:04:59.780332 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a2a41-9d7e-4b99-9d62-aea8c588a551 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:59.783305 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-569a2a41-9d7e-4b99-9d62-aea8c588a551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:59.930893 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c17b6-0f1a-4562-b6fd-2f561f6e0ad9 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:04:59.932091 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-654c17b6-0f1a-4562-b6fd-2f561f6e0ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:04:59.949371 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a2a41-9d7e-4b99-9d62-aea8c588a551 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:59.959482 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c17b6-0f1a-4562-b6fd-2f561f6e0ad9 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:04:59.966282 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170541a6-f9bd-4ec6-8cf7-85715c91a8c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:59.966966 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170541a6-f9bd-4ec6-8cf7-85715c91a8c5 service nova] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:59.967403 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170541a6-f9bd-4ec6-8cf7-85715c91a8c5 service nova] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:59.967936 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170541a6-f9bd-4ec6-8cf7-85715c91a8c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:59.971537 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5876c-4220-45ac-966d-d8768df37260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:04:59.973680 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5876c-4220-45ac-966d-d8768df37260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:04:59.975393 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5876c-4220-45ac-966d-d8768df37260 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:04:59.975797 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5876c-4220-45ac-966d-d8768df37260 admin admin] PATH_INFO: `/v3/projects/76175f7c31674a2b8de79d06af74a02e` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:04:59.979658 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5876c-4220-45ac-966d-d8768df37260 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76175f7c31674a2b8de79d06af74a02e)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:59.982059 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5876c-4220-45ac-966d-d8768df37260 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:04:59.991540 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170541a6-f9bd-4ec6-8cf7-85715c91a8c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:04:59.993902 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170541a6-f9bd-4ec6-8cf7-85715c91a8c5 service nova] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:00.021554 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 856/1696] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:04:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:05:00.022796 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170541a6-f9bd-4ec6-8cf7-85715c91a8c5 service nova] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:00.024394 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-170541a6-f9bd-4ec6-8cf7-85715c91a8c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:00.088252 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-13a5876c-4220-45ac-966d-d8768df37260 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76175f7c31674a2b8de79d06af74a02e', 'request_id': 'req-13a5876c-4220-45ac-966d-d8768df37260'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:00.100217 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-13a5876c-4220-45ac-966d-d8768df37260 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76175f7c31674a2b8de79d06af74a02e', 'request_id': 'req-13a5876c-4220-45ac-966d-d8768df37260'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:00.116462 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-13a5876c-4220-45ac-966d-d8768df37260 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76175f7c31674a2b8de79d06af74a02e', 'request_id': 'req-13a5876c-4220-45ac-966d-d8768df37260'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:00.139339 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-13a5876c-4220-45ac-966d-d8768df37260 admin admin] The token cache is being invalidate because project 76175f7c31674a2b8de79d06af74a02e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:05:00.139644 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-13a5876c-4220-45ac-966d-d8768df37260 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:00.143207 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-13a5876c-4220-45ac-966d-d8768df37260 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:00.148614 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 841/1697] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:04:59 2022] DELETE /identity/v3/projects/76175f7c31674a2b8de79d06af74a02e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:00.149101 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5876c-4220-45ac-966d-d8768df37260 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:00.152762 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-13a5876c-4220-45ac-966d-d8768df37260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:00.178393 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170541a6-f9bd-4ec6-8cf7-85715c91a8c5 service nova] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:00.295159 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5876c-4220-45ac-966d-d8768df37260 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:00.304239 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00869ff-2d7a-44da-af1d-e7936cf0e1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:00.305212 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00869ff-2d7a-44da-af1d-e7936cf0e1d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:00.306441 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00869ff-2d7a-44da-af1d-e7936cf0e1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:00.307903 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00869ff-2d7a-44da-af1d-e7936cf0e1d4 admin admin] PATH_INFO: `/v3/users/d6347047fbc74e178a1b439229a4740a` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:00.313173 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00869ff-2d7a-44da-af1d-e7936cf0e1d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6347047fbc74e178a1b439229a4740a)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:00.316635 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00869ff-2d7a-44da-af1d-e7936cf0e1d4 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:00.347999 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c0786-50db-42d2-9173-eb67742dc298 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e8d78f92f12405fb746ddeb2579bd2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:00.348695 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c0786-50db-42d2-9173-eb67742dc298 service swift] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:00.348969 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c0786-50db-42d2-9173-eb67742dc298 service swift] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:00.352509 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c0786-50db-42d2-9173-eb67742dc298 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:00.357866 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-ec0c0786-50db-42d2-9173-eb67742dc298 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:00.411126 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-c00869ff-2d7a-44da-af1d-e7936cf0e1d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6347047fbc74e178a1b439229a4740a'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:00.412110 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-c00869ff-2d7a-44da-af1d-e7936cf0e1d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6347047fbc74e178a1b439229a4740a'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:00.439738 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-c00869ff-2d7a-44da-af1d-e7936cf0e1d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6347047fbc74e178a1b439229a4740a'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:00.441132 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-c00869ff-2d7a-44da-af1d-e7936cf0e1d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6347047fbc74e178a1b439229a4740a'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:00.458094 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-c00869ff-2d7a-44da-af1d-e7936cf0e1d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6347047fbc74e178a1b439229a4740a'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:00.486062 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c0786-50db-42d2-9173-eb67742dc298 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:00.488298 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 842/1698] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:05:00 2022] DELETE /identity/v3/users/d6347047fbc74e178a1b439229a4740a => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:00.489494 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c0786-50db-42d2-9173-eb67742dc298 service swift] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:00.499703 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 857/1699] 10.222.0.32 () {60 vars in 1384 bytes} [Tue Apr 12 03:05:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 03:05:01.140863 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00869ff-2d7a-44da-af1d-e7936cf0e1d4 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:01.142568 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-c00869ff-2d7a-44da-af1d-e7936cf0e1d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:01.366164 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00869ff-2d7a-44da-af1d-e7936cf0e1d4 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:01.384344 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d11b47-041b-4510-8e64-5c2cef9bc266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:01.385339 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d11b47-041b-4510-8e64-5c2cef9bc266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:01.385785 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d11b47-041b-4510-8e64-5c2cef9bc266 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:01.386081 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d11b47-041b-4510-8e64-5c2cef9bc266 admin admin] PATH_INFO: `/v3/users/d0f3167fe02a4341bc0a8471ed569296` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:01.395600 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d11b47-041b-4510-8e64-5c2cef9bc266 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0f3167fe02a4341bc0a8471ed569296)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:01.409519 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d11b47-041b-4510-8e64-5c2cef9bc266 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:01.632783 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-11d11b47-041b-4510-8e64-5c2cef9bc266 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0f3167fe02a4341bc0a8471ed569296'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:01.634353 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-11d11b47-041b-4510-8e64-5c2cef9bc266 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0f3167fe02a4341bc0a8471ed569296'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:01.669112 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-11d11b47-041b-4510-8e64-5c2cef9bc266 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0f3167fe02a4341bc0a8471ed569296'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:01.692236 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-11d11b47-041b-4510-8e64-5c2cef9bc266 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0f3167fe02a4341bc0a8471ed569296'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:01.715437 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-11d11b47-041b-4510-8e64-5c2cef9bc266 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0f3167fe02a4341bc0a8471ed569296'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:01.772500 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 843/1700] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:05:01 2022] DELETE /identity/v3/users/d0f3167fe02a4341bc0a8471ed569296 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:01.978568 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c0786-50db-42d2-9173-eb67742dc298 service swift] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:01.980087 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-ec0c0786-50db-42d2-9173-eb67742dc298 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:02.024958 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c0786-50db-42d2-9173-eb67742dc298 service swift] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:02.140175 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d2343-c55e-47d4-b7a6-4ea542cd5a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:02.142342 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d2343-c55e-47d4-b7a6-4ea542cd5a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:02.142883 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d2343-c55e-47d4-b7a6-4ea542cd5a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:02.145022 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d2343-c55e-47d4-b7a6-4ea542cd5a12 admin admin] PATH_INFO: `/v3/projects/77dd7860d12644818e5110014bd6b574` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:02.146947 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d2343-c55e-47d4-b7a6-4ea542cd5a12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77dd7860d12644818e5110014bd6b574)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:02.155932 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d2343-c55e-47d4-b7a6-4ea542cd5a12 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:02.253607 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d11b47-041b-4510-8e64-5c2cef9bc266 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:02.255670 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-11d11b47-041b-4510-8e64-5c2cef9bc266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:02.284294 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d11b47-041b-4510-8e64-5c2cef9bc266 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:02.310393 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a74d2343-c55e-47d4-b7a6-4ea542cd5a12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77dd7860d12644818e5110014bd6b574', 'request_id': 'req-a74d2343-c55e-47d4-b7a6-4ea542cd5a12'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:02.329984 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a74d2343-c55e-47d4-b7a6-4ea542cd5a12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77dd7860d12644818e5110014bd6b574', 'request_id': 'req-a74d2343-c55e-47d4-b7a6-4ea542cd5a12'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:02.340748 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a74d2343-c55e-47d4-b7a6-4ea542cd5a12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77dd7860d12644818e5110014bd6b574', 'request_id': 'req-a74d2343-c55e-47d4-b7a6-4ea542cd5a12'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:02.373039 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a74d2343-c55e-47d4-b7a6-4ea542cd5a12 admin admin] The token cache is being invalidate because project 77dd7860d12644818e5110014bd6b574 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:05:02.373394 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a74d2343-c55e-47d4-b7a6-4ea542cd5a12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:02.377828 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a74d2343-c55e-47d4-b7a6-4ea542cd5a12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:02.389907 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 858/1701] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:05:01 2022] DELETE /identity/v3/projects/77dd7860d12644818e5110014bd6b574 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:02.392100 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c991c-f9c2-4813-b6c5-a0a930316c3c None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:02.392100 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c991c-f9c2-4813-b6c5-a0a930316c3c None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:02.392412 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c991c-f9c2-4813-b6c5-a0a930316c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:02.420796 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53189112-6714-41d7-8f71-a908a4728372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:02.422012 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53189112-6714-41d7-8f71-a908a4728372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:02.422736 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53189112-6714-41d7-8f71-a908a4728372 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:02.423492 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53189112-6714-41d7-8f71-a908a4728372 admin admin] PATH_INFO: `/v3/projects/1bfa2e50a0ff463ba5bb50c6edc5407f` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:02.425656 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53189112-6714-41d7-8f71-a908a4728372 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bfa2e50a0ff463ba5bb50c6edc5407f)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:02.428249 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53189112-6714-41d7-8f71-a908a4728372 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:02.458518 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-481c991c-f9c2-4813-b6c5-a0a930316c3c None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:02.460145 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-481c991c-f9c2-4813-b6c5-a0a930316c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:02.475641 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 859/1702] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:02.489286 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a7c08-668d-4572-a294-e265b27797e2 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:02.489583 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a7c08-668d-4572-a294-e265b27797e2 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:02.490887 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a7c08-668d-4572-a294-e265b27797e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:02.536825 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-53189112-6714-41d7-8f71-a908a4728372 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bfa2e50a0ff463ba5bb50c6edc5407f', 'request_id': 'req-53189112-6714-41d7-8f71-a908a4728372'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:02.547587 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-535a7c08-668d-4572-a294-e265b27797e2 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:02.549135 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-535a7c08-668d-4572-a294-e265b27797e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:02.553934 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-53189112-6714-41d7-8f71-a908a4728372 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bfa2e50a0ff463ba5bb50c6edc5407f', 'request_id': 'req-53189112-6714-41d7-8f71-a908a4728372'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:02.564638 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-53189112-6714-41d7-8f71-a908a4728372 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bfa2e50a0ff463ba5bb50c6edc5407f', 'request_id': 'req-53189112-6714-41d7-8f71-a908a4728372'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:02.579518 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-53189112-6714-41d7-8f71-a908a4728372 admin admin] The token cache is being invalidate because project 1bfa2e50a0ff463ba5bb50c6edc5407f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:05:02.580158 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-53189112-6714-41d7-8f71-a908a4728372 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:02.581042 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-53189112-6714-41d7-8f71-a908a4728372 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:02.586193 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 844/1703] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:05:02 2022] DELETE /identity/v3/projects/1bfa2e50a0ff463ba5bb50c6edc5407f => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:05:02.587642 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53189112-6714-41d7-8f71-a908a4728372 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:02.589574 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-53189112-6714-41d7-8f71-a908a4728372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:02.703263 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53189112-6714-41d7-8f71-a908a4728372 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:02.709960 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20d155-09b3-4d35-a6f9-3e9b59c32a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:02.711319 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20d155-09b3-4d35-a6f9-3e9b59c32a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:02.711819 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20d155-09b3-4d35-a6f9-3e9b59c32a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:02.712551 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20d155-09b3-4d35-a6f9-3e9b59c32a0a admin admin] PATH_INFO: `/v3/users/32d77d88082f4ffc8f1e9bc67fae6107` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:02.714124 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20d155-09b3-4d35-a6f9-3e9b59c32a0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=32d77d88082f4ffc8f1e9bc67fae6107)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:02.717044 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20d155-09b3-4d35-a6f9-3e9b59c32a0a admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:02.725413 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 860/1704] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:02.725839 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a7c08-668d-4572-a294-e265b27797e2 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:02.738270 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a7c08-668d-4572-a294-e265b27797e2 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:02.743597 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc122e1-be16-414b-83f4-25a75920ef28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:02.745685 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc122e1-be16-414b-83f4-25a75920ef28 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:02.745685 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc122e1-be16-414b-83f4-25a75920ef28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:02.745885 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc122e1-be16-414b-83f4-25a75920ef28 admin admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:02.747252 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc122e1-be16-414b-83f4-25a75920ef28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:05:02.747252 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc122e1-be16-414b-83f4-25a75920ef28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:02.748783 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc122e1-be16-414b-83f4-25a75920ef28 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:02.768847 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 861/1705] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:05:02.770268 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc122e1-be16-414b-83f4-25a75920ef28 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:02.782665 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc122e1-be16-414b-83f4-25a75920ef28 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:02.797428 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ccf73d-aa00-43d5-be6c-986d753f0c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:02.798400 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ccf73d-aa00-43d5-be6c-986d753f0c96 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:02.799218 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ccf73d-aa00-43d5-be6c-986d753f0c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:02.799601 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ccf73d-aa00-43d5-be6c-986d753f0c96 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:02.801167 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ccf73d-aa00-43d5-be6c-986d753f0c96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:02.807249 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ccf73d-aa00-43d5-be6c-986d753f0c96 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:02.879360 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 862/1706] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:05:02 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:02.880392 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ccf73d-aa00-43d5-be6c-986d753f0c96 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:02.892255 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3a20d155-09b3-4d35-a6f9-3e9b59c32a0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32d77d88082f4ffc8f1e9bc67fae6107'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:02.894041 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3a20d155-09b3-4d35-a6f9-3e9b59c32a0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32d77d88082f4ffc8f1e9bc67fae6107'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:02.935265 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3a20d155-09b3-4d35-a6f9-3e9b59c32a0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32d77d88082f4ffc8f1e9bc67fae6107'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:02.937366 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3a20d155-09b3-4d35-a6f9-3e9b59c32a0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32d77d88082f4ffc8f1e9bc67fae6107'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:02.960326 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3a20d155-09b3-4d35-a6f9-3e9b59c32a0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32d77d88082f4ffc8f1e9bc67fae6107'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:02.984027 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 845/1707] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:05:02 2022] DELETE /identity/v3/users/32d77d88082f4ffc8f1e9bc67fae6107 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:03.052573 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ccf73d-aa00-43d5-be6c-986d753f0c96 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:03.200767 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921b18e-2bac-4094-8cf3-12a576283046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:03.202722 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921b18e-2bac-4094-8cf3-12a576283046 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:03.203003 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921b18e-2bac-4094-8cf3-12a576283046 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:03.203278 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921b18e-2bac-4094-8cf3-12a576283046 admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:03.205083 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f921b18e-2bac-4094-8cf3-12a576283046 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:03.208994 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f921b18e-2bac-4094-8cf3-12a576283046 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:03.258585 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 863/1708] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:05:02 2022] POST /identity/v3/users => generated 291 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:03.263452 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20d155-09b3-4d35-a6f9-3e9b59c32a0a admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:03.265417 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-3a20d155-09b3-4d35-a6f9-3e9b59c32a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:03.282318 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20d155-09b3-4d35-a6f9-3e9b59c32a0a admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:03.289250 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff81223-42ef-42d0-90f4-e60b4e7c3041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:03.290437 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff81223-42ef-42d0-90f4-e60b4e7c3041 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:03.290891 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff81223-42ef-42d0-90f4-e60b4e7c3041 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:03.292084 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff81223-42ef-42d0-90f4-e60b4e7c3041 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:03.293932 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff81223-42ef-42d0-90f4-e60b4e7c3041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:03.295963 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff81223-42ef-42d0-90f4-e60b4e7c3041 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:03.320701 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 846/1709] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:03.324628 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921b18e-2bac-4094-8cf3-12a576283046 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:03.341801 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921b18e-2bac-4094-8cf3-12a576283046 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:03.348542 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e102b-e63e-4ae1-bcf5-2f33eb20b636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:03.349331 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e102b-e63e-4ae1-bcf5-2f33eb20b636 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:03.349598 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e102b-e63e-4ae1-bcf5-2f33eb20b636 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:03.349922 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e102b-e63e-4ae1-bcf5-2f33eb20b636 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:03.353465 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e102b-e63e-4ae1-bcf5-2f33eb20b636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:03.361599 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e102b-e63e-4ae1-bcf5-2f33eb20b636 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:03.395285 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 864/1710] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:03.400117 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff81223-42ef-42d0-90f4-e60b4e7c3041 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:03.418079 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff81223-42ef-42d0-90f4-e60b4e7c3041 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:03.432567 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8070a-8297-4eac-8c1f-ede48a997e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:03.439043 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8070a-8297-4eac-8c1f-ede48a997e2a admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:03.439318 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8070a-8297-4eac-8c1f-ede48a997e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:03.440610 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8070a-8297-4eac-8c1f-ede48a997e2a admin admin] PATH_INFO: `/v3/projects/4462d77ae4ab4e42923a1428142ade24/users/e53c005563a44b85a4ffbef8914de431/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:03.489599 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8070a-8297-4eac-8c1f-ede48a997e2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4462d77ae4ab4e42923a1428142ade24, user_id=e53c005563a44b85a4ffbef8914de431, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:03.493290 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8070a-8297-4eac-8c1f-ede48a997e2a admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:03.527493 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 847/1711] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:05:03 2022] PUT /identity/v3/projects/4462d77ae4ab4e42923a1428142ade24/users/e53c005563a44b85a4ffbef8914de431/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:05:03.538729 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010db049-5743-4088-bb09-d8cb693d6bb7 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:03.539011 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010db049-5743-4088-bb09-d8cb693d6bb7 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:03.539419 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010db049-5743-4088-bb09-d8cb693d6bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:03.595308 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8070a-8297-4eac-8c1f-ede48a997e2a admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:03.597945 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-28f8070a-8297-4eac-8c1f-ede48a997e2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:03.605155 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-010db049-5743-4088-bb09-d8cb693d6bb7 None None] MFA Rules not processed for user `e53c005563a44b85a4ffbef8914de431`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:03.606490 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-010db049-5743-4088-bb09-d8cb693d6bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:03.750735 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 865/1712] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:03.758181 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010db049-5743-4088-bb09-d8cb693d6bb7 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:03.766405 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8070a-8297-4eac-8c1f-ede48a997e2a admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:03.774728 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010db049-5743-4088-bb09-d8cb693d6bb7 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:03.779814 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31489f-a261-4247-87d3-9ed10b0d6c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:03.780750 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31489f-a261-4247-87d3-9ed10b0d6c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:03.781022 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31489f-a261-4247-87d3-9ed10b0d6c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:03.781313 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31489f-a261-4247-87d3-9ed10b0d6c7d admin admin] PATH_INFO: `/v3/projects/47496f242a894d35af65db36502cdbc1` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:03.782046 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc3a0c-e56c-4b70-8ecc-82ffad1795ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:03.783037 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc3a0c-e56c-4b70-8ecc-82ffad1795ca admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:03.783532 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc3a0c-e56c-4b70-8ecc-82ffad1795ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:03.783897 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc3a0c-e56c-4b70-8ecc-82ffad1795ca admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:03.784561 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b31489f-a261-4247-87d3-9ed10b0d6c7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=47496f242a894d35af65db36502cdbc1)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:03.785106 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc3a0c-e56c-4b70-8ecc-82ffad1795ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:03.787463 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b31489f-a261-4247-87d3-9ed10b0d6c7d admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:03.805491 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc3a0c-e56c-4b70-8ecc-82ffad1795ca admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:03.861263 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 866/1713] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:05:03 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:03.862977 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc3a0c-e56c-4b70-8ecc-82ffad1795ca admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:03.907181 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-0b31489f-a261-4247-87d3-9ed10b0d6c7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47496f242a894d35af65db36502cdbc1', 'request_id': 'req-0b31489f-a261-4247-87d3-9ed10b0d6c7d'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:03.926672 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-0b31489f-a261-4247-87d3-9ed10b0d6c7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47496f242a894d35af65db36502cdbc1', 'request_id': 'req-0b31489f-a261-4247-87d3-9ed10b0d6c7d'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:03.940100 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-0b31489f-a261-4247-87d3-9ed10b0d6c7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47496f242a894d35af65db36502cdbc1', 'request_id': 'req-0b31489f-a261-4247-87d3-9ed10b0d6c7d'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:03.974185 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-0b31489f-a261-4247-87d3-9ed10b0d6c7d admin admin] The token cache is being invalidate because project 47496f242a894d35af65db36502cdbc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:05:03.974532 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-0b31489f-a261-4247-87d3-9ed10b0d6c7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:03.979506 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-0b31489f-a261-4247-87d3-9ed10b0d6c7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:03.985241 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 848/1714] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:05:03 2022] DELETE /identity/v3/projects/47496f242a894d35af65db36502cdbc1 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:05:03.990413 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a325a1b-4a41-417d-baca-be222efa8fa8 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:03.990711 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a325a1b-4a41-417d-baca-be222efa8fa8 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:03.991014 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a325a1b-4a41-417d-baca-be222efa8fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:04.035751 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-3a325a1b-4a41-417d-baca-be222efa8fa8 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:04.037089 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-3a325a1b-4a41-417d-baca-be222efa8fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:04.047273 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc3a0c-e56c-4b70-8ecc-82ffad1795ca admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:04.154238 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edace6b-fcc3-43e2-aafd-10d09cb337fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:04.156524 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edace6b-fcc3-43e2-aafd-10d09cb337fb admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:04.157017 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edace6b-fcc3-43e2-aafd-10d09cb337fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:04.157492 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edace6b-fcc3-43e2-aafd-10d09cb337fb admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:04.158550 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edace6b-fcc3-43e2-aafd-10d09cb337fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:04.161115 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edace6b-fcc3-43e2-aafd-10d09cb337fb admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:04.189254 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 849/1715] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:04.199922 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 867/1716] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:05:03 2022] POST /identity/v3/users => generated 297 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:04.200074 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a325a1b-4a41-417d-baca-be222efa8fa8 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:04.201289 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-3a325a1b-4a41-417d-baca-be222efa8fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:04.204403 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad716fb7-bb41-4c21-a957-c5d9d7bcfb2b None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:04.204672 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad716fb7-bb41-4c21-a957-c5d9d7bcfb2b None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:04.204992 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad716fb7-bb41-4c21-a957-c5d9d7bcfb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:04.217331 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a325a1b-4a41-417d-baca-be222efa8fa8 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:04.238387 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb1da8-3239-4e20-8d00-0e22666d1004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:04.239316 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb1da8-3239-4e20-8d00-0e22666d1004 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:04.239709 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb1da8-3239-4e20-8d00-0e22666d1004 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:04.240098 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb1da8-3239-4e20-8d00-0e22666d1004 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:04.241035 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb1da8-3239-4e20-8d00-0e22666d1004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:04.244343 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-ad716fb7-bb41-4c21-a957-c5d9d7bcfb2b None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:04.244746 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb1da8-3239-4e20-8d00-0e22666d1004 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:04.247918 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-ad716fb7-bb41-4c21-a957-c5d9d7bcfb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:04.281009 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 868/1717] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:04.281278 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 850/1718] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:04.284858 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad716fb7-bb41-4c21-a957-c5d9d7bcfb2b None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:04.285388 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb1da8-3239-4e20-8d00-0e22666d1004 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:04.306265 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad716fb7-bb41-4c21-a957-c5d9d7bcfb2b None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:04.315670 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb1da8-3239-4e20-8d00-0e22666d1004 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:04.327385 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622e5bc-6b95-4f17-bfef-ae561cd67673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:04.328199 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622e5bc-6b95-4f17-bfef-ae561cd67673 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:04.328487 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622e5bc-6b95-4f17-bfef-ae561cd67673 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:04.328754 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622e5bc-6b95-4f17-bfef-ae561cd67673 admin admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:04.329520 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622e5bc-6b95-4f17-bfef-ae561cd67673 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:05:04.330059 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622e5bc-6b95-4f17-bfef-ae561cd67673 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:04.333137 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622e5bc-6b95-4f17-bfef-ae561cd67673 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:04.333558 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b110b-7d59-4acb-830b-418922a6251f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:04.338126 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b110b-7d59-4acb-830b-418922a6251f admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:04.339685 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b110b-7d59-4acb-830b-418922a6251f admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:04.339990 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b110b-7d59-4acb-830b-418922a6251f admin admin] PATH_INFO: `/v3/projects/9279e4ae388f4a7799903715c27ffb6d/users/2229317ad0ee4cddbcdd3dd057687d0f/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:04.366077 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 869/1719] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:05:04.368404 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622e5bc-6b95-4f17-bfef-ae561cd67673 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:04.390127 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622e5bc-6b95-4f17-bfef-ae561cd67673 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:04.398568 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d53ce-c43a-44ac-8e40-2b9ccc8524ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:04.399364 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d53ce-c43a-44ac-8e40-2b9ccc8524ed admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:04.399675 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d53ce-c43a-44ac-8e40-2b9ccc8524ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:04.399974 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d53ce-c43a-44ac-8e40-2b9ccc8524ed admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:04.400832 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d53ce-c43a-44ac-8e40-2b9ccc8524ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:04.405549 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b110b-7d59-4acb-830b-418922a6251f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9279e4ae388f4a7799903715c27ffb6d, user_id=2229317ad0ee4cddbcdd3dd057687d0f, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:04.405729 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d53ce-c43a-44ac-8e40-2b9ccc8524ed admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:04.420256 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b110b-7d59-4acb-830b-418922a6251f admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:04.461981 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 870/1720] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:05:04 2022] POST /identity/v3/projects => generated 363 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:04.466484 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d53ce-c43a-44ac-8e40-2b9ccc8524ed admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:04.475465 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 851/1721] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:05:04 2022] PUT /identity/v3/projects/9279e4ae388f4a7799903715c27ffb6d/users/2229317ad0ee4cddbcdd3dd057687d0f/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:04.486221 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b110b-7d59-4acb-830b-418922a6251f admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:04.696201 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b110b-7d59-4acb-830b-418922a6251f admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:04.696422 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d53ce-c43a-44ac-8e40-2b9ccc8524ed admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:04.709354 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c84b18-da84-4763-b7ce-8ce9a13bda44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:04.710012 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c84b18-da84-4763-b7ce-8ce9a13bda44 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:04.711966 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c84b18-da84-4763-b7ce-8ce9a13bda44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:04.712255 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c84b18-da84-4763-b7ce-8ce9a13bda44 admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:04.715573 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c84b18-da84-4763-b7ce-8ce9a13bda44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:04.716674 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584de58-8ac0-4a47-8b6c-033d6c5c833b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:04.717392 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584de58-8ac0-4a47-8b6c-033d6c5c833b admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:04.719064 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c84b18-da84-4763-b7ce-8ce9a13bda44 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:04.728317 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584de58-8ac0-4a47-8b6c-033d6c5c833b admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:04.728787 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584de58-8ac0-4a47-8b6c-033d6c5c833b admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:04.729626 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584de58-8ac0-4a47-8b6c-033d6c5c833b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:04.731450 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584de58-8ac0-4a47-8b6c-033d6c5c833b admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:04.774966 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 871/1722] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:05:04 2022] POST /identity/v3/users => generated 282 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:04.778617 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c84b18-da84-4763-b7ce-8ce9a13bda44 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:04.790882 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 852/1723] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:04.795632 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584de58-8ac0-4a47-8b6c-033d6c5c833b admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:04.805026 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c84b18-da84-4763-b7ce-8ce9a13bda44 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:04.819359 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8132e1-4395-4b95-9780-cb2e4460d159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:04.820140 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8132e1-4395-4b95-9780-cb2e4460d159 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:04.820418 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8132e1-4395-4b95-9780-cb2e4460d159 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:04.820687 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8132e1-4395-4b95-9780-cb2e4460d159 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:04.821435 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8132e1-4395-4b95-9780-cb2e4460d159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:04.824572 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584de58-8ac0-4a47-8b6c-033d6c5c833b admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:04.829386 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8132e1-4395-4b95-9780-cb2e4460d159 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:04.833342 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ecb30-2f50-4b69-80b3-d51e1150865f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:04.834643 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ecb30-2f50-4b69-80b3-d51e1150865f admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:04.835054 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ecb30-2f50-4b69-80b3-d51e1150865f admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:04.835474 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ecb30-2f50-4b69-80b3-d51e1150865f admin admin] PATH_INFO: `/v3/projects/9279e4ae388f4a7799903715c27ffb6d/users/2229317ad0ee4cddbcdd3dd057687d0f/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:04.853738 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ecb30-2f50-4b69-80b3-d51e1150865f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9279e4ae388f4a7799903715c27ffb6d, user_id=2229317ad0ee4cddbcdd3dd057687d0f, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:04.856603 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 872/1724] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:04.859622 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ecb30-2f50-4b69-80b3-d51e1150865f admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:04.860030 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8132e1-4395-4b95-9780-cb2e4460d159 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:04.884828 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8132e1-4395-4b95-9780-cb2e4460d159 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:04.888438 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 853/1725] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:05:04 2022] PUT /identity/v3/projects/9279e4ae388f4a7799903715c27ffb6d/users/2229317ad0ee4cddbcdd3dd057687d0f/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:05:04.905635 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6346760-26cf-46c4-898d-a8abe3b667e6 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:04.905917 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6346760-26cf-46c4-898d-a8abe3b667e6 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:04.906191 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6346760-26cf-46c4-898d-a8abe3b667e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:05.004128 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-f6346760-26cf-46c4-898d-a8abe3b667e6 None None] MFA Rules not processed for user `2229317ad0ee4cddbcdd3dd057687d0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:05.005373 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-f6346760-26cf-46c4-898d-a8abe3b667e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:05.028482 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384f70c-9591-434d-95b2-fbac3ecf448b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:05.034821 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384f70c-9591-434d-95b2-fbac3ecf448b admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:05.035297 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384f70c-9591-434d-95b2-fbac3ecf448b admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:05.035422 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384f70c-9591-434d-95b2-fbac3ecf448b admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:05.036279 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384f70c-9591-434d-95b2-fbac3ecf448b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:05.038170 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384f70c-9591-434d-95b2-fbac3ecf448b admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:05.080618 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 873/1726] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:05.081630 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384f70c-9591-434d-95b2-fbac3ecf448b admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:05.093105 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384f70c-9591-434d-95b2-fbac3ecf448b admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:05.114775 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671cf3b-f465-4967-baf0-d85fb028ed4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:05.115958 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671cf3b-f465-4967-baf0-d85fb028ed4b admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:05.116275 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671cf3b-f465-4967-baf0-d85fb028ed4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:05.116552 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671cf3b-f465-4967-baf0-d85fb028ed4b admin admin] PATH_INFO: `/v3/projects/52401679c4584a20bd150bb341367b16/users/b47bfdfecae243789c8dc7da328b1791/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:05.152810 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671cf3b-f465-4967-baf0-d85fb028ed4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=52401679c4584a20bd150bb341367b16, user_id=b47bfdfecae243789c8dc7da328b1791, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:05.155543 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671cf3b-f465-4967-baf0-d85fb028ed4b admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:05.196439 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 874/1727] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:05:05 2022] PUT /identity/v3/projects/52401679c4584a20bd150bb341367b16/users/b47bfdfecae243789c8dc7da328b1791/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:05.198193 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbae1c3-c790-4d17-afd0-3f1e5b921dbb None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:05.198633 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbae1c3-c790-4d17-afd0-3f1e5b921dbb None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:05.198855 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbae1c3-c790-4d17-afd0-3f1e5b921dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:05.205685 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 854/1728] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:04 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:05.216026 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6346760-26cf-46c4-898d-a8abe3b667e6 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:05.217859 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-f6346760-26cf-46c4-898d-a8abe3b667e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:05.267045 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-4bbae1c3-c790-4d17-afd0-3f1e5b921dbb None None] MFA Rules not processed for user `b47bfdfecae243789c8dc7da328b1791`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:05.268294 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-4bbae1c3-c790-4d17-afd0-3f1e5b921dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:05.388150 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6346760-26cf-46c4-898d-a8abe3b667e6 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:05.440000 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 875/1729] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:05 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:05.444786 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbae1c3-c790-4d17-afd0-3f1e5b921dbb None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:05.456800 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-4bbae1c3-c790-4d17-afd0-3f1e5b921dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:05.493123 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd58ab4-5682-4398-aa7d-49806780a3a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:05.493902 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd58ab4-5682-4398-aa7d-49806780a3a0 service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:05.494388 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd58ab4-5682-4398-aa7d-49806780a3a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:05.494559 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd58ab4-5682-4398-aa7d-49806780a3a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:05.627569 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbae1c3-c790-4d17-afd0-3f1e5b921dbb None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:05.638754 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd58ab4-5682-4398-aa7d-49806780a3a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:05.640736 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd58ab4-5682-4398-aa7d-49806780a3a0 service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:05.643307 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2ad85-bb99-4ae5-8520-466d2f262ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:05.657483 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 855/1730] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:05:05 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 03:05:05.658020 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2ad85-bb99-4ae5-8520-466d2f262ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:05.658521 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2ad85-bb99-4ae5-8520-466d2f262ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:05.658895 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2ad85-bb99-4ae5-8520-466d2f262ec6 admin admin] PATH_INFO: `/v3/projects/98768e17488845bca25b5fec380fa8ac` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:05.659901 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd58ab4-5682-4398-aa7d-49806780a3a0 service cinder] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:05.671625 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2ad85-bb99-4ae5-8520-466d2f262ec6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98768e17488845bca25b5fec380fa8ac)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:05.675167 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2ad85-bb99-4ae5-8520-466d2f262ec6 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:05.675499 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd58ab4-5682-4398-aa7d-49806780a3a0 service cinder] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:05.682838 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb0ecf-972a-4c34-bf2e-4a6d1e506f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:05.684859 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb0ecf-972a-4c34-bf2e-4a6d1e506f33 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:05.685214 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb0ecf-972a-4c34-bf2e-4a6d1e506f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:05.685560 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb0ecf-972a-4c34-bf2e-4a6d1e506f33 admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:05.686502 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb0ecf-972a-4c34-bf2e-4a6d1e506f33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:05.691006 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb0ecf-972a-4c34-bf2e-4a6d1e506f33 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:05.747940 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 856/1731] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:05:05 2022] POST /identity/v3/projects => generated 361 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:05.750542 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb0ecf-972a-4c34-bf2e-4a6d1e506f33 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:05.778007 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-90a2ad85-bb99-4ae5-8520-466d2f262ec6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98768e17488845bca25b5fec380fa8ac', 'request_id': 'req-90a2ad85-bb99-4ae5-8520-466d2f262ec6'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:05.789768 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-90a2ad85-bb99-4ae5-8520-466d2f262ec6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98768e17488845bca25b5fec380fa8ac', 'request_id': 'req-90a2ad85-bb99-4ae5-8520-466d2f262ec6'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:05.818024 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-90a2ad85-bb99-4ae5-8520-466d2f262ec6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98768e17488845bca25b5fec380fa8ac', 'request_id': 'req-90a2ad85-bb99-4ae5-8520-466d2f262ec6'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:05.880886 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-90a2ad85-bb99-4ae5-8520-466d2f262ec6 admin admin] The token cache is being invalidate because project 98768e17488845bca25b5fec380fa8ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:05:05.881186 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-90a2ad85-bb99-4ae5-8520-466d2f262ec6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:05.892241 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-90a2ad85-bb99-4ae5-8520-466d2f262ec6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:05.898790 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 876/1732] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:05:05 2022] DELETE /identity/v3/projects/98768e17488845bca25b5fec380fa8ac => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:05.909144 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2313f-3863-495c-a50f-56260c41b013 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:05.909432 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2313f-3863-495c-a50f-56260c41b013 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:05.909690 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2313f-3863-495c-a50f-56260c41b013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:05.912421 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb0ecf-972a-4c34-bf2e-4a6d1e506f33 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:05.992097 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-a9d2313f-3863-495c-a50f-56260c41b013 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:05.995062 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-a9d2313f-3863-495c-a50f-56260c41b013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:06.139177 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae71465-daab-44bb-ad2c-37e085ab2e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:06.140116 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae71465-daab-44bb-ad2c-37e085ab2e26 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:06.140552 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae71465-daab-44bb-ad2c-37e085ab2e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:06.140995 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae71465-daab-44bb-ad2c-37e085ab2e26 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:06.142012 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae71465-daab-44bb-ad2c-37e085ab2e26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:06.147277 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae71465-daab-44bb-ad2c-37e085ab2e26 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:06.169846 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 877/1733] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:06.178022 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b0500-d9ae-416d-9ff4-5440c0c1f7d7 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:06.178309 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b0500-d9ae-416d-9ff4-5440c0c1f7d7 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:06.178589 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b0500-d9ae-416d-9ff4-5440c0c1f7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:06.179662 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 857/1734] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:05:05 2022] POST /identity/v3/users => generated 287 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:06.184324 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae71465-daab-44bb-ad2c-37e085ab2e26 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:06.187973 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-aae71465-daab-44bb-ad2c-37e085ab2e26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:06.206585 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae71465-daab-44bb-ad2c-37e085ab2e26 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:06.211324 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-c30b0500-d9ae-416d-9ff4-5440c0c1f7d7 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:06.214290 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3c48e-9bf6-430c-9f00-5adc3644f19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:06.215404 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3c48e-9bf6-430c-9f00-5adc3644f19e admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:06.215838 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3c48e-9bf6-430c-9f00-5adc3644f19e admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:06.216073 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3c48e-9bf6-430c-9f00-5adc3644f19e admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:06.216930 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3c48e-9bf6-430c-9f00-5adc3644f19e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:06.218150 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-c30b0500-d9ae-416d-9ff4-5440c0c1f7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:06.218987 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3c48e-9bf6-430c-9f00-5adc3644f19e admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:06.238050 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 858/1735] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:06.240956 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 878/1736] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:06.245698 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3c48e-9bf6-430c-9f00-5adc3644f19e admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:06.246888 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b0500-d9ae-416d-9ff4-5440c0c1f7d7 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:06.264881 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3c48e-9bf6-430c-9f00-5adc3644f19e admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:06.271520 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b0500-d9ae-416d-9ff4-5440c0c1f7d7 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:06.271844 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421de33-eae9-4887-8816-aac4eeb4945b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:06.272904 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421de33-eae9-4887-8816-aac4eeb4945b admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:06.273554 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421de33-eae9-4887-8816-aac4eeb4945b admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:06.274457 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421de33-eae9-4887-8816-aac4eeb4945b admin admin] PATH_INFO: `/v3/projects/b5e1c5f983e04c84a3623f89c2c781fd/users/9f019b3fcec9428fbb32a55bd5576caf/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:06.293962 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063242c6-1c8e-4c45-81f7-dfd42524f69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:06.296396 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063242c6-1c8e-4c45-81f7-dfd42524f69c admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:06.298948 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063242c6-1c8e-4c45-81f7-dfd42524f69c admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:06.300255 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063242c6-1c8e-4c45-81f7-dfd42524f69c admin admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:06.302938 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063242c6-1c8e-4c45-81f7-dfd42524f69c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:05:06.304063 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063242c6-1c8e-4c45-81f7-dfd42524f69c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:06.305208 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421de33-eae9-4887-8816-aac4eeb4945b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5e1c5f983e04c84a3623f89c2c781fd, user_id=9f019b3fcec9428fbb32a55bd5576caf, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:06.311045 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421de33-eae9-4887-8816-aac4eeb4945b admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:06.316459 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063242c6-1c8e-4c45-81f7-dfd42524f69c admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:06.335216 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 859/1737] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:05:06 2022] PUT /identity/v3/projects/b5e1c5f983e04c84a3623f89c2c781fd/users/9f019b3fcec9428fbb32a55bd5576caf/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:06.340445 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421de33-eae9-4887-8816-aac4eeb4945b admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:06.360241 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 879/1738] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:05:06.366884 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442a26a-e64d-4acb-b1db-6dfa87d8c23a None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:06.367174 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442a26a-e64d-4acb-b1db-6dfa87d8c23a None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:06.368227 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442a26a-e64d-4acb-b1db-6dfa87d8c23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:06.406979 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-0442a26a-e64d-4acb-b1db-6dfa87d8c23a None None] MFA Rules not processed for user `c22f5695481341419674da058685a2d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:06.408532 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-0442a26a-e64d-4acb-b1db-6dfa87d8c23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:06.603915 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 880/1739] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:05:06.605102 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442a26a-e64d-4acb-b1db-6dfa87d8c23a None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:06.697014 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421de33-eae9-4887-8816-aac4eeb4945b admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:06.713209 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a0e77-9e8b-4723-9ad2-7f0fd6ef7ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:06.714747 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a0e77-9e8b-4723-9ad2-7f0fd6ef7ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:06.715024 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a0e77-9e8b-4723-9ad2-7f0fd6ef7ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:06.715287 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a0e77-9e8b-4723-9ad2-7f0fd6ef7ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:06.727603 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a0e77-9e8b-4723-9ad2-7f0fd6ef7ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:06.735111 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a0e77-9e8b-4723-9ad2-7f0fd6ef7ab4 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:06.785455 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442a26a-e64d-4acb-b1db-6dfa87d8c23a None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:06.787952 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 860/1740] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:06.792134 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a0e77-9e8b-4723-9ad2-7f0fd6ef7ab4 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:06.797672 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-303a0e77-9e8b-4723-9ad2-7f0fd6ef7ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:06.799928 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f0a4c-b7a3-42c8-bd67-cf80f8cb0edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:06.801023 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f0a4c-b7a3-42c8-bd67-cf80f8cb0edd admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:06.807521 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f0a4c-b7a3-42c8-bd67-cf80f8cb0edd admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:06.810452 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f0a4c-b7a3-42c8-bd67-cf80f8cb0edd admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:06.811531 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f0a4c-b7a3-42c8-bd67-cf80f8cb0edd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:06.813937 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f0a4c-b7a3-42c8-bd67-cf80f8cb0edd admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:06.955050 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 881/1741] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:05:06 2022] POST /identity/v3/projects => generated 367 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:06.960108 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f0a4c-b7a3-42c8-bd67-cf80f8cb0edd admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:07.088883 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a0e77-9e8b-4723-9ad2-7f0fd6ef7ab4 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:07.212101 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f0a4c-b7a3-42c8-bd67-cf80f8cb0edd admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:07.240190 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94c944-2729-496c-987e-b477ddb92548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:07.244181 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94c944-2729-496c-987e-b477ddb92548 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:07.246492 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94c944-2729-496c-987e-b477ddb92548 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:07.246492 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94c944-2729-496c-987e-b477ddb92548 admin admin] PATH_INFO: `/v3/projects/b5e1c5f983e04c84a3623f89c2c781fd/users/9f019b3fcec9428fbb32a55bd5576caf/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:07.253496 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94c944-2729-496c-987e-b477ddb92548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5e1c5f983e04c84a3623f89c2c781fd, user_id=9f019b3fcec9428fbb32a55bd5576caf, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:07.259348 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94c944-2729-496c-987e-b477ddb92548 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:07.272506 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75219c4b-cf14-4815-afe5-b87aefb2d9dc tempest-VolumeQuotaClassesTest-1454221533 tempest-VolumeQuotaClassesTest-1454221533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2229317ad0ee4cddbcdd3dd057687d0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9279e4ae388f4a7799903715c27ffb6d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:07.273336 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75219c4b-cf14-4815-afe5-b87aefb2d9dc tempest-VolumeQuotaClassesTest-1454221533 tempest-VolumeQuotaClassesTest-1454221533-project-admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:07.273711 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75219c4b-cf14-4815-afe5-b87aefb2d9dc tempest-VolumeQuotaClassesTest-1454221533 tempest-VolumeQuotaClassesTest-1454221533-project-admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:07.274080 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75219c4b-cf14-4815-afe5-b87aefb2d9dc tempest-VolumeQuotaClassesTest-1454221533 tempest-VolumeQuotaClassesTest-1454221533-project-admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:07.274919 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75219c4b-cf14-4815-afe5-b87aefb2d9dc tempest-VolumeQuotaClassesTest-1454221533 tempest-VolumeQuotaClassesTest-1454221533-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:05:07.276022 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75219c4b-cf14-4815-afe5-b87aefb2d9dc tempest-VolumeQuotaClassesTest-1454221533 tempest-VolumeQuotaClassesTest-1454221533-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:07.278558 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75219c4b-cf14-4815-afe5-b87aefb2d9dc tempest-VolumeQuotaClassesTest-1454221533 tempest-VolumeQuotaClassesTest-1454221533-project-admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:07.308125 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 882/1742] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:05:06 2022] PUT /identity/v3/projects/b5e1c5f983e04c84a3623f89c2c781fd/users/9f019b3fcec9428fbb32a55bd5576caf/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:07.309410 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94c944-2729-496c-987e-b477ddb92548 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:07.317275 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 861/1743] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 529 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:05:07.321274 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa3283-66dd-4fdb-b919-277f4abe7ebe None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:07.328068 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa3283-66dd-4fdb-b919-277f4abe7ebe None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:07.329225 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa3283-66dd-4fdb-b919-277f4abe7ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:07.423462 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-52aa3283-66dd-4fdb-b919-277f4abe7ebe None None] MFA Rules not processed for user `9f019b3fcec9428fbb32a55bd5576caf`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:07.426615 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-52aa3283-66dd-4fdb-b919-277f4abe7ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:07.510406 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94c944-2729-496c-987e-b477ddb92548 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:07.529788 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480fd2c8-5714-4454-a77a-38a730423b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:07.538070 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480fd2c8-5714-4454-a77a-38a730423b0d admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:07.543532 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480fd2c8-5714-4454-a77a-38a730423b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:07.544006 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480fd2c8-5714-4454-a77a-38a730423b0d admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:07.544805 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480fd2c8-5714-4454-a77a-38a730423b0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:07.546897 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480fd2c8-5714-4454-a77a-38a730423b0d admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:07.592121 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 883/1744] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:05:07 2022] POST /identity/v3/users => generated 284 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:07.594073 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480fd2c8-5714-4454-a77a-38a730423b0d admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:07.639968 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 862/1745] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:07 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:07.639968 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa3283-66dd-4fdb-b919-277f4abe7ebe None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:07.655211 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa3283-66dd-4fdb-b919-277f4abe7ebe None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:07.668551 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05f4b4-0644-4249-b07e-f3c6e65a665a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:07.669358 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05f4b4-0644-4249-b07e-f3c6e65a665a admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:07.669717 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05f4b4-0644-4249-b07e-f3c6e65a665a admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:07.670081 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05f4b4-0644-4249-b07e-f3c6e65a665a admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:07.670970 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af05f4b4-0644-4249-b07e-f3c6e65a665a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:07.672803 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af05f4b4-0644-4249-b07e-f3c6e65a665a admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:07.698190 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 863/1746] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:07.698190 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05f4b4-0644-4249-b07e-f3c6e65a665a admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:07.702975 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-af05f4b4-0644-4249-b07e-f3c6e65a665a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:07.754464 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480fd2c8-5714-4454-a77a-38a730423b0d admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:07.768226 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5840c-13b3-40b2-b196-6733f6add363 tempest-VolumeQuotaClassesTest-1454221533 tempest-VolumeQuotaClassesTest-1454221533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2229317ad0ee4cddbcdd3dd057687d0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9279e4ae388f4a7799903715c27ffb6d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:07.769227 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5840c-13b3-40b2-b196-6733f6add363 tempest-VolumeQuotaClassesTest-1454221533 tempest-VolumeQuotaClassesTest-1454221533-project-admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:07.769657 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5840c-13b3-40b2-b196-6733f6add363 tempest-VolumeQuotaClassesTest-1454221533 tempest-VolumeQuotaClassesTest-1454221533-project-admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:07.770097 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5840c-13b3-40b2-b196-6733f6add363 tempest-VolumeQuotaClassesTest-1454221533 tempest-VolumeQuotaClassesTest-1454221533-project-admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:07.770979 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5840c-13b3-40b2-b196-6733f6add363 tempest-VolumeQuotaClassesTest-1454221533 tempest-VolumeQuotaClassesTest-1454221533-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:07.773111 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5840c-13b3-40b2-b196-6733f6add363 tempest-VolumeQuotaClassesTest-1454221533 tempest-VolumeQuotaClassesTest-1454221533-project-admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:07.826414 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05f4b4-0644-4249-b07e-f3c6e65a665a admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:07.828679 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 884/1747] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:05:07 2022] POST /identity/v3/projects => generated 353 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:07.829816 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5840c-13b3-40b2-b196-6733f6add363 tempest-VolumeQuotaClassesTest-1454221533 tempest-VolumeQuotaClassesTest-1454221533-project-admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:07.963691 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b047bcb6-3804-4a42-83e7-c8bc939f429c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:07.964648 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047bcb6-3804-4a42-83e7-c8bc939f429c service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:07.964990 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047bcb6-3804-4a42-83e7-c8bc939f429c service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:07.965528 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5840c-13b3-40b2-b196-6733f6add363 tempest-VolumeQuotaClassesTest-1454221533 tempest-VolumeQuotaClassesTest-1454221533-project-admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:07.965774 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047bcb6-3804-4a42-83e7-c8bc939f429c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:07.983166 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a80679-073c-432e-9f2a-ca7a10cb0499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:07.984265 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a80679-073c-432e-9f2a-ca7a10cb0499 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:07.984704 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a80679-073c-432e-9f2a-ca7a10cb0499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:07.985124 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a80679-073c-432e-9f2a-ca7a10cb0499 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:07.986091 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a80679-073c-432e-9f2a-ca7a10cb0499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:07.987919 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a80679-073c-432e-9f2a-ca7a10cb0499 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:08.013180 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 885/1748] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:08.014537 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a80679-073c-432e-9f2a-ca7a10cb0499 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:08.167842 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a80679-073c-432e-9f2a-ca7a10cb0499 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:08.182759 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b8cb6-173c-4220-a1ea-24ea2aa088ac tempest-VolumeQuotaClassesTest-1454221533 tempest-VolumeQuotaClassesTest-1454221533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2229317ad0ee4cddbcdd3dd057687d0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9279e4ae388f4a7799903715c27ffb6d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:08.183959 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b8cb6-173c-4220-a1ea-24ea2aa088ac tempest-VolumeQuotaClassesTest-1454221533 tempest-VolumeQuotaClassesTest-1454221533-project-admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:08.184432 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b8cb6-173c-4220-a1ea-24ea2aa088ac tempest-VolumeQuotaClassesTest-1454221533 tempest-VolumeQuotaClassesTest-1454221533-project-admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:08.184885 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b8cb6-173c-4220-a1ea-24ea2aa088ac tempest-VolumeQuotaClassesTest-1454221533 tempest-VolumeQuotaClassesTest-1454221533-project-admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:08.185969 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b8cb6-173c-4220-a1ea-24ea2aa088ac tempest-VolumeQuotaClassesTest-1454221533 tempest-VolumeQuotaClassesTest-1454221533-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:05:08.186520 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b8cb6-173c-4220-a1ea-24ea2aa088ac tempest-VolumeQuotaClassesTest-1454221533 tempest-VolumeQuotaClassesTest-1454221533-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:08.188432 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b8cb6-173c-4220-a1ea-24ea2aa088ac tempest-VolumeQuotaClassesTest-1454221533 tempest-VolumeQuotaClassesTest-1454221533-project-admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:08.216619 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 886/1749] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:05:08.220670 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b8cb6-173c-4220-a1ea-24ea2aa088ac tempest-VolumeQuotaClassesTest-1454221533 tempest-VolumeQuotaClassesTest-1454221533-project-admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:08.227146 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b047bcb6-3804-4a42-83e7-c8bc939f429c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:08.234540 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b047bcb6-3804-4a42-83e7-c8bc939f429c service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:08.253910 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b8cb6-173c-4220-a1ea-24ea2aa088ac tempest-VolumeQuotaClassesTest-1454221533 tempest-VolumeQuotaClassesTest-1454221533-project-admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:08.259375 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a64a3-0059-459c-b156-747525883587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:08.260743 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a64a3-0059-459c-b156-747525883587 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:08.261247 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a64a3-0059-459c-b156-747525883587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:08.261719 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a64a3-0059-459c-b156-747525883587 admin admin] PATH_INFO: `/v3/projects/77de0799001844b88282cd644df5c4d9/users/d7ff215cb4864653896569323a01662e/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:08.298387 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a64a3-0059-459c-b156-747525883587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77de0799001844b88282cd644df5c4d9, user_id=d7ff215cb4864653896569323a01662e, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:08.301562 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a64a3-0059-459c-b156-747525883587 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:08.308383 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 864/1750] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:05:07 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:05:08.334837 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 887/1751] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:05:08 2022] PUT /identity/v3/projects/77de0799001844b88282cd644df5c4d9/users/d7ff215cb4864653896569323a01662e/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:08.353160 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a64a3-0059-459c-b156-747525883587 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:08.354282 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc036305-cc11-4951-ac7e-f71720c979f8 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:08.354967 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc036305-cc11-4951-ac7e-f71720c979f8 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:08.355390 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc036305-cc11-4951-ac7e-f71720c979f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:08.477717 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a64a3-0059-459c-b156-747525883587 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:08.481302 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-dc036305-cc11-4951-ac7e-f71720c979f8 None None] MFA Rules not processed for user `d7ff215cb4864653896569323a01662e`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:08.482976 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-dc036305-cc11-4951-ac7e-f71720c979f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:08.504706 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b655d-8190-4ff7-ab3e-a13aecc9993c tempest-VolumeQuotaClassesTest-1454221533 tempest-VolumeQuotaClassesTest-1454221533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2229317ad0ee4cddbcdd3dd057687d0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9279e4ae388f4a7799903715c27ffb6d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:08.505715 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b655d-8190-4ff7-ab3e-a13aecc9993c tempest-VolumeQuotaClassesTest-1454221533 tempest-VolumeQuotaClassesTest-1454221533-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:08.506051 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b655d-8190-4ff7-ab3e-a13aecc9993c tempest-VolumeQuotaClassesTest-1454221533 tempest-VolumeQuotaClassesTest-1454221533-project-admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:08.506381 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b655d-8190-4ff7-ab3e-a13aecc9993c tempest-VolumeQuotaClassesTest-1454221533 tempest-VolumeQuotaClassesTest-1454221533-project-admin] PATH_INFO: `/v3/projects/dbff404d8fba42faad5cf6afed0d8ffd` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:08.507816 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b655d-8190-4ff7-ab3e-a13aecc9993c tempest-VolumeQuotaClassesTest-1454221533 tempest-VolumeQuotaClassesTest-1454221533-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dbff404d8fba42faad5cf6afed0d8ffd)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:08.520416 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b655d-8190-4ff7-ab3e-a13aecc9993c tempest-VolumeQuotaClassesTest-1454221533 tempest-VolumeQuotaClassesTest-1454221533-project-admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:08.622137 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-948b655d-8190-4ff7-ab3e-a13aecc9993c tempest-VolumeQuotaClassesTest-1454221533 tempest-VolumeQuotaClassesTest-1454221533-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbff404d8fba42faad5cf6afed0d8ffd', 'request_id': 'req-948b655d-8190-4ff7-ab3e-a13aecc9993c'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:08.626918 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 865/1752] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:08.628000 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc036305-cc11-4951-ac7e-f71720c979f8 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:08.643412 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-948b655d-8190-4ff7-ab3e-a13aecc9993c tempest-VolumeQuotaClassesTest-1454221533 tempest-VolumeQuotaClassesTest-1454221533-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbff404d8fba42faad5cf6afed0d8ffd', 'request_id': 'req-948b655d-8190-4ff7-ab3e-a13aecc9993c'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:08.658467 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-948b655d-8190-4ff7-ab3e-a13aecc9993c tempest-VolumeQuotaClassesTest-1454221533 tempest-VolumeQuotaClassesTest-1454221533-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbff404d8fba42faad5cf6afed0d8ffd', 'request_id': 'req-948b655d-8190-4ff7-ab3e-a13aecc9993c'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:08.692640 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-948b655d-8190-4ff7-ab3e-a13aecc9993c tempest-VolumeQuotaClassesTest-1454221533 tempest-VolumeQuotaClassesTest-1454221533-project-admin] The token cache is being invalidate because project dbff404d8fba42faad5cf6afed0d8ffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:05:08.692998 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-948b655d-8190-4ff7-ab3e-a13aecc9993c tempest-VolumeQuotaClassesTest-1454221533 tempest-VolumeQuotaClassesTest-1454221533-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:08.693569 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-948b655d-8190-4ff7-ab3e-a13aecc9993c tempest-VolumeQuotaClassesTest-1454221533 tempest-VolumeQuotaClassesTest-1454221533-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:08.695418 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 888/1753] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:05:08 2022] DELETE /identity/v3/projects/dbff404d8fba42faad5cf6afed0d8ffd => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:05:08.697002 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5fc544-ed74-4404-a411-221438ab9888 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:08.697907 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5fc544-ed74-4404-a411-221438ab9888 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:08.698189 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5fc544-ed74-4404-a411-221438ab9888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:08.772355 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-4a5fc544-ed74-4404-a411-221438ab9888 None None] MFA Rules not processed for user `8f516943aec14608b5c9d343418a2677`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:08.775252 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-4a5fc544-ed74-4404-a411-221438ab9888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:08.864903 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc036305-cc11-4951-ac7e-f71720c979f8 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:08.931588 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 889/1754] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Apr 12 03:05:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:08.943991 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5fc544-ed74-4404-a411-221438ab9888 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:08.947983 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-4a5fc544-ed74-4404-a411-221438ab9888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:09.100497 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a7f88-344f-4f0d-a770-6b3e9c9b7edd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:09.102215 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a7f88-344f-4f0d-a770-6b3e9c9b7edd service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:09.102338 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a7f88-344f-4f0d-a770-6b3e9c9b7edd service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:09.110914 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a7f88-344f-4f0d-a770-6b3e9c9b7edd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:09.116602 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-eb9a7f88-344f-4f0d-a770-6b3e9c9b7edd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:09.212179 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5fc544-ed74-4404-a411-221438ab9888 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:09.229582 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1efbb6-9560-43ea-b815-96a17faf8549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:09.230305 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1efbb6-9560-43ea-b815-96a17faf8549 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:09.232246 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1efbb6-9560-43ea-b815-96a17faf8549 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:09.235251 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1efbb6-9560-43ea-b815-96a17faf8549 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:09.236279 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1efbb6-9560-43ea-b815-96a17faf8549 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:09.241487 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1efbb6-9560-43ea-b815-96a17faf8549 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:09.324845 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a7f88-344f-4f0d-a770-6b3e9c9b7edd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:09.327180 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a7f88-344f-4f0d-a770-6b3e9c9b7edd service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:09.349153 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 890/1755] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:05:08 2022] POST /identity/v3/projects => generated 369 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:09.355587 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b60a1-7331-4e2a-b72e-80c6da4c180d None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:09.358207 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 866/1756] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:05:08 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 731 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:05:09.358697 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b60a1-7331-4e2a-b72e-80c6da4c180d None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:09.359207 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b60a1-7331-4e2a-b72e-80c6da4c180d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:09.359338 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a7f88-344f-4f0d-a770-6b3e9c9b7edd service cinder] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:09.366579 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-eb9a7f88-344f-4f0d-a770-6b3e9c9b7edd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:09.409759 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-893b60a1-7331-4e2a-b72e-80c6da4c180d None None] MFA Rules not processed for user `8f516943aec14608b5c9d343418a2677`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:09.414497 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-893b60a1-7331-4e2a-b72e-80c6da4c180d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:09.416169 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a7f88-344f-4f0d-a770-6b3e9c9b7edd service cinder] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:09.487681 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 891/1757] 10.222.0.32 () {58 vars in 1009 bytes} [Tue Apr 12 03:05:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:09.488629 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b60a1-7331-4e2a-b72e-80c6da4c180d None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:09.637704 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b60a1-7331-4e2a-b72e-80c6da4c180d None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:09.647428 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b50169-c0a8-4d69-8313-b33bdba74b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:09.648726 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b50169-c0a8-4d69-8313-b33bdba74b81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:09.649135 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b50169-c0a8-4d69-8313-b33bdba74b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:09.649507 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b50169-c0a8-4d69-8313-b33bdba74b81 admin admin] PATH_INFO: `/v3/users/e53c005563a44b85a4ffbef8914de431` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:09.649821 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28632a9-b93a-4b89-80fb-70d193c268ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:09.650643 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28632a9-b93a-4b89-80fb-70d193c268ef admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:09.650916 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28632a9-b93a-4b89-80fb-70d193c268ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:09.651553 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28632a9-b93a-4b89-80fb-70d193c268ef admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:09.651657 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b50169-c0a8-4d69-8313-b33bdba74b81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e53c005563a44b85a4ffbef8914de431)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:09.652489 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28632a9-b93a-4b89-80fb-70d193c268ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:09.654499 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28632a9-b93a-4b89-80fb-70d193c268ef admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:09.658564 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b50169-c0a8-4d69-8313-b33bdba74b81 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:09.706739 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 892/1758] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:05:09 2022] POST /identity/v3/users => generated 291 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:09.715244 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28632a9-b93a-4b89-80fb-70d193c268ef admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:09.717663 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-f28632a9-b93a-4b89-80fb-70d193c268ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:09.748099 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28632a9-b93a-4b89-80fb-70d193c268ef admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:09.755583 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262060cd-fb17-4b97-a175-9bf30a6ec9bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:09.757905 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262060cd-fb17-4b97-a175-9bf30a6ec9bb service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:09.759681 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262060cd-fb17-4b97-a175-9bf30a6ec9bb service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:09.760000 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262060cd-fb17-4b97-a175-9bf30a6ec9bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:09.797686 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262060cd-fb17-4b97-a175-9bf30a6ec9bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:09.803011 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262060cd-fb17-4b97-a175-9bf30a6ec9bb service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:09.837190 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-74b50169-c0a8-4d69-8313-b33bdba74b81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e53c005563a44b85a4ffbef8914de431'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:09.839688 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-74b50169-c0a8-4d69-8313-b33bdba74b81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e53c005563a44b85a4ffbef8914de431'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:09.874806 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-74b50169-c0a8-4d69-8313-b33bdba74b81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e53c005563a44b85a4ffbef8914de431'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:09.878423 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-74b50169-c0a8-4d69-8313-b33bdba74b81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e53c005563a44b85a4ffbef8914de431'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:09.885523 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 893/1759] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:05:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:05:09.886445 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262060cd-fb17-4b97-a175-9bf30a6ec9bb service neutron] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:09.913053 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-74b50169-c0a8-4d69-8313-b33bdba74b81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e53c005563a44b85a4ffbef8914de431'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:09.948862 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262060cd-fb17-4b97-a175-9bf30a6ec9bb service neutron] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:09.963019 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30df650-bcf1-47f8-b07f-a86e496dabb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:09.968253 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30df650-bcf1-47f8-b07f-a86e496dabb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:09.968827 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30df650-bcf1-47f8-b07f-a86e496dabb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:09.969242 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30df650-bcf1-47f8-b07f-a86e496dabb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:09.970137 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30df650-bcf1-47f8-b07f-a86e496dabb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:09.973510 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30df650-bcf1-47f8-b07f-a86e496dabb8 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:10.008410 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 894/1760] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:10.009060 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 867/1761] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:05:09 2022] DELETE /identity/v3/users/e53c005563a44b85a4ffbef8914de431 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:10.009915 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30df650-bcf1-47f8-b07f-a86e496dabb8 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:10.016716 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b50169-c0a8-4d69-8313-b33bdba74b81 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:10.017794 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-b30df650-bcf1-47f8-b07f-a86e496dabb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:10.032244 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-74b50169-c0a8-4d69-8313-b33bdba74b81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:10.061457 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30df650-bcf1-47f8-b07f-a86e496dabb8 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:10.217017 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6deff-1baf-4cc5-8fff-19fcd140b99e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:10.219196 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6deff-1baf-4cc5-8fff-19fcd140b99e service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:10.221592 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b50169-c0a8-4d69-8313-b33bdba74b81 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:10.224172 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6deff-1baf-4cc5-8fff-19fcd140b99e service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:10.224635 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6deff-1baf-4cc5-8fff-19fcd140b99e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:10.232071 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-97b6deff-1baf-4cc5-8fff-19fcd140b99e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:10.242051 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc3d44-6527-4733-b31f-c7e5276a2a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:10.243021 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc3d44-6527-4733-b31f-c7e5276a2a47 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:10.244994 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc3d44-6527-4733-b31f-c7e5276a2a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:10.245388 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc3d44-6527-4733-b31f-c7e5276a2a47 admin admin] PATH_INFO: `/v3/projects/aa644a9718ec4bc6bdd7aec799402b2e/users/115bedfed3cf4e5d9751acee2becd985/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:10.255799 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6deff-1baf-4cc5-8fff-19fcd140b99e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:10.262299 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6deff-1baf-4cc5-8fff-19fcd140b99e service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:10.291978 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc3d44-6527-4733-b31f-c7e5276a2a47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa644a9718ec4bc6bdd7aec799402b2e, user_id=115bedfed3cf4e5d9751acee2becd985, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:10.299218 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc3d44-6527-4733-b31f-c7e5276a2a47 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:10.320758 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 895/1762] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:05:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:05:10.337181 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 868/1763] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:05:10 2022] PUT /identity/v3/projects/aa644a9718ec4bc6bdd7aec799402b2e/users/115bedfed3cf4e5d9751acee2becd985/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:10.338684 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ddbc3-e029-45d0-924f-2d71ca9125be None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:10.339117 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc3d44-6527-4733-b31f-c7e5276a2a47 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:10.339498 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ddbc3-e029-45d0-924f-2d71ca9125be None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:10.339939 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ddbc3-e029-45d0-924f-2d71ca9125be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:10.386857 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-b46ddbc3-e029-45d0-924f-2d71ca9125be None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:10.388921 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-b46ddbc3-e029-45d0-924f-2d71ca9125be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:10.556813 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 896/1764] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:10.560855 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc3d44-6527-4733-b31f-c7e5276a2a47 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:10.573633 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b7c3d-42a7-4027-a52b-fa30a1252d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:10.574421 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b7c3d-42a7-4027-a52b-fa30a1252d7b admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:10.574699 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b7c3d-42a7-4027-a52b-fa30a1252d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:10.574992 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b7c3d-42a7-4027-a52b-fa30a1252d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:10.577104 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b7c3d-42a7-4027-a52b-fa30a1252d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:10.578233 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b7c3d-42a7-4027-a52b-fa30a1252d7b admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:10.613759 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 869/1765] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:10.615676 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ddbc3-e029-45d0-924f-2d71ca9125be None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:10.632514 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ddbc3-e029-45d0-924f-2d71ca9125be None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:10.655848 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b7c3d-42a7-4027-a52b-fa30a1252d7b admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:10.657889 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e1beb-51da-40f7-941d-5317c93d5a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:10.661817 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e1beb-51da-40f7-941d-5317c93d5a3b admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:10.663228 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e1beb-51da-40f7-941d-5317c93d5a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:10.664505 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e1beb-51da-40f7-941d-5317c93d5a3b admin admin] PATH_INFO: `/v3/projects/aa644a9718ec4bc6bdd7aec799402b2e/users/115bedfed3cf4e5d9751acee2becd985/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:10.683463 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e1beb-51da-40f7-941d-5317c93d5a3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa644a9718ec4bc6bdd7aec799402b2e, user_id=115bedfed3cf4e5d9751acee2becd985, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:10.686345 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e1beb-51da-40f7-941d-5317c93d5a3b admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:10.762012 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 897/1766] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:05:10 2022] PUT /identity/v3/projects/aa644a9718ec4bc6bdd7aec799402b2e/users/115bedfed3cf4e5d9751acee2becd985/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:10.763668 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2de5dd-18d9-466d-b5c4-8b723b0b7235 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:10.763971 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2de5dd-18d9-466d-b5c4-8b723b0b7235 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:10.764264 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2de5dd-18d9-466d-b5c4-8b723b0b7235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:10.861196 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-6a2de5dd-18d9-466d-b5c4-8b723b0b7235 None None] MFA Rules not processed for user `115bedfed3cf4e5d9751acee2becd985`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:10.862819 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-6a2de5dd-18d9-466d-b5c4-8b723b0b7235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:10.932968 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b7c3d-42a7-4027-a52b-fa30a1252d7b admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:11.122151 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3348f-05af-443c-a15e-34468c0210fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:11.123013 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3348f-05af-443c-a15e-34468c0210fa service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:11.123385 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3348f-05af-443c-a15e-34468c0210fa service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:11.123829 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3348f-05af-443c-a15e-34468c0210fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:11.161430 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 898/1767] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:10 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:11.170646 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2de5dd-18d9-466d-b5c4-8b723b0b7235 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:11.175435 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-6a2de5dd-18d9-466d-b5c4-8b723b0b7235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:11.403000 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2de5dd-18d9-466d-b5c4-8b723b0b7235 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:11.412223 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01efa3-9b82-4fec-82f8-d4a7c51fdb22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:11.415682 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01efa3-9b82-4fec-82f8-d4a7c51fdb22 service cinder] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:11.423339 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01efa3-9b82-4fec-82f8-d4a7c51fdb22 service cinder] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:11.423824 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01efa3-9b82-4fec-82f8-d4a7c51fdb22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:11.438722 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3348f-05af-443c-a15e-34468c0210fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:11.443748 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3348f-05af-443c-a15e-34468c0210fa service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:11.456683 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01efa3-9b82-4fec-82f8-d4a7c51fdb22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:11.463108 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01efa3-9b82-4fec-82f8-d4a7c51fdb22 service cinder] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:11.500985 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 899/1768] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:05:11 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:05:11.509443 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 870/1769] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:05:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 854 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:05:12.951441 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc9446-eaec-46bb-bfa7-27189d180dca None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:12.952504 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc9446-eaec-46bb-bfa7-27189d180dca None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:12.952985 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc9446-eaec-46bb-bfa7-27189d180dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:13.077365 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-68bc9446-eaec-46bb-bfa7-27189d180dca None None] MFA Rules not processed for user `569824a5ffb846f1a447f1195bb9c017`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:13.080812 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-68bc9446-eaec-46bb-bfa7-27189d180dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:13.273358 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 900/1770] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:13.578814 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3348f-05af-443c-a15e-34468c0210fa service neutron] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:13.580386 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-11e3348f-05af-443c-a15e-34468c0210fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:13.869371 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3348f-05af-443c-a15e-34468c0210fa service neutron] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:13.897599 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19823514-edee-41c7-b029-14abe7f93177 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:13.898339 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19823514-edee-41c7-b029-14abe7f93177 service nova] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:13.899492 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19823514-edee-41c7-b029-14abe7f93177 service nova] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:13.900268 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19823514-edee-41c7-b029-14abe7f93177 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:13.917242 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19823514-edee-41c7-b029-14abe7f93177 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:13.918912 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19823514-edee-41c7-b029-14abe7f93177 service nova] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:13.976141 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 871/1771] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:05:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:05:14.134022 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc9446-eaec-46bb-bfa7-27189d180dca None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:14.135533 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-68bc9446-eaec-46bb-bfa7-27189d180dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:14.173005 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc9446-eaec-46bb-bfa7-27189d180dca None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:14.187502 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113098e2-e625-4fc9-aed3-8b4465354ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:14.190873 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113098e2-e625-4fc9-aed3-8b4465354ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:14.206110 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113098e2-e625-4fc9-aed3-8b4465354ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:14.207469 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113098e2-e625-4fc9-aed3-8b4465354ef1 admin admin] PATH_INFO: `/v3/users/b47bfdfecae243789c8dc7da328b1791` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:14.210401 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113098e2-e625-4fc9-aed3-8b4465354ef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b47bfdfecae243789c8dc7da328b1791)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:14.214661 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113098e2-e625-4fc9-aed3-8b4465354ef1 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:14.396138 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-113098e2-e625-4fc9-aed3-8b4465354ef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b47bfdfecae243789c8dc7da328b1791'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:14.451102 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-113098e2-e625-4fc9-aed3-8b4465354ef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b47bfdfecae243789c8dc7da328b1791'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:14.452059 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-113098e2-e625-4fc9-aed3-8b4465354ef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b47bfdfecae243789c8dc7da328b1791'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:14.453393 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-113098e2-e625-4fc9-aed3-8b4465354ef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b47bfdfecae243789c8dc7da328b1791'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:14.500398 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-113098e2-e625-4fc9-aed3-8b4465354ef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b47bfdfecae243789c8dc7da328b1791'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:14.541951 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 901/1772] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:05:14 2022] DELETE /identity/v3/users/b47bfdfecae243789c8dc7da328b1791 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:14.546578 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3029a-4bbe-426f-a8f8-ebe080d0a6fd None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:14.546967 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3029a-4bbe-426f-a8f8-ebe080d0a6fd None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:14.547331 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3029a-4bbe-426f-a8f8-ebe080d0a6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:14.617093 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-02e3029a-4bbe-426f-a8f8-ebe080d0a6fd None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:14.619927 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-02e3029a-4bbe-426f-a8f8-ebe080d0a6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:14.898072 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 872/1773] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:15.069684 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113098e2-e625-4fc9-aed3-8b4465354ef1 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:15.069966 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-113098e2-e625-4fc9-aed3-8b4465354ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:15.201509 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113098e2-e625-4fc9-aed3-8b4465354ef1 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:15.220722 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac798d9-594f-4287-af45-de47404d97eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:15.221402 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac798d9-594f-4287-af45-de47404d97eb service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:15.223281 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac798d9-594f-4287-af45-de47404d97eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:15.223701 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac798d9-594f-4287-af45-de47404d97eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:15.259707 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac798d9-594f-4287-af45-de47404d97eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:15.266260 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac798d9-594f-4287-af45-de47404d97eb service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:15.302718 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 902/1774] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:05:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:05:15.321737 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3029a-4bbe-426f-a8f8-ebe080d0a6fd None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:15.323560 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-02e3029a-4bbe-426f-a8f8-ebe080d0a6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:15.351897 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3029a-4bbe-426f-a8f8-ebe080d0a6fd None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:15.384216 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458888e2-eeda-433e-8491-b67e75137305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:15.385779 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458888e2-eeda-433e-8491-b67e75137305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:15.386251 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458888e2-eeda-433e-8491-b67e75137305 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:15.386735 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458888e2-eeda-433e-8491-b67e75137305 admin admin] PATH_INFO: `/v3/users/d7ff215cb4864653896569323a01662e` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:15.389240 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458888e2-eeda-433e-8491-b67e75137305 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7ff215cb4864653896569323a01662e)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:15.394773 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458888e2-eeda-433e-8491-b67e75137305 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:15.490531 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-458888e2-eeda-433e-8491-b67e75137305 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7ff215cb4864653896569323a01662e'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:15.491417 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-458888e2-eeda-433e-8491-b67e75137305 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7ff215cb4864653896569323a01662e'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:15.528396 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-458888e2-eeda-433e-8491-b67e75137305 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7ff215cb4864653896569323a01662e'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:15.532287 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-458888e2-eeda-433e-8491-b67e75137305 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7ff215cb4864653896569323a01662e'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:15.552733 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-458888e2-eeda-433e-8491-b67e75137305 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7ff215cb4864653896569323a01662e'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:15.578291 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 873/1775] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:05:15 2022] DELETE /identity/v3/users/d7ff215cb4864653896569323a01662e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:15.583345 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3c073-d596-4d61-9f7a-bd1f8aa12c70 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:15.583852 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3c073-d596-4d61-9f7a-bd1f8aa12c70 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:15.584277 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3c073-d596-4d61-9f7a-bd1f8aa12c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:15.617025 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-26a3c073-d596-4d61-9f7a-bd1f8aa12c70 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:15.618460 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-26a3c073-d596-4d61-9f7a-bd1f8aa12c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:15.725686 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 903/1776] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:05:15.745108 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458888e2-eeda-433e-8491-b67e75137305 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:15.750263 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-458888e2-eeda-433e-8491-b67e75137305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:15.782937 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3c073-d596-4d61-9f7a-bd1f8aa12c70 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:15.784797 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-26a3c073-d596-4d61-9f7a-bd1f8aa12c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:15.805794 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3c073-d596-4d61-9f7a-bd1f8aa12c70 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:15.830714 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc45a9-b20a-4f7b-8bfe-d8690c804c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:15.831858 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc45a9-b20a-4f7b-8bfe-d8690c804c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:15.832278 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc45a9-b20a-4f7b-8bfe-d8690c804c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:15.832672 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc45a9-b20a-4f7b-8bfe-d8690c804c33 admin admin] PATH_INFO: `/v3/projects/4462d77ae4ab4e42923a1428142ade24` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:15.835102 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc45a9-b20a-4f7b-8bfe-d8690c804c33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4462d77ae4ab4e42923a1428142ade24)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:15.837310 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc45a9-b20a-4f7b-8bfe-d8690c804c33 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:15.927948 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458888e2-eeda-433e-8491-b67e75137305 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:15.941644 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13ca7b-9025-4f9f-9c91-bb5d8d2d08d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:15.942546 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13ca7b-9025-4f9f-9c91-bb5d8d2d08d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:15.942986 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13ca7b-9025-4f9f-9c91-bb5d8d2d08d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:15.943399 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13ca7b-9025-4f9f-9c91-bb5d8d2d08d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:15.960853 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a13ca7b-9025-4f9f-9c91-bb5d8d2d08d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:15.969805 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a13ca7b-9025-4f9f-9c91-bb5d8d2d08d8 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:15.980133 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-b5fc45a9-b20a-4f7b-8bfe-d8690c804c33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4462d77ae4ab4e42923a1428142ade24', 'request_id': 'req-b5fc45a9-b20a-4f7b-8bfe-d8690c804c33'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:15.992062 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 874/1777] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:05:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:05:15.993652 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f2e0f-d847-4cdf-961e-22ddadb439ba None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:15.994199 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f2e0f-d847-4cdf-961e-22ddadb439ba None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:15.994638 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f2e0f-d847-4cdf-961e-22ddadb439ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:16.002388 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-b5fc45a9-b20a-4f7b-8bfe-d8690c804c33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4462d77ae4ab4e42923a1428142ade24', 'request_id': 'req-b5fc45a9-b20a-4f7b-8bfe-d8690c804c33'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:16.023565 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-b5fc45a9-b20a-4f7b-8bfe-d8690c804c33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4462d77ae4ab4e42923a1428142ade24', 'request_id': 'req-b5fc45a9-b20a-4f7b-8bfe-d8690c804c33'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:16.043708 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-b5fc45a9-b20a-4f7b-8bfe-d8690c804c33 admin admin] The token cache is being invalidate because project 4462d77ae4ab4e42923a1428142ade24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:05:16.044566 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-b5fc45a9-b20a-4f7b-8bfe-d8690c804c33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:16.048189 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-b5fc45a9-b20a-4f7b-8bfe-d8690c804c33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:16.052344 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-2d9f2e0f-d847-4cdf-961e-22ddadb439ba None None] MFA Rules not processed for user `4ded28c2ffe345ccbefde50585023857`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:16.053836 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-2d9f2e0f-d847-4cdf-961e-22ddadb439ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:16.054118 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 904/1778] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:05:15 2022] DELETE /identity/v3/projects/4462d77ae4ab4e42923a1428142ade24 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:16.058636 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc45a9-b20a-4f7b-8bfe-d8690c804c33 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:16.061405 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-b5fc45a9-b20a-4f7b-8bfe-d8690c804c33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:16.157473 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 875/1779] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:16.171162 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f2e0f-d847-4cdf-961e-22ddadb439ba None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:16.173449 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-2d9f2e0f-d847-4cdf-961e-22ddadb439ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:16.253960 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc45a9-b20a-4f7b-8bfe-d8690c804c33 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:16.267181 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337326e0-b01b-4475-87f3-d2f8ad9ff46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:16.268094 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337326e0-b01b-4475-87f3-d2f8ad9ff46c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:16.268535 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337326e0-b01b-4475-87f3-d2f8ad9ff46c admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:16.268949 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337326e0-b01b-4475-87f3-d2f8ad9ff46c admin admin] PATH_INFO: `/v3/users/2229317ad0ee4cddbcdd3dd057687d0f` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:16.271626 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337326e0-b01b-4475-87f3-d2f8ad9ff46c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2229317ad0ee4cddbcdd3dd057687d0f)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:16.273772 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337326e0-b01b-4475-87f3-d2f8ad9ff46c admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:16.317672 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f2e0f-d847-4cdf-961e-22ddadb439ba None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:16.326916 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5979844-3ed5-46f8-bfd5-e44645184725 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:16.328486 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5979844-3ed5-46f8-bfd5-e44645184725 service nova] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:16.328486 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5979844-3ed5-46f8-bfd5-e44645184725 service nova] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:16.328720 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5979844-3ed5-46f8-bfd5-e44645184725 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:16.341738 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5979844-3ed5-46f8-bfd5-e44645184725 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:16.344608 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5979844-3ed5-46f8-bfd5-e44645184725 service nova] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:16.363018 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 876/1780] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:05:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 03:05:16.382936 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-337326e0-b01b-4475-87f3-d2f8ad9ff46c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2229317ad0ee4cddbcdd3dd057687d0f'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:16.394272 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-337326e0-b01b-4475-87f3-d2f8ad9ff46c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2229317ad0ee4cddbcdd3dd057687d0f'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:16.395097 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-337326e0-b01b-4475-87f3-d2f8ad9ff46c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2229317ad0ee4cddbcdd3dd057687d0f'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:16.396010 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-337326e0-b01b-4475-87f3-d2f8ad9ff46c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2229317ad0ee4cddbcdd3dd057687d0f'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:16.414480 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-337326e0-b01b-4475-87f3-d2f8ad9ff46c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2229317ad0ee4cddbcdd3dd057687d0f'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:16.460414 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 905/1781] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:05:16 2022] DELETE /identity/v3/users/2229317ad0ee4cddbcdd3dd057687d0f => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:17.918424 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72280dc5-7b23-4ca2-8f28-de1712403be2 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:17.918985 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72280dc5-7b23-4ca2-8f28-de1712403be2 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:17.918985 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72280dc5-7b23-4ca2-8f28-de1712403be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:17.990273 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-72280dc5-7b23-4ca2-8f28-de1712403be2 None None] MFA Rules not processed for user `d452c4f1c0ac4646ac7869552de56b96`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:17.994782 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-72280dc5-7b23-4ca2-8f28-de1712403be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:18.200971 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 877/1782] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:18.228330 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337326e0-b01b-4475-87f3-d2f8ad9ff46c admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:18.230839 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-337326e0-b01b-4475-87f3-d2f8ad9ff46c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:18.416654 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72280dc5-7b23-4ca2-8f28-de1712403be2 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:18.419778 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-72280dc5-7b23-4ca2-8f28-de1712403be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:18.452149 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337326e0-b01b-4475-87f3-d2f8ad9ff46c admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:18.471020 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc7111-94f9-4cd9-90bf-b609345a19e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:18.471750 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc7111-94f9-4cd9-90bf-b609345a19e0 service nova] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:18.472303 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc7111-94f9-4cd9-90bf-b609345a19e0 service nova] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:18.472781 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc7111-94f9-4cd9-90bf-b609345a19e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:18.496817 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc7111-94f9-4cd9-90bf-b609345a19e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:18.502124 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc7111-94f9-4cd9-90bf-b609345a19e0 service nova] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:18.529237 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 906/1783] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:05:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:05:18.640241 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72280dc5-7b23-4ca2-8f28-de1712403be2 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:18.649417 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9eb73-90c7-47eb-8278-16258c73a15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:18.650514 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9eb73-90c7-47eb-8278-16258c73a15e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:18.650794 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9eb73-90c7-47eb-8278-16258c73a15e admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:18.651060 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9eb73-90c7-47eb-8278-16258c73a15e admin admin] PATH_INFO: `/v3/projects/77de0799001844b88282cd644df5c4d9` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:18.658401 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9eb73-90c7-47eb-8278-16258c73a15e admin admin] RBAC: Authorizing `identity:delete_project(project_id=77de0799001844b88282cd644df5c4d9)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:18.660140 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9eb73-90c7-47eb-8278-16258c73a15e admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:18.750623 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517c953-eb2c-421b-8982-cdf0d6780a37 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:18.750902 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517c953-eb2c-421b-8982-cdf0d6780a37 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:18.751457 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517c953-eb2c-421b-8982-cdf0d6780a37 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:18.753703 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 907/1784] 10.222.0.32 () {54 vars in 921 bytes} [Tue Apr 12 03:05:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 03:05:18.758618 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-37f9eb73-90c7-47eb-8278-16258c73a15e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77de0799001844b88282cd644df5c4d9', 'request_id': 'req-37f9eb73-90c7-47eb-8278-16258c73a15e'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:18.780800 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-37f9eb73-90c7-47eb-8278-16258c73a15e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77de0799001844b88282cd644df5c4d9', 'request_id': 'req-37f9eb73-90c7-47eb-8278-16258c73a15e'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:18.819585 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-37f9eb73-90c7-47eb-8278-16258c73a15e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77de0799001844b88282cd644df5c4d9', 'request_id': 'req-37f9eb73-90c7-47eb-8278-16258c73a15e'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:18.840199 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-37f9eb73-90c7-47eb-8278-16258c73a15e admin admin] The token cache is being invalidate because project 77de0799001844b88282cd644df5c4d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:05:18.840852 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-37f9eb73-90c7-47eb-8278-16258c73a15e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:18.841567 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-37f9eb73-90c7-47eb-8278-16258c73a15e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:18.843577 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 878/1785] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:05:18 2022] DELETE /identity/v3/projects/77de0799001844b88282cd644df5c4d9 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:05:18.847613 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517c953-eb2c-421b-8982-cdf0d6780a37 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:18.853683 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-b517c953-eb2c-421b-8982-cdf0d6780a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:18.857194 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1502f-2b57-4336-8e79-e01900c9125f None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:18.857417 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1502f-2b57-4336-8e79-e01900c9125f None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:18.859263 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1502f-2b57-4336-8e79-e01900c9125f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:18.939036 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-b2c1502f-2b57-4336-8e79-e01900c9125f None None] MFA Rules not processed for user `43ee5cb310fd4538910e40ea7082708c`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:18.941765 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-b2c1502f-2b57-4336-8e79-e01900c9125f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:19.136530 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517c953-eb2c-421b-8982-cdf0d6780a37 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:19.161780 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22094f83-437d-473e-b120-0b69c169c62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:19.162840 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22094f83-437d-473e-b120-0b69c169c62a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:19.163192 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22094f83-437d-473e-b120-0b69c169c62a admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:19.163532 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22094f83-437d-473e-b120-0b69c169c62a admin admin] PATH_INFO: `/v3/users/115bedfed3cf4e5d9751acee2becd985` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:19.167781 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 879/1786] 10.222.0.32 () {58 vars in 1018 bytes} [Tue Apr 12 03:05:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:19.168547 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22094f83-437d-473e-b120-0b69c169c62a admin admin] RBAC: Authorizing `identity:delete_user(user_id=115bedfed3cf4e5d9751acee2becd985)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:19.170551 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22094f83-437d-473e-b120-0b69c169c62a admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:19.273045 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-22094f83-437d-473e-b120-0b69c169c62a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '115bedfed3cf4e5d9751acee2becd985'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:19.280947 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-22094f83-437d-473e-b120-0b69c169c62a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '115bedfed3cf4e5d9751acee2becd985'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:19.281865 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-22094f83-437d-473e-b120-0b69c169c62a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '115bedfed3cf4e5d9751acee2becd985'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:19.282476 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-22094f83-437d-473e-b120-0b69c169c62a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '115bedfed3cf4e5d9751acee2becd985'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:19.296374 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-22094f83-437d-473e-b120-0b69c169c62a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '115bedfed3cf4e5d9751acee2becd985'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:19.320799 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 908/1787] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:05:18 2022] DELETE /identity/v3/users/115bedfed3cf4e5d9751acee2becd985 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:19.394139 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1502f-2b57-4336-8e79-e01900c9125f None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:19.396690 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-b2c1502f-2b57-4336-8e79-e01900c9125f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:19.445883 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1502f-2b57-4336-8e79-e01900c9125f None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:19.476303 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22094f83-437d-473e-b120-0b69c169c62a admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:19.478629 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-22094f83-437d-473e-b120-0b69c169c62a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:19.632089 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3852bd-0eba-4964-b462-e864daaaf7d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:19.634989 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3852bd-0eba-4964-b462-e864daaaf7d5 service nova] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:19.635322 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3852bd-0eba-4964-b462-e864daaaf7d5 service nova] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:19.635537 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3852bd-0eba-4964-b462-e864daaaf7d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:19.642146 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-eb3852bd-0eba-4964-b462-e864daaaf7d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:19.673615 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3852bd-0eba-4964-b462-e864daaaf7d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:19.675498 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3852bd-0eba-4964-b462-e864daaaf7d5 service nova] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:19.698451 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22094f83-437d-473e-b120-0b69c169c62a admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:19.703832 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 880/1788] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:05:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:05:19.715404 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd00300-1837-41d2-b128-b30079929a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:19.716703 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd00300-1837-41d2-b128-b30079929a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:19.717187 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd00300-1837-41d2-b128-b30079929a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:19.717625 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd00300-1837-41d2-b128-b30079929a8b admin admin] PATH_INFO: `/v3/projects/52401679c4584a20bd150bb341367b16` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:19.719033 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd00300-1837-41d2-b128-b30079929a8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=52401679c4584a20bd150bb341367b16)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:19.722332 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd00300-1837-41d2-b128-b30079929a8b admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:19.829801 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-acd00300-1837-41d2-b128-b30079929a8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52401679c4584a20bd150bb341367b16', 'request_id': 'req-acd00300-1837-41d2-b128-b30079929a8b'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:19.847897 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-acd00300-1837-41d2-b128-b30079929a8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52401679c4584a20bd150bb341367b16', 'request_id': 'req-acd00300-1837-41d2-b128-b30079929a8b'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:19.888183 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-acd00300-1837-41d2-b128-b30079929a8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52401679c4584a20bd150bb341367b16', 'request_id': 'req-acd00300-1837-41d2-b128-b30079929a8b'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:19.929842 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-acd00300-1837-41d2-b128-b30079929a8b admin admin] The token cache is being invalidate because project 52401679c4584a20bd150bb341367b16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:05:19.930380 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-acd00300-1837-41d2-b128-b30079929a8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:19.932473 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-acd00300-1837-41d2-b128-b30079929a8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:19.935518 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 909/1789] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:05:19 2022] DELETE /identity/v3/projects/52401679c4584a20bd150bb341367b16 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:19.939897 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3852bd-0eba-4964-b462-e864daaaf7d5 service nova] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:19.957396 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3852bd-0eba-4964-b462-e864daaaf7d5 service nova] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:19.971982 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22165430-3ce0-40db-b12f-978b9612de31 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:19.972518 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22165430-3ce0-40db-b12f-978b9612de31 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:19.972890 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22165430-3ce0-40db-b12f-978b9612de31 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:19.984898 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 910/1790] 10.222.0.32 () {54 vars in 921 bytes} [Tue Apr 12 03:05:19 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 03:05:20.125665 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d13de6-aa27-4ad8-9aea-ab91d214c57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:20.126060 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c06e0-3753-4799-bf5d-1199af05017a None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:20.126643 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c06e0-3753-4799-bf5d-1199af05017a None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:20.126761 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d13de6-aa27-4ad8-9aea-ab91d214c57f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:20.126977 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d13de6-aa27-4ad8-9aea-ab91d214c57f admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:20.127230 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d13de6-aa27-4ad8-9aea-ab91d214c57f admin admin] PATH_INFO: `/v3/users/9f019b3fcec9428fbb32a55bd5576caf` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:20.127677 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c06e0-3753-4799-bf5d-1199af05017a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:20.128438 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d13de6-aa27-4ad8-9aea-ab91d214c57f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f019b3fcec9428fbb32a55bd5576caf)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:20.131618 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d13de6-aa27-4ad8-9aea-ab91d214c57f admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:20.179586 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-562c06e0-3753-4799-bf5d-1199af05017a None None] MFA Rules not processed for user `43ee5cb310fd4538910e40ea7082708c`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:20.185227 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-562c06e0-3753-4799-bf5d-1199af05017a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:20.240523 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-c5d13de6-aa27-4ad8-9aea-ab91d214c57f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f019b3fcec9428fbb32a55bd5576caf'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:20.242685 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-c5d13de6-aa27-4ad8-9aea-ab91d214c57f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f019b3fcec9428fbb32a55bd5576caf'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:20.273767 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-c5d13de6-aa27-4ad8-9aea-ab91d214c57f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f019b3fcec9428fbb32a55bd5576caf'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:20.277744 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-c5d13de6-aa27-4ad8-9aea-ab91d214c57f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f019b3fcec9428fbb32a55bd5576caf'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:20.300126 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-c5d13de6-aa27-4ad8-9aea-ab91d214c57f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f019b3fcec9428fbb32a55bd5576caf'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:20.320692 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 911/1791] 10.222.0.32 () {58 vars in 1018 bytes} [Tue Apr 12 03:05:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:05:20.323116 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c06e0-3753-4799-bf5d-1199af05017a None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:20.326324 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-562c06e0-3753-4799-bf5d-1199af05017a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:20.328741 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 881/1792] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:05:19 2022] DELETE /identity/v3/users/9f019b3fcec9428fbb32a55bd5576caf => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:20.347076 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c06e0-3753-4799-bf5d-1199af05017a None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:20.423331 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707f5e1-c907-48a9-a191-a655033a64ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:20.424478 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707f5e1-c907-48a9-a191-a655033a64ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:20.424825 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707f5e1-c907-48a9-a191-a655033a64ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:20.425158 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707f5e1-c907-48a9-a191-a655033a64ce admin admin] PATH_INFO: `/v3/projects/9279e4ae388f4a7799903715c27ffb6d` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:20.426490 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707f5e1-c907-48a9-a191-a655033a64ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=9279e4ae388f4a7799903715c27ffb6d)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:20.428728 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707f5e1-c907-48a9-a191-a655033a64ce admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:20.488630 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-6707f5e1-c907-48a9-a191-a655033a64ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9279e4ae388f4a7799903715c27ffb6d', 'request_id': 'req-6707f5e1-c907-48a9-a191-a655033a64ce'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:20.503382 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-6707f5e1-c907-48a9-a191-a655033a64ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9279e4ae388f4a7799903715c27ffb6d', 'request_id': 'req-6707f5e1-c907-48a9-a191-a655033a64ce'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:20.514075 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-6707f5e1-c907-48a9-a191-a655033a64ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9279e4ae388f4a7799903715c27ffb6d', 'request_id': 'req-6707f5e1-c907-48a9-a191-a655033a64ce'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:20.540005 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d13de6-aa27-4ad8-9aea-ab91d214c57f admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:20.540214 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-6707f5e1-c907-48a9-a191-a655033a64ce admin admin] The token cache is being invalidate because project 9279e4ae388f4a7799903715c27ffb6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:05:20.540417 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-6707f5e1-c907-48a9-a191-a655033a64ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:20.542380 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-6707f5e1-c907-48a9-a191-a655033a64ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:20.542746 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-c5d13de6-aa27-4ad8-9aea-ab91d214c57f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:20.548190 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 912/1793] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:05:20 2022] DELETE /identity/v3/projects/9279e4ae388f4a7799903715c27ffb6d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:20.550042 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4cda3-f362-4987-a3cd-8046e6212edb None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:20.550374 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4cda3-f362-4987-a3cd-8046e6212edb None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:20.550652 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4cda3-f362-4987-a3cd-8046e6212edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:20.588372 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-e5c4cda3-f362-4987-a3cd-8046e6212edb None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:20.589742 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-e5c4cda3-f362-4987-a3cd-8046e6212edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:20.702043 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 913/1794] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:05:20.709010 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ce5ed-a399-4d4d-aa7c-12fc16b5f503 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:20.709370 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ce5ed-a399-4d4d-aa7c-12fc16b5f503 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:20.709577 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ce5ed-a399-4d4d-aa7c-12fc16b5f503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:20.725851 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d13de6-aa27-4ad8-9aea-ab91d214c57f admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:20.758786 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-879ce5ed-a399-4d4d-aa7c-12fc16b5f503 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:20.763773 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-879ce5ed-a399-4d4d-aa7c-12fc16b5f503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:20.785992 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 914/1795] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:20.790823 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ce5ed-a399-4d4d-aa7c-12fc16b5f503 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:20.827453 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ce5ed-a399-4d4d-aa7c-12fc16b5f503 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:20.842400 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a2fe8-48f6-4658-abbd-632841805adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:20.844227 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a2fe8-48f6-4658-abbd-632841805adc admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:20.845449 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a2fe8-48f6-4658-abbd-632841805adc admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:20.845771 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a2fe8-48f6-4658-abbd-632841805adc admin admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:20.849558 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a2fe8-48f6-4658-abbd-632841805adc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:05:20.849818 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a2fe8-48f6-4658-abbd-632841805adc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:20.854252 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a2fe8-48f6-4658-abbd-632841805adc admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:20.881895 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 915/1796] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 03:05:20.886618 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a2fe8-48f6-4658-abbd-632841805adc admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:20.895304 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a957bfd-108e-4bfe-85d2-ee2f195d62d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:20.896046 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a957bfd-108e-4bfe-85d2-ee2f195d62d5 service nova] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:20.896584 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a957bfd-108e-4bfe-85d2-ee2f195d62d5 service nova] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:20.896855 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a957bfd-108e-4bfe-85d2-ee2f195d62d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:20.899127 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-5a957bfd-108e-4bfe-85d2-ee2f195d62d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:20.912739 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a957bfd-108e-4bfe-85d2-ee2f195d62d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:20.913020 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a2fe8-48f6-4658-abbd-632841805adc admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:20.914428 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a957bfd-108e-4bfe-85d2-ee2f195d62d5 service nova] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:20.928453 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1f9ea-ce64-4ffb-aebe-b79c41461d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:20.930974 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1f9ea-ce64-4ffb-aebe-b79c41461d05 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:20.931370 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1f9ea-ce64-4ffb-aebe-b79c41461d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:20.933594 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1f9ea-ce64-4ffb-aebe-b79c41461d05 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:20.934333 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1f9ea-ce64-4ffb-aebe-b79c41461d05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:20.939087 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1f9ea-ce64-4ffb-aebe-b79c41461d05 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:20.947459 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 882/1797] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:05:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:05:21.006389 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 916/1798] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:05:20 2022] POST /identity/v3/projects => generated 399 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:21.008136 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a957bfd-108e-4bfe-85d2-ee2f195d62d5 service nova] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:21.031981 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a957bfd-108e-4bfe-85d2-ee2f195d62d5 service nova] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:21.140480 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52b5ae-4d04-40a5-b5a6-dbaa36edc19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:21.143842 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52b5ae-4d04-40a5-b5a6-dbaa36edc19a admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:21.144110 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52b5ae-4d04-40a5-b5a6-dbaa36edc19a admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:21.144471 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52b5ae-4d04-40a5-b5a6-dbaa36edc19a admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:21.145861 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52b5ae-4d04-40a5-b5a6-dbaa36edc19a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:21.153361 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52b5ae-4d04-40a5-b5a6-dbaa36edc19a admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:21.220254 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 883/1799] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:05:21 2022] POST /identity/v3/users => generated 300 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:21.224664 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1f9ea-ce64-4ffb-aebe-b79c41461d05 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:21.239596 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1f9ea-ce64-4ffb-aebe-b79c41461d05 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:21.245110 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db6b98-1c5c-4b8c-a7e8-70cbbb51358c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:21.245850 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db6b98-1c5c-4b8c-a7e8-70cbbb51358c admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:21.246127 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db6b98-1c5c-4b8c-a7e8-70cbbb51358c admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:21.246399 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db6b98-1c5c-4b8c-a7e8-70cbbb51358c admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:21.247686 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db6b98-1c5c-4b8c-a7e8-70cbbb51358c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:21.249660 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db6b98-1c5c-4b8c-a7e8-70cbbb51358c admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:21.276868 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 917/1800] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:05:21.281106 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52b5ae-4d04-40a5-b5a6-dbaa36edc19a admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:21.301288 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52b5ae-4d04-40a5-b5a6-dbaa36edc19a admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:21.316288 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5f51a-73f2-4f77-ac13-c7d45323c979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:21.317329 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5f51a-73f2-4f77-ac13-c7d45323c979 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:21.317825 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5f51a-73f2-4f77-ac13-c7d45323c979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:21.318289 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5f51a-73f2-4f77-ac13-c7d45323c979 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:21.319212 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5f51a-73f2-4f77-ac13-c7d45323c979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:21.321279 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5f51a-73f2-4f77-ac13-c7d45323c979 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:21.350369 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 884/1801] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:21.352097 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db6b98-1c5c-4b8c-a7e8-70cbbb51358c admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:21.368367 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db6b98-1c5c-4b8c-a7e8-70cbbb51358c admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:21.378822 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a974fd1-f019-4467-a3b5-7fc6ecaf519c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:21.380162 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a974fd1-f019-4467-a3b5-7fc6ecaf519c admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:21.380635 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a974fd1-f019-4467-a3b5-7fc6ecaf519c admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:21.381096 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a974fd1-f019-4467-a3b5-7fc6ecaf519c admin admin] PATH_INFO: `/v3/projects/e8752912a4b34d46be2855333bb82142/users/c2a76b57a1f94bbcbc8b24debc0674db/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:21.415455 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a974fd1-f019-4467-a3b5-7fc6ecaf519c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8752912a4b34d46be2855333bb82142, user_id=c2a76b57a1f94bbcbc8b24debc0674db, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:21.418764 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a974fd1-f019-4467-a3b5-7fc6ecaf519c admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:21.447863 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 918/1802] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:05:21 2022] PUT /identity/v3/projects/e8752912a4b34d46be2855333bb82142/users/c2a76b57a1f94bbcbc8b24debc0674db/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:05:21.451756 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add20ca9-0ad3-437f-906d-b422f059e17f None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:21.452048 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add20ca9-0ad3-437f-906d-b422f059e17f None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:21.452320 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add20ca9-0ad3-437f-906d-b422f059e17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:21.492306 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-add20ca9-0ad3-437f-906d-b422f059e17f None None] MFA Rules not processed for user `c2a76b57a1f94bbcbc8b24debc0674db`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:21.494096 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-add20ca9-0ad3-437f-906d-b422f059e17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:21.712698 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 885/1803] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:21.717388 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a974fd1-f019-4467-a3b5-7fc6ecaf519c admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:21.731411 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add20ca9-0ad3-437f-906d-b422f059e17f None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:21.735497 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-add20ca9-0ad3-437f-906d-b422f059e17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:21.857698 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a974fd1-f019-4467-a3b5-7fc6ecaf519c admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:21.869650 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d63235-0150-4922-acfc-29bfef1bf107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:21.871506 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d63235-0150-4922-acfc-29bfef1bf107 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:21.871818 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d63235-0150-4922-acfc-29bfef1bf107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:21.872098 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d63235-0150-4922-acfc-29bfef1bf107 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:21.872795 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d63235-0150-4922-acfc-29bfef1bf107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:21.878098 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d63235-0150-4922-acfc-29bfef1bf107 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:21.892442 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add20ca9-0ad3-437f-906d-b422f059e17f None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:21.905185 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e28794-9091-422e-a968-e741b27106d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:21.905982 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e28794-9091-422e-a968-e741b27106d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:21.906305 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e28794-9091-422e-a968-e741b27106d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:21.906585 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e28794-9091-422e-a968-e741b27106d5 admin admin] PATH_INFO: `/v3/projects/b5e1c5f983e04c84a3623f89c2c781fd` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:21.909043 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e28794-9091-422e-a968-e741b27106d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5e1c5f983e04c84a3623f89c2c781fd)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:21.912454 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e28794-9091-422e-a968-e741b27106d5 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:21.935701 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 919/1804] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:05:21 2022] POST /identity/v3/projects => generated 399 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:21.938575 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d63235-0150-4922-acfc-29bfef1bf107 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:22.036475 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-06e28794-9091-422e-a968-e741b27106d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5e1c5f983e04c84a3623f89c2c781fd', 'request_id': 'req-06e28794-9091-422e-a968-e741b27106d5'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:22.049547 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-06e28794-9091-422e-a968-e741b27106d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5e1c5f983e04c84a3623f89c2c781fd', 'request_id': 'req-06e28794-9091-422e-a968-e741b27106d5'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:22.060214 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-06e28794-9091-422e-a968-e741b27106d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5e1c5f983e04c84a3623f89c2c781fd', 'request_id': 'req-06e28794-9091-422e-a968-e741b27106d5'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:22.084326 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-06e28794-9091-422e-a968-e741b27106d5 admin admin] The token cache is being invalidate because project b5e1c5f983e04c84a3623f89c2c781fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:05:22.085669 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-06e28794-9091-422e-a968-e741b27106d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:22.087629 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-06e28794-9091-422e-a968-e741b27106d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:22.089551 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d63235-0150-4922-acfc-29bfef1bf107 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:22.092829 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 886/1805] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:05:21 2022] DELETE /identity/v3/projects/b5e1c5f983e04c84a3623f89c2c781fd => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:22.097806 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11f801-864c-44f7-b6e9-57755471687c None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:22.098160 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11f801-864c-44f7-b6e9-57755471687c None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:22.098483 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11f801-864c-44f7-b6e9-57755471687c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:22.141687 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-0f11f801-864c-44f7-b6e9-57755471687c None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:22.143168 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-0f11f801-864c-44f7-b6e9-57755471687c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:22.230088 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ce9b5-0769-48e0-b973-0f662395d6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:22.230793 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ce9b5-0769-48e0-b973-0f662395d6c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:22.231070 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ce9b5-0769-48e0-b973-0f662395d6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:22.231344 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ce9b5-0769-48e0-b973-0f662395d6c3 admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:22.232082 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ce9b5-0769-48e0-b973-0f662395d6c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:22.234837 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ce9b5-0769-48e0-b973-0f662395d6c3 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:22.302141 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 920/1806] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:05:21 2022] POST /identity/v3/users => generated 306 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:22.303181 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ce9b5-0769-48e0-b973-0f662395d6c3 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:22.311418 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-2c2ce9b5-0769-48e0-b973-0f662395d6c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:22.315703 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 887/1807] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:05:22.316757 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11f801-864c-44f7-b6e9-57755471687c None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:22.319532 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-0f11f801-864c-44f7-b6e9-57755471687c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:22.337098 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11f801-864c-44f7-b6e9-57755471687c None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:22.347449 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ce9b5-0769-48e0-b973-0f662395d6c3 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:22.353081 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71150f5-2a1e-4060-805a-814702886254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:22.354014 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71150f5-2a1e-4060-805a-814702886254 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:22.354456 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71150f5-2a1e-4060-805a-814702886254 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:22.354722 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71150f5-2a1e-4060-805a-814702886254 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:22.355458 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71150f5-2a1e-4060-805a-814702886254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:22.363352 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b20ec-2545-4c02-829a-33bd1a65befd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:22.364016 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b20ec-2545-4c02-829a-33bd1a65befd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:22.365243 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b20ec-2545-4c02-829a-33bd1a65befd admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:22.365596 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b20ec-2545-4c02-829a-33bd1a65befd admin admin] PATH_INFO: `/v3/projects/aa644a9718ec4bc6bdd7aec799402b2e` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:22.367871 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b20ec-2545-4c02-829a-33bd1a65befd admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa644a9718ec4bc6bdd7aec799402b2e)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:22.369187 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71150f5-2a1e-4060-805a-814702886254 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:22.382567 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b20ec-2545-4c02-829a-33bd1a65befd admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:22.386740 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 888/1808] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:22.388247 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825b32a-746d-4835-95de-b89e8a9040fd None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:22.388530 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825b32a-746d-4835-95de-b89e8a9040fd None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:22.388802 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825b32a-746d-4835-95de-b89e8a9040fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:22.408181 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-9825b32a-746d-4835-95de-b89e8a9040fd None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:22.409387 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-9825b32a-746d-4835-95de-b89e8a9040fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:22.421542 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 889/1809] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:22.422537 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825b32a-746d-4835-95de-b89e8a9040fd None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:22.439012 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825b32a-746d-4835-95de-b89e8a9040fd None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:22.445478 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c220a-508c-4164-8caa-ca8fceecbc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:22.446561 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c220a-508c-4164-8caa-ca8fceecbc28 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:22.446802 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c220a-508c-4164-8caa-ca8fceecbc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:22.447220 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c220a-508c-4164-8caa-ca8fceecbc28 admin admin] PATH_INFO: `/v3/projects/5eb7e8d0972a42d0b57006f2db182038/users/df3e65797a174210a778b75fe6e9280d/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:22.483845 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c220a-508c-4164-8caa-ca8fceecbc28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eb7e8d0972a42d0b57006f2db182038, user_id=df3e65797a174210a778b75fe6e9280d, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:22.487615 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-1e7b20ec-2545-4c02-829a-33bd1a65befd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa644a9718ec4bc6bdd7aec799402b2e', 'request_id': 'req-1e7b20ec-2545-4c02-829a-33bd1a65befd'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:22.492595 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c220a-508c-4164-8caa-ca8fceecbc28 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:22.503118 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-1e7b20ec-2545-4c02-829a-33bd1a65befd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa644a9718ec4bc6bdd7aec799402b2e', 'request_id': 'req-1e7b20ec-2545-4c02-829a-33bd1a65befd'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:22.519924 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-1e7b20ec-2545-4c02-829a-33bd1a65befd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa644a9718ec4bc6bdd7aec799402b2e', 'request_id': 'req-1e7b20ec-2545-4c02-829a-33bd1a65befd'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:22.525231 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 890/1810] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:05:22 2022] PUT /identity/v3/projects/5eb7e8d0972a42d0b57006f2db182038/users/df3e65797a174210a778b75fe6e9280d/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:22.530122 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c220a-508c-4164-8caa-ca8fceecbc28 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:22.552898 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-1e7b20ec-2545-4c02-829a-33bd1a65befd admin admin] The token cache is being invalidate because project aa644a9718ec4bc6bdd7aec799402b2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:05:22.553564 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-1e7b20ec-2545-4c02-829a-33bd1a65befd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:22.554826 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-1e7b20ec-2545-4c02-829a-33bd1a65befd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:22.557603 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 921/1811] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:05:22 2022] DELETE /identity/v3/projects/aa644a9718ec4bc6bdd7aec799402b2e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:22.558680 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b20ec-2545-4c02-829a-33bd1a65befd admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:22.560534 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-1e7b20ec-2545-4c02-829a-33bd1a65befd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:22.613390 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c220a-508c-4164-8caa-ca8fceecbc28 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:22.623966 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfebec8-d8ac-42fe-ad94-e3ae5e9ddd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:22.625234 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfebec8-d8ac-42fe-ad94-e3ae5e9ddd53 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:22.626696 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfebec8-d8ac-42fe-ad94-e3ae5e9ddd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:22.627099 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfebec8-d8ac-42fe-ad94-e3ae5e9ddd53 admin admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:22.629028 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfebec8-d8ac-42fe-ad94-e3ae5e9ddd53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:05:22.629345 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfebec8-d8ac-42fe-ad94-e3ae5e9ddd53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:22.633757 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfebec8-d8ac-42fe-ad94-e3ae5e9ddd53 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:22.667508 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 891/1812] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:05:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:05:22.669166 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29ba5d-5849-4011-815a-6a868fd94de0 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:22.669455 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29ba5d-5849-4011-815a-6a868fd94de0 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:22.669727 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29ba5d-5849-4011-815a-6a868fd94de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:22.693278 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b20ec-2545-4c02-829a-33bd1a65befd admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:22.700837 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f520dd2-6df2-4dd8-91f7-1cab80748f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:22.701940 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f520dd2-6df2-4dd8-91f7-1cab80748f1c admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:22.702431 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f520dd2-6df2-4dd8-91f7-1cab80748f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:22.704297 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f520dd2-6df2-4dd8-91f7-1cab80748f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:22.705364 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f520dd2-6df2-4dd8-91f7-1cab80748f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:22.707989 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f520dd2-6df2-4dd8-91f7-1cab80748f1c admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:22.716407 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-4d29ba5d-5849-4011-815a-6a868fd94de0 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:22.717815 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-4d29ba5d-5849-4011-815a-6a868fd94de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:22.733253 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 922/1813] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:22.734118 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f520dd2-6df2-4dd8-91f7-1cab80748f1c admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:22.746892 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 892/1814] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:22.746892 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29ba5d-5849-4011-815a-6a868fd94de0 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:22.747088 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-7f520dd2-6df2-4dd8-91f7-1cab80748f1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:22.754561 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29ba5d-5849-4011-815a-6a868fd94de0 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:22.760226 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d009a3-fa5f-4720-b5c6-ea4e6e6f1dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:22.761151 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d009a3-fa5f-4720-b5c6-ea4e6e6f1dc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:22.761559 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d009a3-fa5f-4720-b5c6-ea4e6e6f1dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:22.761839 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d009a3-fa5f-4720-b5c6-ea4e6e6f1dc3 admin admin] PATH_INFO: `/v3/projects/5eb7e8d0972a42d0b57006f2db182038/users/df3e65797a174210a778b75fe6e9280d/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:22.764369 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d009a3-fa5f-4720-b5c6-ea4e6e6f1dc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eb7e8d0972a42d0b57006f2db182038, user_id=df3e65797a174210a778b75fe6e9280d, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:22.768280 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d009a3-fa5f-4720-b5c6-ea4e6e6f1dc3 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:22.774380 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f520dd2-6df2-4dd8-91f7-1cab80748f1c admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:22.801535 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 893/1815] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:05:22 2022] PUT /identity/v3/projects/5eb7e8d0972a42d0b57006f2db182038/users/df3e65797a174210a778b75fe6e9280d/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:22.803841 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ba78b-fc02-4bf1-808c-862c5d503ab0 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:22.804127 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ba78b-fc02-4bf1-808c-862c5d503ab0 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:22.804397 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ba78b-fc02-4bf1-808c-862c5d503ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:22.849542 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-1c3ba78b-fc02-4bf1-808c-862c5d503ab0 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:22.852014 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-1c3ba78b-fc02-4bf1-808c-862c5d503ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:22.925762 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe2d95-6a76-437f-ab6a-a69c7951c74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:22.926712 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe2d95-6a76-437f-ab6a-a69c7951c74b admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:22.927175 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe2d95-6a76-437f-ab6a-a69c7951c74b admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:22.927576 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe2d95-6a76-437f-ab6a-a69c7951c74b admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:22.929116 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe2d95-6a76-437f-ab6a-a69c7951c74b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:22.931182 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe2d95-6a76-437f-ab6a-a69c7951c74b admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:22.939419 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 894/1816] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:22.939419 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02032395-3c28-4c31-975a-df8b3afa27a7 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:22.939419 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02032395-3c28-4c31-975a-df8b3afa27a7 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:22.939419 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02032395-3c28-4c31-975a-df8b3afa27a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:22.972402 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-02032395-3c28-4c31-975a-df8b3afa27a7 None None] MFA Rules not processed for user `df3e65797a174210a778b75fe6e9280d`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:22.973844 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-02032395-3c28-4c31-975a-df8b3afa27a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:22.995284 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 923/1817] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:05:22 2022] POST /identity/v3/projects => generated 373 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:22.997202 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe2d95-6a76-437f-ab6a-a69c7951c74b admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:23.070372 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 895/1818] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:22 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:23.070372 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02032395-3c28-4c31-975a-df8b3afa27a7 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:23.085684 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe2d95-6a76-437f-ab6a-a69c7951c74b admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:23.090870 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02032395-3c28-4c31-975a-df8b3afa27a7 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:23.093929 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df249ce5-c751-46a5-9fd9-c9a268aa83d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:23.094849 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df249ce5-c751-46a5-9fd9-c9a268aa83d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:23.095435 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df249ce5-c751-46a5-9fd9-c9a268aa83d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:23.095898 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df249ce5-c751-46a5-9fd9-c9a268aa83d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:23.098140 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df249ce5-c751-46a5-9fd9-c9a268aa83d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:05:23.098590 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df249ce5-c751-46a5-9fd9-c9a268aa83d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:23.101064 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c11cf-d3be-4dae-8c92-ee7151ffb74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:23.101768 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c11cf-d3be-4dae-8c92-ee7151ffb74a admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:23.102049 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c11cf-d3be-4dae-8c92-ee7151ffb74a admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:23.102357 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c11cf-d3be-4dae-8c92-ee7151ffb74a admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:23.103082 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c11cf-d3be-4dae-8c92-ee7151ffb74a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:23.103246 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df249ce5-c751-46a5-9fd9-c9a268aa83d4 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:23.114538 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c11cf-d3be-4dae-8c92-ee7151ffb74a admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:23.149378 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 896/1819] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:05:23 2022] POST /identity/v3/users => generated 287 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:23.151600 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c11cf-d3be-4dae-8c92-ee7151ffb74a admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:23.169047 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-0a0c11cf-d3be-4dae-8c92-ee7151ffb74a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:23.189467 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 924/1820] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:05:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:05:23.195361 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df249ce5-c751-46a5-9fd9-c9a268aa83d4 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:23.237207 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df249ce5-c751-46a5-9fd9-c9a268aa83d4 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:23.266587 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec884d-6940-47dd-bba5-52f5927acdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:23.267827 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec884d-6940-47dd-bba5-52f5927acdf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:23.267827 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec884d-6940-47dd-bba5-52f5927acdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:23.268361 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec884d-6940-47dd-bba5-52f5927acdf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:23.269218 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ec884d-6940-47dd-bba5-52f5927acdf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:23.271393 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ec884d-6940-47dd-bba5-52f5927acdf0 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:23.287456 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 925/1821] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:23.292919 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec884d-6940-47dd-bba5-52f5927acdf0 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:23.297347 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c11cf-d3be-4dae-8c92-ee7151ffb74a admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:23.302827 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d629b9-09c6-4f3a-854b-fae116a8b4ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:23.303558 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d629b9-09c6-4f3a-854b-fae116a8b4ed service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:23.303673 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d629b9-09c6-4f3a-854b-fae116a8b4ed service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:23.304009 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d629b9-09c6-4f3a-854b-fae116a8b4ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:23.305510 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec884d-6940-47dd-bba5-52f5927acdf0 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:23.312740 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f08107-8260-4642-9e79-e9bbd3b08646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:23.313508 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f08107-8260-4642-9e79-e9bbd3b08646 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:23.314767 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f08107-8260-4642-9e79-e9bbd3b08646 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:23.314767 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f08107-8260-4642-9e79-e9bbd3b08646 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:23.315128 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f08107-8260-4642-9e79-e9bbd3b08646 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:23.318379 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f08107-8260-4642-9e79-e9bbd3b08646 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:23.361920 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 926/1822] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:05:23 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:23.366873 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f08107-8260-4642-9e79-e9bbd3b08646 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:23.505922 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d629b9-09c6-4f3a-854b-fae116a8b4ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:23.514494 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d629b9-09c6-4f3a-854b-fae116a8b4ed service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:23.526298 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f08107-8260-4642-9e79-e9bbd3b08646 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:23.546680 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f2594-b690-4446-9f65-9b2532672fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:23.547498 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f2594-b690-4446-9f65-9b2532672fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:23.547931 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f2594-b690-4446-9f65-9b2532672fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:23.548873 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f2594-b690-4446-9f65-9b2532672fb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:23.551889 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f2594-b690-4446-9f65-9b2532672fb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:23.555018 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f2594-b690-4446-9f65-9b2532672fb0 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:23.560287 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 897/1823] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:05:23 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:05:23.561460 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d629b9-09c6-4f3a-854b-fae116a8b4ed service cinder] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:23.573234 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d629b9-09c6-4f3a-854b-fae116a8b4ed service cinder] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:23.580162 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c9d9d-eda8-4583-884f-ec92d354df07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:23.581346 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c9d9d-eda8-4583-884f-ec92d354df07 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:23.581963 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c9d9d-eda8-4583-884f-ec92d354df07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:23.582367 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c9d9d-eda8-4583-884f-ec92d354df07 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:23.583321 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c9d9d-eda8-4583-884f-ec92d354df07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:23.585782 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c9d9d-eda8-4583-884f-ec92d354df07 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:23.592952 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 927/1824] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:23.601473 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f2594-b690-4446-9f65-9b2532672fb0 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:23.629481 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 898/1825] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:05:23 2022] POST /identity/v3/users => generated 293 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:23.636468 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c9d9d-eda8-4583-884f-ec92d354df07 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:23.654346 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c9d9d-eda8-4583-884f-ec92d354df07 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:23.656708 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f2594-b690-4446-9f65-9b2532672fb0 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:23.662655 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa158a18-30ac-4c6d-ac97-e84563351005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:23.663677 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa158a18-30ac-4c6d-ac97-e84563351005 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:23.663927 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa158a18-30ac-4c6d-ac97-e84563351005 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:23.664192 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa158a18-30ac-4c6d-ac97-e84563351005 admin admin] PATH_INFO: `/v3/projects/350d413574414300ae9cb2a4086e518e/users/43a69366717d47dc98aaf131b53de9da/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:23.671905 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d35443-4c1b-4632-9af3-35de6f711026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:23.672814 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d35443-4c1b-4632-9af3-35de6f711026 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:23.674249 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d35443-4c1b-4632-9af3-35de6f711026 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:23.675592 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d35443-4c1b-4632-9af3-35de6f711026 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:23.678611 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d35443-4c1b-4632-9af3-35de6f711026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:23.680644 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d35443-4c1b-4632-9af3-35de6f711026 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:23.687101 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa158a18-30ac-4c6d-ac97-e84563351005 admin admin] RBAC: Authorizing `identity:create_grant(project_id=350d413574414300ae9cb2a4086e518e, user_id=43a69366717d47dc98aaf131b53de9da, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:23.689828 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa158a18-30ac-4c6d-ac97-e84563351005 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:23.709126 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 899/1826] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:23.712322 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d35443-4c1b-4632-9af3-35de6f711026 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:23.726585 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 928/1827] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:05:23 2022] PUT /identity/v3/projects/350d413574414300ae9cb2a4086e518e/users/43a69366717d47dc98aaf131b53de9da/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:23.728194 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa158a18-30ac-4c6d-ac97-e84563351005 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:23.823508 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d35443-4c1b-4632-9af3-35de6f711026 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:23.833295 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa158a18-30ac-4c6d-ac97-e84563351005 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:23.848417 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0481be7-3417-46cc-b911-2a33223b0e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:23.850692 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0481be7-3417-46cc-b911-2a33223b0e0e admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:23.850692 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0481be7-3417-46cc-b911-2a33223b0e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:23.850692 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0481be7-3417-46cc-b911-2a33223b0e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:23.853503 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0481be7-3417-46cc-b911-2a33223b0e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:23.856035 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0481be7-3417-46cc-b911-2a33223b0e0e admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:23.884599 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 929/1828] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:23.886331 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a525abf-6076-45dd-b77c-c68e485e2c97 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:23.886819 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a525abf-6076-45dd-b77c-c68e485e2c97 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:23.888669 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a525abf-6076-45dd-b77c-c68e485e2c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:23.941398 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8496954-bc2f-4b3c-939e-e96b2139fcb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:23.942173 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8496954-bc2f-4b3c-939e-e96b2139fcb5 service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:23.942545 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8496954-bc2f-4b3c-939e-e96b2139fcb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:23.944346 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8496954-bc2f-4b3c-939e-e96b2139fcb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:23.947742 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-b8496954-bc2f-4b3c-939e-e96b2139fcb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:23.951146 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-0a525abf-6076-45dd-b77c-c68e485e2c97 None None] MFA Rules not processed for user `43a69366717d47dc98aaf131b53de9da`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:23.953485 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-0a525abf-6076-45dd-b77c-c68e485e2c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:24.080273 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8496954-bc2f-4b3c-939e-e96b2139fcb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:24.082679 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8496954-bc2f-4b3c-939e-e96b2139fcb5 service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:24.094928 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 900/1829] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:05:23 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:05:24.096009 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8496954-bc2f-4b3c-939e-e96b2139fcb5 service cinder] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:24.110968 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 930/1830] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:24.116679 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8496954-bc2f-4b3c-939e-e96b2139fcb5 service cinder] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:24.116904 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a525abf-6076-45dd-b77c-c68e485e2c97 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:24.130134 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2010a-d1d3-4164-b00c-9ea13cd0c0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:24.131181 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2010a-d1d3-4164-b00c-9ea13cd0c0ce admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:24.132585 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2010a-d1d3-4164-b00c-9ea13cd0c0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:24.132965 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2010a-d1d3-4164-b00c-9ea13cd0c0ce admin admin] PATH_INFO: `/v3/projects/21b2a4b743c747939de825d7c3282b6a/users/bf02398302074e25b74218fa186e7f51/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:24.134121 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a525abf-6076-45dd-b77c-c68e485e2c97 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:24.147192 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a45ec-e6c8-4f8f-846c-2a44cc85adab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:24.148013 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a45ec-e6c8-4f8f-846c-2a44cc85adab admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:24.148428 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a45ec-e6c8-4f8f-846c-2a44cc85adab admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:24.148915 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a45ec-e6c8-4f8f-846c-2a44cc85adab admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:24.149816 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a45ec-e6c8-4f8f-846c-2a44cc85adab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:24.151940 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a45ec-e6c8-4f8f-846c-2a44cc85adab admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:24.168699 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f2010a-d1d3-4164-b00c-9ea13cd0c0ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=21b2a4b743c747939de825d7c3282b6a, user_id=bf02398302074e25b74218fa186e7f51, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:24.174149 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f2010a-d1d3-4164-b00c-9ea13cd0c0ce admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:24.208323 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 901/1831] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:05:24 2022] PUT /identity/v3/projects/21b2a4b743c747939de825d7c3282b6a/users/bf02398302074e25b74218fa186e7f51/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:24.220464 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b77b6d-9860-4079-9fea-bbf45b2b73ce None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:24.220908 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b77b6d-9860-4079-9fea-bbf45b2b73ce None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:24.221794 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b77b6d-9860-4079-9fea-bbf45b2b73ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:24.231675 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 931/1832] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:05:24 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:24.235546 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a45ec-e6c8-4f8f-846c-2a44cc85adab admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:24.296455 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-12b77b6d-9860-4079-9fea-bbf45b2b73ce None None] MFA Rules not processed for user `bf02398302074e25b74218fa186e7f51`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:24.297724 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-12b77b6d-9860-4079-9fea-bbf45b2b73ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:24.392588 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a45ec-e6c8-4f8f-846c-2a44cc85adab admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:24.400549 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0827d-b717-40fe-907d-2c18bbf5ce87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:24.401341 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0827d-b717-40fe-907d-2c18bbf5ce87 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:24.401623 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0827d-b717-40fe-907d-2c18bbf5ce87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:24.401891 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0827d-b717-40fe-907d-2c18bbf5ce87 admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:24.402785 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0827d-b717-40fe-907d-2c18bbf5ce87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:24.404952 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0827d-b717-40fe-907d-2c18bbf5ce87 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:24.421186 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 902/1833] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:24.428669 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b77b6d-9860-4079-9fea-bbf45b2b73ce None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:24.437686 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 932/1834] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:05:24 2022] POST /identity/v3/users => generated 295 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:24.439318 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0827d-b717-40fe-907d-2c18bbf5ce87 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:24.456297 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0827d-b717-40fe-907d-2c18bbf5ce87 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:24.460945 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b77b6d-9860-4079-9fea-bbf45b2b73ce None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:24.461444 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d82d07-5604-42d1-bc0d-315c60d05885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:24.462137 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d82d07-5604-42d1-bc0d-315c60d05885 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:24.462643 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d82d07-5604-42d1-bc0d-315c60d05885 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:24.462915 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d82d07-5604-42d1-bc0d-315c60d05885 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:24.463663 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d82d07-5604-42d1-bc0d-315c60d05885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:24.465467 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d82d07-5604-42d1-bc0d-315c60d05885 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:24.473711 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658505c-d139-4afa-a4ea-018689ecf22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:24.474564 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658505c-d139-4afa-a4ea-018689ecf22b admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:24.476994 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658505c-d139-4afa-a4ea-018689ecf22b admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:24.477151 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658505c-d139-4afa-a4ea-018689ecf22b admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:24.478771 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 933/1835] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:24.478908 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658505c-d139-4afa-a4ea-018689ecf22b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:24.482075 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658505c-d139-4afa-a4ea-018689ecf22b admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:24.482786 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d82d07-5604-42d1-bc0d-315c60d05885 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:24.497123 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d82d07-5604-42d1-bc0d-315c60d05885 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:24.503867 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78345385-dc8b-4f37-b53a-eeb9c6fe6431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:24.505999 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78345385-dc8b-4f37-b53a-eeb9c6fe6431 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:24.506373 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78345385-dc8b-4f37-b53a-eeb9c6fe6431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:24.506650 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78345385-dc8b-4f37-b53a-eeb9c6fe6431 admin admin] PATH_INFO: `/v3/projects/d26968553346437cb9159bf079d0f7de/users/bd421f3ef89a4390a7a7035fbd710bff/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:24.527230 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78345385-dc8b-4f37-b53a-eeb9c6fe6431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d26968553346437cb9159bf079d0f7de, user_id=bd421f3ef89a4390a7a7035fbd710bff, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:24.530505 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78345385-dc8b-4f37-b53a-eeb9c6fe6431 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:24.552780 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 903/1836] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:05:24 2022] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:24.556702 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658505c-d139-4afa-a4ea-018689ecf22b admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:24.567379 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 934/1837] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:05:24 2022] PUT /identity/v3/projects/d26968553346437cb9159bf079d0f7de/users/bd421f3ef89a4390a7a7035fbd710bff/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:24.576356 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78345385-dc8b-4f37-b53a-eeb9c6fe6431 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:24.723604 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658505c-d139-4afa-a4ea-018689ecf22b admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:24.736021 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84030a7e-5702-487d-873c-26fd4360711c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:24.737068 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84030a7e-5702-487d-873c-26fd4360711c admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:24.737445 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84030a7e-5702-487d-873c-26fd4360711c admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:24.737864 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84030a7e-5702-487d-873c-26fd4360711c admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:24.738603 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84030a7e-5702-487d-873c-26fd4360711c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:24.740842 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84030a7e-5702-487d-873c-26fd4360711c admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:24.742066 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78345385-dc8b-4f37-b53a-eeb9c6fe6431 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:24.754362 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25bb86-06c7-4cf6-aa63-785980caae43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:24.756088 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25bb86-06c7-4cf6-aa63-785980caae43 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:24.756510 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25bb86-06c7-4cf6-aa63-785980caae43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:24.756914 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25bb86-06c7-4cf6-aa63-785980caae43 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:24.758207 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25bb86-06c7-4cf6-aa63-785980caae43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:24.767008 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25bb86-06c7-4cf6-aa63-785980caae43 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:24.786878 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 904/1838] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:05:24 2022] POST /identity/v3/users => generated 300 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:24.788327 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84030a7e-5702-487d-873c-26fd4360711c admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:24.799822 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 935/1839] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:24 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:24.803803 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25bb86-06c7-4cf6-aa63-785980caae43 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:24.808745 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84030a7e-5702-487d-873c-26fd4360711c admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:24.819621 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25bb86-06c7-4cf6-aa63-785980caae43 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:24.821951 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379216e-4e7d-44ea-998f-8e5f136bb0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:24.823132 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379216e-4e7d-44ea-998f-8e5f136bb0cc admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:24.823593 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379216e-4e7d-44ea-998f-8e5f136bb0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:24.823961 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379216e-4e7d-44ea-998f-8e5f136bb0cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:24.824771 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379216e-4e7d-44ea-998f-8e5f136bb0cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:24.825904 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037904c-c371-4fd8-834b-2287216f5ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:24.826938 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037904c-c371-4fd8-834b-2287216f5ec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:24.827264 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037904c-c371-4fd8-834b-2287216f5ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:24.827608 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037904c-c371-4fd8-834b-2287216f5ec2 admin admin] PATH_INFO: `/v3/projects/d26968553346437cb9159bf079d0f7de/users/bd421f3ef89a4390a7a7035fbd710bff/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:24.829786 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037904c-c371-4fd8-834b-2287216f5ec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d26968553346437cb9159bf079d0f7de, user_id=bd421f3ef89a4390a7a7035fbd710bff, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:24.830414 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379216e-4e7d-44ea-998f-8e5f136bb0cc admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:24.833020 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037904c-c371-4fd8-834b-2287216f5ec2 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:24.856927 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 936/1840] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:05:24 2022] PUT /identity/v3/projects/d26968553346437cb9159bf079d0f7de/users/bd421f3ef89a4390a7a7035fbd710bff/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:24.857274 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 905/1841] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:24 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:05:24.861963 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379216e-4e7d-44ea-998f-8e5f136bb0cc admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:24.862183 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd4ed8-398b-4edf-a1fe-eb3fe525eec0 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:24.862472 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd4ed8-398b-4edf-a1fe-eb3fe525eec0 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:24.862752 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd4ed8-398b-4edf-a1fe-eb3fe525eec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:24.882776 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379216e-4e7d-44ea-998f-8e5f136bb0cc admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:24.894961 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-1ccd4ed8-398b-4edf-a1fe-eb3fe525eec0 None None] MFA Rules not processed for user `bd421f3ef89a4390a7a7035fbd710bff`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:24.896219 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-1ccd4ed8-398b-4edf-a1fe-eb3fe525eec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:24.974402 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d39041-7517-450a-9425-a7c2906e2d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:24.976554 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d39041-7517-450a-9425-a7c2906e2d5b admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:24.977019 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d39041-7517-450a-9425-a7c2906e2d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:24.977476 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d39041-7517-450a-9425-a7c2906e2d5b admin admin] PATH_INFO: `/v3/projects/4a1c868ff4f54f0f93e71eaa09dd09a0/users/4e9edb792a9144e392847292d37f37d0/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:24.983602 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 937/1842] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:24 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:24.997178 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd4ed8-398b-4edf-a1fe-eb3fe525eec0 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:25.025781 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d39041-7517-450a-9425-a7c2906e2d5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a1c868ff4f54f0f93e71eaa09dd09a0, user_id=4e9edb792a9144e392847292d37f37d0, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:25.029629 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d39041-7517-450a-9425-a7c2906e2d5b admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:25.054177 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 906/1843] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:05:24 2022] PUT /identity/v3/projects/4a1c868ff4f54f0f93e71eaa09dd09a0/users/4e9edb792a9144e392847292d37f37d0/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:05:25.068860 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d39041-7517-450a-9425-a7c2906e2d5b admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:25.094119 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd4ed8-398b-4edf-a1fe-eb3fe525eec0 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:25.147036 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d39041-7517-450a-9425-a7c2906e2d5b admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:25.152171 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905ae5c-a38c-45ee-b3cc-af6e93ceaefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:25.153491 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905ae5c-a38c-45ee-b3cc-af6e93ceaefd admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:25.153491 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905ae5c-a38c-45ee-b3cc-af6e93ceaefd admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:25.153491 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905ae5c-a38c-45ee-b3cc-af6e93ceaefd admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:25.154155 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905ae5c-a38c-45ee-b3cc-af6e93ceaefd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:25.155803 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905ae5c-a38c-45ee-b3cc-af6e93ceaefd admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:25.161354 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf499f74-d392-40bb-b9aa-635350c04a8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:25.162229 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf499f74-d392-40bb-b9aa-635350c04a8c service cinder] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:25.162640 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf499f74-d392-40bb-b9aa-635350c04a8c service cinder] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:25.163027 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf499f74-d392-40bb-b9aa-635350c04a8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:25.166904 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 907/1844] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:25.171976 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905ae5c-a38c-45ee-b3cc-af6e93ceaefd admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:25.187571 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905ae5c-a38c-45ee-b3cc-af6e93ceaefd admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:25.196534 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e968f-b851-425a-b232-41028bf2493d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:25.198730 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e968f-b851-425a-b232-41028bf2493d admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:25.199175 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e968f-b851-425a-b232-41028bf2493d admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:25.199791 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e968f-b851-425a-b232-41028bf2493d admin admin] PATH_INFO: `/v3/projects/4a1c868ff4f54f0f93e71eaa09dd09a0/users/4e9edb792a9144e392847292d37f37d0/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:25.203080 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e968f-b851-425a-b232-41028bf2493d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a1c868ff4f54f0f93e71eaa09dd09a0, user_id=4e9edb792a9144e392847292d37f37d0, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:25.212127 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e968f-b851-425a-b232-41028bf2493d admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:25.238056 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 908/1845] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:05:25 2022] PUT /identity/v3/projects/4a1c868ff4f54f0f93e71eaa09dd09a0/users/4e9edb792a9144e392847292d37f37d0/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:25.250674 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023fe42-94cf-4a8e-a5f8-2e39a93a70dd None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:25.250958 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023fe42-94cf-4a8e-a5f8-2e39a93a70dd None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:25.251424 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023fe42-94cf-4a8e-a5f8-2e39a93a70dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:25.271949 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf499f74-d392-40bb-b9aa-635350c04a8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:25.274758 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf499f74-d392-40bb-b9aa-635350c04a8c service cinder] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:25.299156 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 938/1846] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:05:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:05:25.301762 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcc7b3-1d48-4302-b18e-1f0150b225fb None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:25.302424 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcc7b3-1d48-4302-b18e-1f0150b225fb None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:25.302896 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcc7b3-1d48-4302-b18e-1f0150b225fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:25.333916 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-10fcc7b3-1d48-4302-b18e-1f0150b225fb None None] MFA Rules not processed for user `569824a5ffb846f1a447f1195bb9c017`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:25.335481 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-10fcc7b3-1d48-4302-b18e-1f0150b225fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:25.338014 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-a023fe42-94cf-4a8e-a5f8-2e39a93a70dd None None] MFA Rules not processed for user `4e9edb792a9144e392847292d37f37d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:25.342533 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-a023fe42-94cf-4a8e-a5f8-2e39a93a70dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:25.419243 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 939/1847] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:25.540089 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 909/1848] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:25 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:25.560527 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fcc7b3-1d48-4302-b18e-1f0150b225fb None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:25.562740 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-10fcc7b3-1d48-4302-b18e-1f0150b225fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:25.709994 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fcc7b3-1d48-4302-b18e-1f0150b225fb None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:25.715973 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93256920-cdb3-4d7a-9749-d43140c0e7cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:25.716860 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93256920-cdb3-4d7a-9749-d43140c0e7cc service cinder] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:25.717241 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93256920-cdb3-4d7a-9749-d43140c0e7cc service cinder] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:25.717611 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93256920-cdb3-4d7a-9749-d43140c0e7cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:25.739610 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93256920-cdb3-4d7a-9749-d43140c0e7cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:25.741241 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93256920-cdb3-4d7a-9749-d43140c0e7cc service cinder] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:25.757164 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 940/1849] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:05:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:05:25.942684 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a2016-1b31-4011-8891-edbe9347ec6d None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:25.942961 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a2016-1b31-4011-8891-edbe9347ec6d None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:25.943233 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a2016-1b31-4011-8891-edbe9347ec6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:25.979567 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-281a2016-1b31-4011-8891-edbe9347ec6d None None] MFA Rules not processed for user `d452c4f1c0ac4646ac7869552de56b96`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:25.980809 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-281a2016-1b31-4011-8891-edbe9347ec6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:26.072980 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93256920-cdb3-4d7a-9749-d43140c0e7cc service cinder] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:26.125280 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 910/1850] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:26.214926 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93256920-cdb3-4d7a-9749-d43140c0e7cc service cinder] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:26.237504 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc25b0-32c2-4d15-91a4-6c9d67f6f100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:26.237504 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc25b0-32c2-4d15-91a4-6c9d67f6f100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:26.237930 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc25b0-32c2-4d15-91a4-6c9d67f6f100 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:26.238733 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc25b0-32c2-4d15-91a4-6c9d67f6f100 admin admin] PATH_INFO: `/v3/users/bf02398302074e25b74218fa186e7f51` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:26.240602 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc25b0-32c2-4d15-91a4-6c9d67f6f100 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf02398302074e25b74218fa186e7f51)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:26.247711 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc25b0-32c2-4d15-91a4-6c9d67f6f100 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:26.338982 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-2fcc25b0-32c2-4d15-91a4-6c9d67f6f100 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf02398302074e25b74218fa186e7f51'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:26.356521 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-2fcc25b0-32c2-4d15-91a4-6c9d67f6f100 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf02398302074e25b74218fa186e7f51'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:26.359528 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-2fcc25b0-32c2-4d15-91a4-6c9d67f6f100 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf02398302074e25b74218fa186e7f51'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:26.360285 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-2fcc25b0-32c2-4d15-91a4-6c9d67f6f100 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf02398302074e25b74218fa186e7f51'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:26.373681 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-2fcc25b0-32c2-4d15-91a4-6c9d67f6f100 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf02398302074e25b74218fa186e7f51'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:26.392158 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 941/1851] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:05:26 2022] DELETE /identity/v3/users/bf02398302074e25b74218fa186e7f51 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:26.396411 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f204518-aa5f-4698-a1c5-0fa982472b8a None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:26.397138 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f204518-aa5f-4698-a1c5-0fa982472b8a None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:26.397138 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f204518-aa5f-4698-a1c5-0fa982472b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:26.430483 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-2f204518-aa5f-4698-a1c5-0fa982472b8a None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:26.431968 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-2f204518-aa5f-4698-a1c5-0fa982472b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:26.569788 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 911/1852] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:26.584335 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc25b0-32c2-4d15-91a4-6c9d67f6f100 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:26.585806 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-2fcc25b0-32c2-4d15-91a4-6c9d67f6f100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:26.665050 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1a5cf-d381-4f2b-80ee-f5437ed806d4 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:26.665437 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1a5cf-d381-4f2b-80ee-f5437ed806d4 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:26.666909 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1a5cf-d381-4f2b-80ee-f5437ed806d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:26.694253 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-76e1a5cf-d381-4f2b-80ee-f5437ed806d4 None None] MFA Rules not processed for user `4ded28c2ffe345ccbefde50585023857`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:26.697787 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-76e1a5cf-d381-4f2b-80ee-f5437ed806d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:26.723123 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc25b0-32c2-4d15-91a4-6c9d67f6f100 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:26.733732 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6673bf2-18a6-498a-bcd3-c78da95635b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:26.734173 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6673bf2-18a6-498a-bcd3-c78da95635b2 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:26.734469 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6673bf2-18a6-498a-bcd3-c78da95635b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:26.734733 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6673bf2-18a6-498a-bcd3-c78da95635b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:26.756630 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6673bf2-18a6-498a-bcd3-c78da95635b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:26.758748 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6673bf2-18a6-498a-bcd3-c78da95635b2 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:26.773094 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 942/1853] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:05:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:05:26.836981 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 912/1854] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:27.468278 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6673bf2-18a6-498a-bcd3-c78da95635b2 service neutron] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:27.469981 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-d6673bf2-18a6-498a-bcd3-c78da95635b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:27.507378 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6673bf2-18a6-498a-bcd3-c78da95635b2 service neutron] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:27.524566 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eabee4-d988-43e9-9c03-6766abe3fef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:27.526456 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eabee4-d988-43e9-9c03-6766abe3fef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:27.527378 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eabee4-d988-43e9-9c03-6766abe3fef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:27.528109 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eabee4-d988-43e9-9c03-6766abe3fef3 admin admin] PATH_INFO: `/v3/projects/21b2a4b743c747939de825d7c3282b6a` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:27.529954 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eabee4-d988-43e9-9c03-6766abe3fef3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21b2a4b743c747939de825d7c3282b6a)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:27.532358 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eabee4-d988-43e9-9c03-6766abe3fef3 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:27.590595 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-01eabee4-d988-43e9-9c03-6766abe3fef3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21b2a4b743c747939de825d7c3282b6a', 'request_id': 'req-01eabee4-d988-43e9-9c03-6766abe3fef3'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:27.604432 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-01eabee4-d988-43e9-9c03-6766abe3fef3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21b2a4b743c747939de825d7c3282b6a', 'request_id': 'req-01eabee4-d988-43e9-9c03-6766abe3fef3'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:27.612509 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-01eabee4-d988-43e9-9c03-6766abe3fef3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21b2a4b743c747939de825d7c3282b6a', 'request_id': 'req-01eabee4-d988-43e9-9c03-6766abe3fef3'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:27.641142 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-01eabee4-d988-43e9-9c03-6766abe3fef3 admin admin] The token cache is being invalidate because project 21b2a4b743c747939de825d7c3282b6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:05:27.641424 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-01eabee4-d988-43e9-9c03-6766abe3fef3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:27.642030 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-01eabee4-d988-43e9-9c03-6766abe3fef3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:27.643783 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 943/1855] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:05:27 2022] DELETE /identity/v3/projects/21b2a4b743c747939de825d7c3282b6a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:27.649336 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1a5cf-d381-4f2b-80ee-f5437ed806d4 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:27.661588 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1a5cf-d381-4f2b-80ee-f5437ed806d4 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:27.738176 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c26ea-10e4-45c0-9d6c-1be93c946d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:27.739419 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c26ea-10e4-45c0-9d6c-1be93c946d2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:27.739951 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c26ea-10e4-45c0-9d6c-1be93c946d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:27.740396 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c26ea-10e4-45c0-9d6c-1be93c946d2c admin admin] PATH_INFO: `/v3/users/4e9edb792a9144e392847292d37f37d0` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:27.742393 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c26ea-10e4-45c0-9d6c-1be93c946d2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e9edb792a9144e392847292d37f37d0)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:27.745541 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c26ea-10e4-45c0-9d6c-1be93c946d2c admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:27.828876 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-108c26ea-10e4-45c0-9d6c-1be93c946d2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e9edb792a9144e392847292d37f37d0'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:27.830190 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-108c26ea-10e4-45c0-9d6c-1be93c946d2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e9edb792a9144e392847292d37f37d0'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:27.849172 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-108c26ea-10e4-45c0-9d6c-1be93c946d2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e9edb792a9144e392847292d37f37d0'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:27.850948 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-108c26ea-10e4-45c0-9d6c-1be93c946d2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e9edb792a9144e392847292d37f37d0'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:27.864604 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-108c26ea-10e4-45c0-9d6c-1be93c946d2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e9edb792a9144e392847292d37f37d0'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:27.889942 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 913/1856] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:05:27 2022] DELETE /identity/v3/users/4e9edb792a9144e392847292d37f37d0 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:28.355814 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eabee4-d988-43e9-9c03-6766abe3fef3 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:28.357879 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-01eabee4-d988-43e9-9c03-6766abe3fef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:28.390133 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eabee4-d988-43e9-9c03-6766abe3fef3 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:28.462045 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bfde02-ebd0-49a0-9059-c23fc4d2f2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:28.462974 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfde02-ebd0-49a0-9059-c23fc4d2f2e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:28.463248 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfde02-ebd0-49a0-9059-c23fc4d2f2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:28.463515 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfde02-ebd0-49a0-9059-c23fc4d2f2e6 admin admin] PATH_INFO: `/v3/projects/4a1c868ff4f54f0f93e71eaa09dd09a0` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:28.464730 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bfde02-ebd0-49a0-9059-c23fc4d2f2e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a1c868ff4f54f0f93e71eaa09dd09a0)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:28.466724 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bfde02-ebd0-49a0-9059-c23fc4d2f2e6 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:28.515388 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-c3bfde02-ebd0-49a0-9059-c23fc4d2f2e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a1c868ff4f54f0f93e71eaa09dd09a0', 'request_id': 'req-c3bfde02-ebd0-49a0-9059-c23fc4d2f2e6'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:28.524474 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-c3bfde02-ebd0-49a0-9059-c23fc4d2f2e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a1c868ff4f54f0f93e71eaa09dd09a0', 'request_id': 'req-c3bfde02-ebd0-49a0-9059-c23fc4d2f2e6'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:28.531571 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-c3bfde02-ebd0-49a0-9059-c23fc4d2f2e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a1c868ff4f54f0f93e71eaa09dd09a0', 'request_id': 'req-c3bfde02-ebd0-49a0-9059-c23fc4d2f2e6'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:28.543437 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-c3bfde02-ebd0-49a0-9059-c23fc4d2f2e6 admin admin] The token cache is being invalidate because project 4a1c868ff4f54f0f93e71eaa09dd09a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:05:28.544080 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-c3bfde02-ebd0-49a0-9059-c23fc4d2f2e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:28.545053 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-c3bfde02-ebd0-49a0-9059-c23fc4d2f2e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:28.548754 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 944/1857] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:05:28 2022] DELETE /identity/v3/projects/4a1c868ff4f54f0f93e71eaa09dd09a0 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:28.553399 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79315cd6-3cd9-44df-ad99-2f19d1ddee8c None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:28.553679 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79315cd6-3cd9-44df-ad99-2f19d1ddee8c None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:28.553949 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79315cd6-3cd9-44df-ad99-2f19d1ddee8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:28.581340 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-79315cd6-3cd9-44df-ad99-2f19d1ddee8c None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:28.582799 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-79315cd6-3cd9-44df-ad99-2f19d1ddee8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:28.665376 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 914/1858] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:28.673529 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c449e28-d28c-41a5-b9a8-933b3a54ba82 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:28.674297 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c449e28-d28c-41a5-b9a8-933b3a54ba82 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:28.674571 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c449e28-d28c-41a5-b9a8-933b3a54ba82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:28.693631 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-5c449e28-d28c-41a5-b9a8-933b3a54ba82 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:28.694821 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-5c449e28-d28c-41a5-b9a8-933b3a54ba82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:28.704460 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 945/1859] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:05:28.708055 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79315cd6-3cd9-44df-ad99-2f19d1ddee8c None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:28.719979 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79315cd6-3cd9-44df-ad99-2f19d1ddee8c None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:28.725326 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0564e19-65ac-425c-a1f0-466edcf618ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:28.725997 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0564e19-65ac-425c-a1f0-466edcf618ac admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:28.726270 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0564e19-65ac-425c-a1f0-466edcf618ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:28.726542 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0564e19-65ac-425c-a1f0-466edcf618ac admin admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:28.727256 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0564e19-65ac-425c-a1f0-466edcf618ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:05:28.727552 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0564e19-65ac-425c-a1f0-466edcf618ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:28.729626 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0564e19-65ac-425c-a1f0-466edcf618ac admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:28.743763 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 915/1860] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 03:05:28.746209 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c449e28-d28c-41a5-b9a8-933b3a54ba82 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:28.755559 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c449e28-d28c-41a5-b9a8-933b3a54ba82 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:28.761239 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da31fed-5f02-481a-8a6f-82b39b4b4490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:28.762092 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da31fed-5f02-481a-8a6f-82b39b4b4490 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:28.762372 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da31fed-5f02-481a-8a6f-82b39b4b4490 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:28.762633 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da31fed-5f02-481a-8a6f-82b39b4b4490 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:28.763481 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da31fed-5f02-481a-8a6f-82b39b4b4490 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:28.765617 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da31fed-5f02-481a-8a6f-82b39b4b4490 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:28.792504 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 946/1861] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:05:28 2022] POST /identity/v3/projects => generated 409 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:28.797118 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0564e19-65ac-425c-a1f0-466edcf618ac admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:28.808364 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0564e19-65ac-425c-a1f0-466edcf618ac admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:28.865985 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572e24f-d14c-4c4c-b8f8-d09ef8ddb910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:28.866822 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572e24f-d14c-4c4c-b8f8-d09ef8ddb910 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:28.867084 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572e24f-d14c-4c4c-b8f8-d09ef8ddb910 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:28.867617 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572e24f-d14c-4c4c-b8f8-d09ef8ddb910 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:28.868450 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572e24f-d14c-4c4c-b8f8-d09ef8ddb910 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:28.870642 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572e24f-d14c-4c4c-b8f8-d09ef8ddb910 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:28.893246 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 916/1862] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:05:28 2022] POST /identity/v3/users => generated 305 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:28.897385 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da31fed-5f02-481a-8a6f-82b39b4b4490 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:28.908430 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da31fed-5f02-481a-8a6f-82b39b4b4490 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:28.921567 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cba35-5cba-4821-a0a9-7219559ed659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:28.922509 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cba35-5cba-4821-a0a9-7219559ed659 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:28.922844 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cba35-5cba-4821-a0a9-7219559ed659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:28.923176 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cba35-5cba-4821-a0a9-7219559ed659 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:28.924582 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496cba35-5cba-4821-a0a9-7219559ed659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:28.926594 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496cba35-5cba-4821-a0a9-7219559ed659 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:28.940410 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 947/1863] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:28.944709 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572e24f-d14c-4c4c-b8f8-d09ef8ddb910 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:28.959074 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572e24f-d14c-4c4c-b8f8-d09ef8ddb910 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:28.964492 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8063a1f-758b-48d6-b8d6-e901492fcbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:28.965444 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8063a1f-758b-48d6-b8d6-e901492fcbbe admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:28.965805 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8063a1f-758b-48d6-b8d6-e901492fcbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:28.966127 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8063a1f-758b-48d6-b8d6-e901492fcbbe admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:28.966888 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8063a1f-758b-48d6-b8d6-e901492fcbbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:28.968653 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8063a1f-758b-48d6-b8d6-e901492fcbbe admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:28.983746 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 917/1864] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:28.986228 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cba35-5cba-4821-a0a9-7219559ed659 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:28.997103 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cba35-5cba-4821-a0a9-7219559ed659 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:29.001707 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2cf67-3372-4899-a731-784b151b1c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:29.002598 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2cf67-3372-4899-a731-784b151b1c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:29.002876 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2cf67-3372-4899-a731-784b151b1c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:29.003148 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2cf67-3372-4899-a731-784b151b1c10 admin admin] PATH_INFO: `/v3/projects/e0d4221fd7d949558d0c859ec4503b31/users/e329bab1574e43d6b5c4651d706991f1/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:29.018804 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2cf67-3372-4899-a731-784b151b1c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0d4221fd7d949558d0c859ec4503b31, user_id=e329bab1574e43d6b5c4651d706991f1, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:29.021505 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2cf67-3372-4899-a731-784b151b1c10 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:29.035690 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 948/1865] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:05:28 2022] PUT /identity/v3/projects/e0d4221fd7d949558d0c859ec4503b31/users/e329bab1574e43d6b5c4651d706991f1/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:05:29.048290 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ced3b-e512-4ca9-83c2-bb796b56df8e None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:29.048725 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ced3b-e512-4ca9-83c2-bb796b56df8e None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:29.049113 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ced3b-e512-4ca9-83c2-bb796b56df8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:29.083241 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-fe4ced3b-e512-4ca9-83c2-bb796b56df8e None None] MFA Rules not processed for user `e329bab1574e43d6b5c4651d706991f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:29.084517 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-fe4ced3b-e512-4ca9-83c2-bb796b56df8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:29.157198 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 918/1866] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:29 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:29.161943 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2cf67-3372-4899-a731-784b151b1c10 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:29.226204 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2cf67-3372-4899-a731-784b151b1c10 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:29.231674 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec02ef-e14b-4e8b-be8a-1ec866e9d591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:29.232379 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec02ef-e14b-4e8b-be8a-1ec866e9d591 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:29.232664 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec02ef-e14b-4e8b-be8a-1ec866e9d591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:29.232941 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec02ef-e14b-4e8b-be8a-1ec866e9d591 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:29.233668 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec02ef-e14b-4e8b-be8a-1ec866e9d591 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:29.235578 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec02ef-e14b-4e8b-be8a-1ec866e9d591 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:29.263126 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 949/1867] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:05:29 2022] POST /identity/v3/projects => generated 409 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:29.268736 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ced3b-e512-4ca9-83c2-bb796b56df8e None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:29.279758 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ced3b-e512-4ca9-83c2-bb796b56df8e None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:29.336786 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f92f1-cc28-4f8c-aeba-ef4316ef2987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:29.337518 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f92f1-cc28-4f8c-aeba-ef4316ef2987 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:29.337799 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f92f1-cc28-4f8c-aeba-ef4316ef2987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:29.338084 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f92f1-cc28-4f8c-aeba-ef4316ef2987 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:29.338783 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f92f1-cc28-4f8c-aeba-ef4316ef2987 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:29.340873 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f92f1-cc28-4f8c-aeba-ef4316ef2987 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:29.365657 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 919/1868] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:05:29 2022] POST /identity/v3/users => generated 311 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 03:05:29.366722 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec02ef-e14b-4e8b-be8a-1ec866e9d591 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:29.377199 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec02ef-e14b-4e8b-be8a-1ec866e9d591 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:29.381936 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b862c7e-4244-4f12-a096-08e9b0a38c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:29.382598 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b862c7e-4244-4f12-a096-08e9b0a38c78 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:29.382876 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b862c7e-4244-4f12-a096-08e9b0a38c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:29.383144 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b862c7e-4244-4f12-a096-08e9b0a38c78 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:29.383905 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b862c7e-4244-4f12-a096-08e9b0a38c78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:29.385569 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b862c7e-4244-4f12-a096-08e9b0a38c78 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:29.396014 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 950/1869] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:29.400315 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f92f1-cc28-4f8c-aeba-ef4316ef2987 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:29.410166 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f92f1-cc28-4f8c-aeba-ef4316ef2987 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:29.415548 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bfb2e-3669-4551-849c-55251b92977f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:29.416469 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bfb2e-3669-4551-849c-55251b92977f admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:29.416746 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bfb2e-3669-4551-849c-55251b92977f admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:29.417011 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bfb2e-3669-4551-849c-55251b92977f admin admin] PATH_INFO: `/v3/projects/a66448ee992f4376a6afc444c8d1df9a/users/5b6bc2e2ffc84881b5a4cb9050437ead/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:29.433199 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91bfb2e-3669-4551-849c-55251b92977f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a66448ee992f4376a6afc444c8d1df9a, user_id=5b6bc2e2ffc84881b5a4cb9050437ead, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:29.436343 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91bfb2e-3669-4551-849c-55251b92977f admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:29.452141 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 920/1870] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:05:29 2022] PUT /identity/v3/projects/a66448ee992f4376a6afc444c8d1df9a/users/5b6bc2e2ffc84881b5a4cb9050437ead/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:29.456806 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b862c7e-4244-4f12-a096-08e9b0a38c78 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:29.467620 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b862c7e-4244-4f12-a096-08e9b0a38c78 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:29.529833 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc56c36-e40b-4990-809d-91b70fb9d75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:29.530511 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc56c36-e40b-4990-809d-91b70fb9d75a admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:29.530786 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc56c36-e40b-4990-809d-91b70fb9d75a admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:29.531060 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc56c36-e40b-4990-809d-91b70fb9d75a admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:29.531797 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc56c36-e40b-4990-809d-91b70fb9d75a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:29.533371 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc56c36-e40b-4990-809d-91b70fb9d75a admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:29.543603 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 951/1871] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:05:29.547662 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bfb2e-3669-4551-849c-55251b92977f admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:29.557881 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bfb2e-3669-4551-849c-55251b92977f admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:29.562588 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f976a2-4002-414f-a33b-7fa86ec795ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:29.563504 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f976a2-4002-414f-a33b-7fa86ec795ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:29.563819 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f976a2-4002-414f-a33b-7fa86ec795ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:29.564091 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f976a2-4002-414f-a33b-7fa86ec795ca admin admin] PATH_INFO: `/v3/projects/a66448ee992f4376a6afc444c8d1df9a/users/5b6bc2e2ffc84881b5a4cb9050437ead/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:29.566065 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f976a2-4002-414f-a33b-7fa86ec795ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=a66448ee992f4376a6afc444c8d1df9a, user_id=5b6bc2e2ffc84881b5a4cb9050437ead, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:29.568802 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f976a2-4002-414f-a33b-7fa86ec795ca admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:29.579761 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 921/1872] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:05:29 2022] PUT /identity/v3/projects/a66448ee992f4376a6afc444c8d1df9a/users/5b6bc2e2ffc84881b5a4cb9050437ead/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:29.590385 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfe446-8312-457e-b786-9362ed61e96f None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:29.590666 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfe446-8312-457e-b786-9362ed61e96f None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:29.590941 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfe446-8312-457e-b786-9362ed61e96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:29.620656 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-34dfe446-8312-457e-b786-9362ed61e96f None None] MFA Rules not processed for user `5b6bc2e2ffc84881b5a4cb9050437ead`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:29.621863 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-34dfe446-8312-457e-b786-9362ed61e96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:29.691001 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 952/1873] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:29 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:29.702735 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f976a2-4002-414f-a33b-7fa86ec795ca admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:29.704478 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-41f976a2-4002-414f-a33b-7fa86ec795ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:29.760592 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f976a2-4002-414f-a33b-7fa86ec795ca admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:29.765025 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05424f54-f9d1-42c4-9812-07bf0e2c54f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:29.765667 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05424f54-f9d1-42c4-9812-07bf0e2c54f6 service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:29.765940 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05424f54-f9d1-42c4-9812-07bf0e2c54f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:29.766209 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05424f54-f9d1-42c4-9812-07bf0e2c54f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:29.777664 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05424f54-f9d1-42c4-9812-07bf0e2c54f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:29.779138 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05424f54-f9d1-42c4-9812-07bf0e2c54f6 service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:29.791255 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 922/1874] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:05:29 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:05:29.955291 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dfe446-8312-457e-b786-9362ed61e96f None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:29.964892 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dfe446-8312-457e-b786-9362ed61e96f None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:29.968598 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6631b-feb0-4dcb-b87e-b63700885d83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:29.969235 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6631b-feb0-4dcb-b87e-b63700885d83 service cinder] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:29.969512 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6631b-feb0-4dcb-b87e-b63700885d83 service cinder] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:29.969780 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6631b-feb0-4dcb-b87e-b63700885d83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:30.026245 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f6631b-feb0-4dcb-b87e-b63700885d83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:30.027686 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f6631b-feb0-4dcb-b87e-b63700885d83 service cinder] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:30.037056 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 953/1875] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:05:29 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:05:30.906600 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635503d-8ee7-404e-955a-e5ec764a7586 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:30.907185 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635503d-8ee7-404e-955a-e5ec764a7586 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:30.907185 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635503d-8ee7-404e-955a-e5ec764a7586 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:30.908557 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 923/1876] 10.222.0.32 () {54 vars in 921 bytes} [Tue Apr 12 03:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 03:05:30.923744 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e22c11-8af5-44de-80d7-94acfd8e5cc5 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:30.924845 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e22c11-8af5-44de-80d7-94acfd8e5cc5 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:30.926005 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e22c11-8af5-44de-80d7-94acfd8e5cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:30.953307 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-30e22c11-8af5-44de-80d7-94acfd8e5cc5 None None] MFA Rules not processed for user `43ee5cb310fd4538910e40ea7082708c`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:30.954886 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-30e22c11-8af5-44de-80d7-94acfd8e5cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:31.087408 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 954/1877] 10.222.0.32 () {58 vars in 1018 bytes} [Tue Apr 12 03:05:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:31.210460 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635503d-8ee7-404e-955a-e5ec764a7586 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:31.212857 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-3635503d-8ee7-404e-955a-e5ec764a7586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:31.234213 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635503d-8ee7-404e-955a-e5ec764a7586 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:31.246252 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2264f81-8ad3-4259-a974-d6260705d873 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:31.247314 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2264f81-8ad3-4259-a974-d6260705d873 service nova] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:31.247933 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2264f81-8ad3-4259-a974-d6260705d873 service nova] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:31.248533 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2264f81-8ad3-4259-a974-d6260705d873 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:31.260197 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2264f81-8ad3-4259-a974-d6260705d873 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:31.261802 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2264f81-8ad3-4259-a974-d6260705d873 service nova] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:31.274262 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 924/1878] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:05:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 03:05:31.554570 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e22c11-8af5-44de-80d7-94acfd8e5cc5 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:31.557030 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-30e22c11-8af5-44de-80d7-94acfd8e5cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:31.661595 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e22c11-8af5-44de-80d7-94acfd8e5cc5 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:31.667258 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47611102-251d-4075-9b4d-aa94170e44da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:31.668183 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47611102-251d-4075-9b4d-aa94170e44da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:31.668459 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47611102-251d-4075-9b4d-aa94170e44da admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:31.668728 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47611102-251d-4075-9b4d-aa94170e44da admin admin] PATH_INFO: `/v3/users/c2a76b57a1f94bbcbc8b24debc0674db` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:31.669921 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47611102-251d-4075-9b4d-aa94170e44da admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2a76b57a1f94bbcbc8b24debc0674db)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:31.671868 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47611102-251d-4075-9b4d-aa94170e44da admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:31.705496 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2264f81-8ad3-4259-a974-d6260705d873 service nova] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:31.719215 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2264f81-8ad3-4259-a974-d6260705d873 service nova] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:31.723507 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f4bd9-06a0-48e4-abf1-99dc75836348 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:31.724401 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f4bd9-06a0-48e4-abf1-99dc75836348 service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:31.724744 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f4bd9-06a0-48e4-abf1-99dc75836348 service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:31.726738 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f4bd9-06a0-48e4-abf1-99dc75836348 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:31.729887 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-ec5f4bd9-06a0-48e4-abf1-99dc75836348 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:31.742650 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-47611102-251d-4075-9b4d-aa94170e44da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2a76b57a1f94bbcbc8b24debc0674db'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:31.773767 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-47611102-251d-4075-9b4d-aa94170e44da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2a76b57a1f94bbcbc8b24debc0674db'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:31.774698 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-47611102-251d-4075-9b4d-aa94170e44da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2a76b57a1f94bbcbc8b24debc0674db'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:31.776403 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-47611102-251d-4075-9b4d-aa94170e44da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2a76b57a1f94bbcbc8b24debc0674db'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:31.797461 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-47611102-251d-4075-9b4d-aa94170e44da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2a76b57a1f94bbcbc8b24debc0674db'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:31.837147 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 955/1879] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:05:31 2022] DELETE /identity/v3/users/c2a76b57a1f94bbcbc8b24debc0674db => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:31.838988 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccbe77-8ee2-4a88-9fd9-43db6f25d24b None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:31.839246 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccbe77-8ee2-4a88-9fd9-43db6f25d24b None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:31.839924 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccbe77-8ee2-4a88-9fd9-43db6f25d24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:31.873957 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f4bd9-06a0-48e4-abf1-99dc75836348 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:31.876976 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f4bd9-06a0-48e4-abf1-99dc75836348 service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:31.882263 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-42ccbe77-8ee2-4a88-9fd9-43db6f25d24b None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:31.887449 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-42ccbe77-8ee2-4a88-9fd9-43db6f25d24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:31.915037 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 925/1880] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:05:31 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:05:31.991737 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 956/1881] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:32.011359 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f4bd9-06a0-48e4-abf1-99dc75836348 service cinder] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:32.012911 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-ec5f4bd9-06a0-48e4-abf1-99dc75836348 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:32.072790 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f4bd9-06a0-48e4-abf1-99dc75836348 service cinder] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:32.142463 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d22428-061b-49be-a4c3-c52d1336f19d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:32.143376 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d22428-061b-49be-a4c3-c52d1336f19d service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:32.143553 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d22428-061b-49be-a4c3-c52d1336f19d service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:32.143959 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d22428-061b-49be-a4c3-c52d1336f19d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:32.154280 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d22428-061b-49be-a4c3-c52d1336f19d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:32.155947 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d22428-061b-49be-a4c3-c52d1336f19d service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:32.166268 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 926/1882] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:05:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:05:32.530628 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ccbe77-8ee2-4a88-9fd9-43db6f25d24b None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:32.533189 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-42ccbe77-8ee2-4a88-9fd9-43db6f25d24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:32.558697 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ccbe77-8ee2-4a88-9fd9-43db6f25d24b None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:32.563747 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fadab1-23c2-4e11-b262-9fdbd122c514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:32.564639 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fadab1-23c2-4e11-b262-9fdbd122c514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:32.564917 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fadab1-23c2-4e11-b262-9fdbd122c514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:32.565191 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fadab1-23c2-4e11-b262-9fdbd122c514 admin admin] PATH_INFO: `/v3/projects/e8752912a4b34d46be2855333bb82142` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:32.566386 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fadab1-23c2-4e11-b262-9fdbd122c514 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8752912a4b34d46be2855333bb82142)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:32.568459 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fadab1-23c2-4e11-b262-9fdbd122c514 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:32.620398 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-c5fadab1-23c2-4e11-b262-9fdbd122c514 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8752912a4b34d46be2855333bb82142', 'request_id': 'req-c5fadab1-23c2-4e11-b262-9fdbd122c514'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:32.629484 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-c5fadab1-23c2-4e11-b262-9fdbd122c514 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8752912a4b34d46be2855333bb82142', 'request_id': 'req-c5fadab1-23c2-4e11-b262-9fdbd122c514'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:32.636392 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-c5fadab1-23c2-4e11-b262-9fdbd122c514 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8752912a4b34d46be2855333bb82142', 'request_id': 'req-c5fadab1-23c2-4e11-b262-9fdbd122c514'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:32.646425 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-c5fadab1-23c2-4e11-b262-9fdbd122c514 admin admin] The token cache is being invalidate because project e8752912a4b34d46be2855333bb82142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:05:32.646705 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-c5fadab1-23c2-4e11-b262-9fdbd122c514 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:32.647333 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-c5fadab1-23c2-4e11-b262-9fdbd122c514 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:32.649006 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 957/1883] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:05:32 2022] DELETE /identity/v3/projects/e8752912a4b34d46be2855333bb82142 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:32.652930 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d22428-061b-49be-a4c3-c52d1336f19d service neutron] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:32.662171 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d22428-061b-49be-a4c3-c52d1336f19d service neutron] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:32.721417 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e09d97-0ac9-415a-a02a-2b9f7eaefd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:32.722333 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e09d97-0ac9-415a-a02a-2b9f7eaefd5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:32.722611 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e09d97-0ac9-415a-a02a-2b9f7eaefd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:32.722873 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e09d97-0ac9-415a-a02a-2b9f7eaefd5b admin admin] PATH_INFO: `/v3/users/df3e65797a174210a778b75fe6e9280d` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:32.724118 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e09d97-0ac9-415a-a02a-2b9f7eaefd5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=df3e65797a174210a778b75fe6e9280d)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:32.726101 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e09d97-0ac9-415a-a02a-2b9f7eaefd5b admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:32.775918 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-d2e09d97-0ac9-415a-a02a-2b9f7eaefd5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df3e65797a174210a778b75fe6e9280d'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:32.776703 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-d2e09d97-0ac9-415a-a02a-2b9f7eaefd5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df3e65797a174210a778b75fe6e9280d'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:32.789430 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-d2e09d97-0ac9-415a-a02a-2b9f7eaefd5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df3e65797a174210a778b75fe6e9280d'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:32.790160 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-d2e09d97-0ac9-415a-a02a-2b9f7eaefd5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df3e65797a174210a778b75fe6e9280d'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:32.797400 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-d2e09d97-0ac9-415a-a02a-2b9f7eaefd5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df3e65797a174210a778b75fe6e9280d'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:32.811652 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 927/1884] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:05:32 2022] DELETE /identity/v3/users/df3e65797a174210a778b75fe6e9280d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:33.105632 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fadab1-23c2-4e11-b262-9fdbd122c514 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:33.107560 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-c5fadab1-23c2-4e11-b262-9fdbd122c514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:33.121224 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fadab1-23c2-4e11-b262-9fdbd122c514 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:33.180341 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4e05a-f586-4c5c-bad0-d5e66f470bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:33.181225 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4e05a-f586-4c5c-bad0-d5e66f470bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:33.181493 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4e05a-f586-4c5c-bad0-d5e66f470bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:33.181954 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4e05a-f586-4c5c-bad0-d5e66f470bbd admin admin] PATH_INFO: `/v3/projects/5eb7e8d0972a42d0b57006f2db182038` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:33.183669 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b4e05a-f586-4c5c-bad0-d5e66f470bbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eb7e8d0972a42d0b57006f2db182038)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:33.186045 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b4e05a-f586-4c5c-bad0-d5e66f470bbd admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:33.232046 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-60b4e05a-f586-4c5c-bad0-d5e66f470bbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eb7e8d0972a42d0b57006f2db182038', 'request_id': 'req-60b4e05a-f586-4c5c-bad0-d5e66f470bbd'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:33.239999 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-60b4e05a-f586-4c5c-bad0-d5e66f470bbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eb7e8d0972a42d0b57006f2db182038', 'request_id': 'req-60b4e05a-f586-4c5c-bad0-d5e66f470bbd'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:33.246369 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-60b4e05a-f586-4c5c-bad0-d5e66f470bbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eb7e8d0972a42d0b57006f2db182038', 'request_id': 'req-60b4e05a-f586-4c5c-bad0-d5e66f470bbd'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:33.256259 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-60b4e05a-f586-4c5c-bad0-d5e66f470bbd admin admin] The token cache is being invalidate because project 5eb7e8d0972a42d0b57006f2db182038 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:05:33.256535 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-60b4e05a-f586-4c5c-bad0-d5e66f470bbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:33.257130 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-60b4e05a-f586-4c5c-bad0-d5e66f470bbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:33.258670 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 958/1885] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:05:33 2022] DELETE /identity/v3/projects/5eb7e8d0972a42d0b57006f2db182038 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:33.264002 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c48c6-43c5-4577-bd6e-85659b10a493 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:33.264494 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c48c6-43c5-4577-bd6e-85659b10a493 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:33.264602 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c48c6-43c5-4577-bd6e-85659b10a493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:33.282730 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-dd1c48c6-43c5-4577-bd6e-85659b10a493 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:33.283936 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-dd1c48c6-43c5-4577-bd6e-85659b10a493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:33.347697 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 928/1886] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:33.355538 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17f00a-214b-47b7-a6e7-91714dc8e4ad None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:33.355849 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17f00a-214b-47b7-a6e7-91714dc8e4ad None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:33.356109 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17f00a-214b-47b7-a6e7-91714dc8e4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:33.374594 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-cc17f00a-214b-47b7-a6e7-91714dc8e4ad None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:33.375820 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-cc17f00a-214b-47b7-a6e7-91714dc8e4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:33.383953 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 959/1887] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:05:33.388284 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c48c6-43c5-4577-bd6e-85659b10a493 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:33.397902 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c48c6-43c5-4577-bd6e-85659b10a493 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:33.405105 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5c735-77ac-4fe7-9ce4-ebdfff3b2301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:33.406064 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5c735-77ac-4fe7-9ce4-ebdfff3b2301 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:33.406454 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5c735-77ac-4fe7-9ce4-ebdfff3b2301 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:33.406880 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5c735-77ac-4fe7-9ce4-ebdfff3b2301 admin admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:33.408151 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5c735-77ac-4fe7-9ce4-ebdfff3b2301 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:05:33.408572 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5c735-77ac-4fe7-9ce4-ebdfff3b2301 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:33.411446 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5c735-77ac-4fe7-9ce4-ebdfff3b2301 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:33.427860 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 929/1888] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:05:33.429029 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17f00a-214b-47b7-a6e7-91714dc8e4ad None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:33.438583 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17f00a-214b-47b7-a6e7-91714dc8e4ad None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:33.443155 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ec62b-148d-416c-989e-d1e96f98c26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:33.443927 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ec62b-148d-416c-989e-d1e96f98c26a admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:33.444204 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ec62b-148d-416c-989e-d1e96f98c26a admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:33.444465 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ec62b-148d-416c-989e-d1e96f98c26a admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:33.445159 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ec62b-148d-416c-989e-d1e96f98c26a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:33.447137 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ec62b-148d-416c-989e-d1e96f98c26a admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:33.479412 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 960/1889] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:05:33 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 03:05:33.483663 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5c735-77ac-4fe7-9ce4-ebdfff3b2301 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:33.493479 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5c735-77ac-4fe7-9ce4-ebdfff3b2301 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:33.558259 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13489bb4-b998-4415-b139-cd73e256af32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:33.558926 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13489bb4-b998-4415-b139-cd73e256af32 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:33.559200 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13489bb4-b998-4415-b139-cd73e256af32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:33.559478 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13489bb4-b998-4415-b139-cd73e256af32 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:33.560159 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13489bb4-b998-4415-b139-cd73e256af32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:33.562097 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13489bb4-b998-4415-b139-cd73e256af32 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:33.584019 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 930/1890] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:05:33 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:33.588132 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ec62b-148d-416c-989e-d1e96f98c26a admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:33.600954 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ec62b-148d-416c-989e-d1e96f98c26a admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:33.603482 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94217946-6f94-49cc-8e6e-49639044c73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:33.604540 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94217946-6f94-49cc-8e6e-49639044c73a admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:33.604540 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94217946-6f94-49cc-8e6e-49639044c73a admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:33.604693 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94217946-6f94-49cc-8e6e-49639044c73a admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:33.605393 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94217946-6f94-49cc-8e6e-49639044c73a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:33.606989 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94217946-6f94-49cc-8e6e-49639044c73a admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:33.617728 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 961/1891] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:33.621778 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13489bb4-b998-4415-b139-cd73e256af32 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:33.632403 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13489bb4-b998-4415-b139-cd73e256af32 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:33.637443 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f2e5b-f287-4834-a145-da8d073f5178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:33.638116 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f2e5b-f287-4834-a145-da8d073f5178 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:33.638395 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f2e5b-f287-4834-a145-da8d073f5178 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:33.638667 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f2e5b-f287-4834-a145-da8d073f5178 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:33.639385 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f2e5b-f287-4834-a145-da8d073f5178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:33.641039 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f2e5b-f287-4834-a145-da8d073f5178 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:33.651691 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 931/1892] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:33.656638 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94217946-6f94-49cc-8e6e-49639044c73a admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:33.666746 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94217946-6f94-49cc-8e6e-49639044c73a admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:33.672057 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537cc066-7607-455c-8346-ecdf4e4cdc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:33.672488 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cc066-7607-455c-8346-ecdf4e4cdc5a admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:33.672759 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cc066-7607-455c-8346-ecdf4e4cdc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:33.673197 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cc066-7607-455c-8346-ecdf4e4cdc5a admin admin] PATH_INFO: `/v3/projects/90e06406c4564d89998e9b379f3bcbae/users/30eb42fb29134f748603aa17536e04f2/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:33.691183 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537cc066-7607-455c-8346-ecdf4e4cdc5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=90e06406c4564d89998e9b379f3bcbae, user_id=30eb42fb29134f748603aa17536e04f2, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:33.697632 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537cc066-7607-455c-8346-ecdf4e4cdc5a admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:33.709232 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 962/1893] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:05:33 2022] PUT /identity/v3/projects/90e06406c4564d89998e9b379f3bcbae/users/30eb42fb29134f748603aa17536e04f2/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:05:33.723747 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b888be-241f-454e-97c0-93f71e8b0523 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:33.724050 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b888be-241f-454e-97c0-93f71e8b0523 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:33.724324 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b888be-241f-454e-97c0-93f71e8b0523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:33.751792 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-80b888be-241f-454e-97c0-93f71e8b0523 None None] MFA Rules not processed for user `30eb42fb29134f748603aa17536e04f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:33.753075 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-80b888be-241f-454e-97c0-93f71e8b0523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:33.815395 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 932/1894] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:33.821111 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537cc066-7607-455c-8346-ecdf4e4cdc5a admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:33.894618 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537cc066-7607-455c-8346-ecdf4e4cdc5a admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:33.902686 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1485e10-13b2-4d14-a53f-4041c8176e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:33.903350 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1485e10-13b2-4d14-a53f-4041c8176e26 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:33.903630 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1485e10-13b2-4d14-a53f-4041c8176e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:33.903929 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1485e10-13b2-4d14-a53f-4041c8176e26 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:33.904626 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1485e10-13b2-4d14-a53f-4041c8176e26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:33.906567 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1485e10-13b2-4d14-a53f-4041c8176e26 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:33.934216 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 963/1895] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:05:33 2022] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:33.938387 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b888be-241f-454e-97c0-93f71e8b0523 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:33.949823 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b888be-241f-454e-97c0-93f71e8b0523 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:34.006385 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a419a-52ca-43e7-ac82-c4454de5af48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:34.007053 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a419a-52ca-43e7-ac82-c4454de5af48 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:34.007320 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a419a-52ca-43e7-ac82-c4454de5af48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:34.007590 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a419a-52ca-43e7-ac82-c4454de5af48 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:34.008322 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a419a-52ca-43e7-ac82-c4454de5af48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:34.010537 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a419a-52ca-43e7-ac82-c4454de5af48 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:34.034104 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 933/1896] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:05:33 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:34.038091 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1485e10-13b2-4d14-a53f-4041c8176e26 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:34.048719 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1485e10-13b2-4d14-a53f-4041c8176e26 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:34.053777 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39bb97-4a1e-4ca0-a027-6e658f1209f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:34.054441 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39bb97-4a1e-4ca0-a027-6e658f1209f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:34.054738 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39bb97-4a1e-4ca0-a027-6e658f1209f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:34.055000 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39bb97-4a1e-4ca0-a027-6e658f1209f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:34.055762 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f39bb97-4a1e-4ca0-a027-6e658f1209f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:34.057749 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f39bb97-4a1e-4ca0-a027-6e658f1209f6 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:34.068969 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 964/1897] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:34.073591 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a419a-52ca-43e7-ac82-c4454de5af48 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:34.084387 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a419a-52ca-43e7-ac82-c4454de5af48 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:34.090269 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b356f7-c962-45c7-b08e-00115ecca383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:34.091301 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b356f7-c962-45c7-b08e-00115ecca383 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:34.091639 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b356f7-c962-45c7-b08e-00115ecca383 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:34.092129 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b356f7-c962-45c7-b08e-00115ecca383 admin admin] PATH_INFO: `/v3/projects/5a30c1027ac346c0b00a5b6f976b3586/users/39ffd9f21cb0491aa8fb3996abc73314/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:34.107612 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b356f7-c962-45c7-b08e-00115ecca383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a30c1027ac346c0b00a5b6f976b3586, user_id=39ffd9f21cb0491aa8fb3996abc73314, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:34.110271 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b356f7-c962-45c7-b08e-00115ecca383 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:34.125781 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 934/1898] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:05:34 2022] PUT /identity/v3/projects/5a30c1027ac346c0b00a5b6f976b3586/users/39ffd9f21cb0491aa8fb3996abc73314/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:34.129785 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39bb97-4a1e-4ca0-a027-6e658f1209f6 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:34.140181 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39bb97-4a1e-4ca0-a027-6e658f1209f6 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:34.197671 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64927f5-4381-4c47-998e-303d7e081089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:34.198339 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64927f5-4381-4c47-998e-303d7e081089 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:34.198612 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64927f5-4381-4c47-998e-303d7e081089 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:34.198876 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64927f5-4381-4c47-998e-303d7e081089 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:34.199627 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64927f5-4381-4c47-998e-303d7e081089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:34.201728 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64927f5-4381-4c47-998e-303d7e081089 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:34.211938 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 965/1899] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:34.216203 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b356f7-c962-45c7-b08e-00115ecca383 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:34.226737 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b356f7-c962-45c7-b08e-00115ecca383 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:34.232865 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012234c-6b6e-46e6-9e69-e1080f5d7585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:34.233978 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012234c-6b6e-46e6-9e69-e1080f5d7585 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:34.242511 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012234c-6b6e-46e6-9e69-e1080f5d7585 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:34.242844 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012234c-6b6e-46e6-9e69-e1080f5d7585 admin admin] PATH_INFO: `/v3/projects/5a30c1027ac346c0b00a5b6f976b3586/users/39ffd9f21cb0491aa8fb3996abc73314/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:34.253040 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a012234c-6b6e-46e6-9e69-e1080f5d7585 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a30c1027ac346c0b00a5b6f976b3586, user_id=39ffd9f21cb0491aa8fb3996abc73314, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:34.255801 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a012234c-6b6e-46e6-9e69-e1080f5d7585 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:34.267990 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 935/1900] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:05:34 2022] PUT /identity/v3/projects/5a30c1027ac346c0b00a5b6f976b3586/users/39ffd9f21cb0491aa8fb3996abc73314/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:05:34.278246 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b52c60-a1ce-4fad-bcef-578faca06fcd None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:34.278533 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b52c60-a1ce-4fad-bcef-578faca06fcd None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:34.278808 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b52c60-a1ce-4fad-bcef-578faca06fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:34.312298 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-84b52c60-a1ce-4fad-bcef-578faca06fcd None None] MFA Rules not processed for user `39ffd9f21cb0491aa8fb3996abc73314`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:34.313579 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-84b52c60-a1ce-4fad-bcef-578faca06fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:34.400936 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 966/1901] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:34 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:34.411677 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012234c-6b6e-46e6-9e69-e1080f5d7585 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:34.413417 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-a012234c-6b6e-46e6-9e69-e1080f5d7585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:34.476394 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012234c-6b6e-46e6-9e69-e1080f5d7585 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:34.480727 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e8f49-4a70-42bb-895d-7d9fc754e7b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:34.481438 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e8f49-4a70-42bb-895d-7d9fc754e7b3 service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:34.481743 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e8f49-4a70-42bb-895d-7d9fc754e7b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:34.482005 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e8f49-4a70-42bb-895d-7d9fc754e7b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:34.491749 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e8f49-4a70-42bb-895d-7d9fc754e7b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:34.493276 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e8f49-4a70-42bb-895d-7d9fc754e7b3 service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:34.503205 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 936/1902] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:05:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:05:34.646806 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b52c60-a1ce-4fad-bcef-578faca06fcd None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:34.657128 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b52c60-a1ce-4fad-bcef-578faca06fcd None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:34.661330 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bdbf5-930e-45ff-9f39-25c6236cc8fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:34.662005 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bdbf5-930e-45ff-9f39-25c6236cc8fc service cinder] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:34.662448 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bdbf5-930e-45ff-9f39-25c6236cc8fc service cinder] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:34.662860 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bdbf5-930e-45ff-9f39-25c6236cc8fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:34.817122 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543bdbf5-930e-45ff-9f39-25c6236cc8fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:34.818637 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543bdbf5-930e-45ff-9f39-25c6236cc8fc service cinder] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:34.850592 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 967/1903] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:05:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:05:39.548031 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e8f49-4a70-42bb-895d-7d9fc754e7b3 service cinder] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:39.561680 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bdbf5-930e-45ff-9f39-25c6236cc8fc service cinder] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:39.564210 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-543bdbf5-930e-45ff-9f39-25c6236cc8fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:39.617227 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e8f49-4a70-42bb-895d-7d9fc754e7b3 service cinder] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:39.624489 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9fde1-4fd7-4585-b027-79ff8bc25b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:39.625723 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9fde1-4fd7-4585-b027-79ff8bc25b50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:39.626202 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9fde1-4fd7-4585-b027-79ff8bc25b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:39.626731 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9fde1-4fd7-4585-b027-79ff8bc25b50 admin admin] PATH_INFO: `/v3/users/30eb42fb29134f748603aa17536e04f2` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:39.628226 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9fde1-4fd7-4585-b027-79ff8bc25b50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30eb42fb29134f748603aa17536e04f2)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:39.630568 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9fde1-4fd7-4585-b027-79ff8bc25b50 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:39.646923 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bdbf5-930e-45ff-9f39-25c6236cc8fc service cinder] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:39.652490 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5b371-498c-4825-b61f-2d25545ae1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:39.653384 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5b371-498c-4825-b61f-2d25545ae1bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:39.653657 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5b371-498c-4825-b61f-2d25545ae1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:39.653925 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5b371-498c-4825-b61f-2d25545ae1bb admin admin] PATH_INFO: `/v3/users/e329bab1574e43d6b5c4651d706991f1` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:39.655461 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5b371-498c-4825-b61f-2d25545ae1bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e329bab1574e43d6b5c4651d706991f1)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:39.657061 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5b371-498c-4825-b61f-2d25545ae1bb admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:39.688061 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-80a9fde1-4fd7-4585-b027-79ff8bc25b50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30eb42fb29134f748603aa17536e04f2'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:39.688812 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-80a9fde1-4fd7-4585-b027-79ff8bc25b50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30eb42fb29134f748603aa17536e04f2'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:39.702961 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-80a9fde1-4fd7-4585-b027-79ff8bc25b50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30eb42fb29134f748603aa17536e04f2'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:39.703990 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-80a9fde1-4fd7-4585-b027-79ff8bc25b50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30eb42fb29134f748603aa17536e04f2'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:39.724522 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-80a9fde1-4fd7-4585-b027-79ff8bc25b50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30eb42fb29134f748603aa17536e04f2'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:39.724699 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-bae5b371-498c-4825-b61f-2d25545ae1bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e329bab1574e43d6b5c4651d706991f1'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:39.734417 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-bae5b371-498c-4825-b61f-2d25545ae1bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e329bab1574e43d6b5c4651d706991f1'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:39.735790 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-bae5b371-498c-4825-b61f-2d25545ae1bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e329bab1574e43d6b5c4651d706991f1'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:39.736550 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-bae5b371-498c-4825-b61f-2d25545ae1bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e329bab1574e43d6b5c4651d706991f1'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:39.756816 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 937/1904] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:05:39 2022] DELETE /identity/v3/users/30eb42fb29134f748603aa17536e04f2 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:39.757268 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-bae5b371-498c-4825-b61f-2d25545ae1bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e329bab1574e43d6b5c4651d706991f1'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:39.758263 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c2126-c6c2-4160-846a-7fd68ee23e08 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:39.758759 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c2126-c6c2-4160-846a-7fd68ee23e08 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:39.759409 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c2126-c6c2-4160-846a-7fd68ee23e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:39.778589 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 968/1905] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:05:39 2022] DELETE /identity/v3/users/e329bab1574e43d6b5c4651d706991f1 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:05:39.782981 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69db77-e3e1-4a4f-bfdc-a4ebcab8cc36 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:39.783366 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69db77-e3e1-4a4f-bfdc-a4ebcab8cc36 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:39.783745 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69db77-e3e1-4a4f-bfdc-a4ebcab8cc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:39.784225 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-4f7c2126-c6c2-4160-846a-7fd68ee23e08 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:39.785843 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-4f7c2126-c6c2-4160-846a-7fd68ee23e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:39.810134 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-1a69db77-e3e1-4a4f-bfdc-a4ebcab8cc36 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:39.811773 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-1a69db77-e3e1-4a4f-bfdc-a4ebcab8cc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:39.905179 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 938/1906] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:39.909809 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 969/1907] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:05:39.962047 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69db77-e3e1-4a4f-bfdc-a4ebcab8cc36 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:39.962457 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c2126-c6c2-4160-846a-7fd68ee23e08 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:39.970394 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-1a69db77-e3e1-4a4f-bfdc-a4ebcab8cc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:39.970632 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-4f7c2126-c6c2-4160-846a-7fd68ee23e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:40.178773 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c2126-c6c2-4160-846a-7fd68ee23e08 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:40.179542 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69db77-e3e1-4a4f-bfdc-a4ebcab8cc36 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:40.190072 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682a7da-604f-4f5f-bf30-0407e11d49ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:40.191044 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798623e-d17f-4d9f-8d2c-be5c09dd8192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:40.192702 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798623e-d17f-4d9f-8d2c-be5c09dd8192 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:40.193075 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682a7da-604f-4f5f-bf30-0407e11d49ae service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:40.194090 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798623e-d17f-4d9f-8d2c-be5c09dd8192 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:40.194380 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682a7da-604f-4f5f-bf30-0407e11d49ae service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:40.195290 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798623e-d17f-4d9f-8d2c-be5c09dd8192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:40.195484 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682a7da-604f-4f5f-bf30-0407e11d49ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:40.226590 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682a7da-604f-4f5f-bf30-0407e11d49ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:40.227145 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798623e-d17f-4d9f-8d2c-be5c09dd8192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:40.231110 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682a7da-604f-4f5f-bf30-0407e11d49ae service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:40.231971 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798623e-d17f-4d9f-8d2c-be5c09dd8192 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:40.271659 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 970/1908] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:05:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:05:40.271976 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 939/1909] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:05:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:05:41.103982 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798623e-d17f-4d9f-8d2c-be5c09dd8192 service neutron] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:41.108768 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-e798623e-d17f-4d9f-8d2c-be5c09dd8192 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:41.109821 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682a7da-604f-4f5f-bf30-0407e11d49ae service neutron] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:41.111449 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-5682a7da-604f-4f5f-bf30-0407e11d49ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:41.161347 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682a7da-604f-4f5f-bf30-0407e11d49ae service neutron] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:41.161549 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798623e-d17f-4d9f-8d2c-be5c09dd8192 service neutron] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:41.168652 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31614273-024d-45ff-9a67-c459e29ddaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:41.169553 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31614273-024d-45ff-9a67-c459e29ddaed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:41.169822 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31614273-024d-45ff-9a67-c459e29ddaed admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:41.170086 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31614273-024d-45ff-9a67-c459e29ddaed admin admin] PATH_INFO: `/v3/projects/90e06406c4564d89998e9b379f3bcbae` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:41.170660 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20af35-e9b8-4445-bfef-6a7ae5ab7a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:41.171264 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31614273-024d-45ff-9a67-c459e29ddaed admin admin] RBAC: Authorizing `identity:delete_project(project_id=90e06406c4564d89998e9b379f3bcbae)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:41.171887 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20af35-e9b8-4445-bfef-6a7ae5ab7a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:41.172169 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20af35-e9b8-4445-bfef-6a7ae5ab7a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:41.172444 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20af35-e9b8-4445-bfef-6a7ae5ab7a00 admin admin] PATH_INFO: `/v3/projects/e0d4221fd7d949558d0c859ec4503b31` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:41.173224 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31614273-024d-45ff-9a67-c459e29ddaed admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:41.173639 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20af35-e9b8-4445-bfef-6a7ae5ab7a00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0d4221fd7d949558d0c859ec4503b31)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:41.176626 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20af35-e9b8-4445-bfef-6a7ae5ab7a00 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:41.224837 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-31614273-024d-45ff-9a67-c459e29ddaed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90e06406c4564d89998e9b379f3bcbae', 'request_id': 'req-31614273-024d-45ff-9a67-c459e29ddaed'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:41.232593 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-ea20af35-e9b8-4445-bfef-6a7ae5ab7a00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0d4221fd7d949558d0c859ec4503b31', 'request_id': 'req-ea20af35-e9b8-4445-bfef-6a7ae5ab7a00'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:41.234248 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-31614273-024d-45ff-9a67-c459e29ddaed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90e06406c4564d89998e9b379f3bcbae', 'request_id': 'req-31614273-024d-45ff-9a67-c459e29ddaed'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:41.241220 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-ea20af35-e9b8-4445-bfef-6a7ae5ab7a00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0d4221fd7d949558d0c859ec4503b31', 'request_id': 'req-ea20af35-e9b8-4445-bfef-6a7ae5ab7a00'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:41.242554 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-31614273-024d-45ff-9a67-c459e29ddaed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90e06406c4564d89998e9b379f3bcbae', 'request_id': 'req-31614273-024d-45ff-9a67-c459e29ddaed'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:41.250868 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-ea20af35-e9b8-4445-bfef-6a7ae5ab7a00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0d4221fd7d949558d0c859ec4503b31', 'request_id': 'req-ea20af35-e9b8-4445-bfef-6a7ae5ab7a00'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:41.253082 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-31614273-024d-45ff-9a67-c459e29ddaed admin admin] The token cache is being invalidate because project 90e06406c4564d89998e9b379f3bcbae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:05:41.253579 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-31614273-024d-45ff-9a67-c459e29ddaed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:41.254400 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-31614273-024d-45ff-9a67-c459e29ddaed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:41.256478 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 971/1910] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:05:41 2022] DELETE /identity/v3/projects/90e06406c4564d89998e9b379f3bcbae => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:41.261257 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31614273-024d-45ff-9a67-c459e29ddaed admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:41.262781 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-ea20af35-e9b8-4445-bfef-6a7ae5ab7a00 admin admin] The token cache is being invalidate because project e0d4221fd7d949558d0c859ec4503b31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:05:41.263046 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-31614273-024d-45ff-9a67-c459e29ddaed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:41.263154 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-ea20af35-e9b8-4445-bfef-6a7ae5ab7a00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:41.263917 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-ea20af35-e9b8-4445-bfef-6a7ae5ab7a00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:41.267806 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 940/1911] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:05:41 2022] DELETE /identity/v3/projects/e0d4221fd7d949558d0c859ec4503b31 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:05:41.269420 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20af35-e9b8-4445-bfef-6a7ae5ab7a00 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:41.271605 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-ea20af35-e9b8-4445-bfef-6a7ae5ab7a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:41.336134 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31614273-024d-45ff-9a67-c459e29ddaed admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:41.341919 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7a883-5f08-4973-ab9f-b38fff0c793d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:41.343085 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7a883-5f08-4973-ab9f-b38fff0c793d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:41.343362 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7a883-5f08-4973-ab9f-b38fff0c793d admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:41.343459 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20af35-e9b8-4445-bfef-6a7ae5ab7a00 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:41.343630 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7a883-5f08-4973-ab9f-b38fff0c793d admin admin] PATH_INFO: `/v3/users/39ffd9f21cb0491aa8fb3996abc73314` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:41.344886 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c7a883-5f08-4973-ab9f-b38fff0c793d admin admin] RBAC: Authorizing `identity:delete_user(user_id=39ffd9f21cb0491aa8fb3996abc73314)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:41.346854 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c7a883-5f08-4973-ab9f-b38fff0c793d admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:41.349091 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704d810-56b7-4265-886c-97f03181ff77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:41.350014 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704d810-56b7-4265-886c-97f03181ff77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:41.350284 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704d810-56b7-4265-886c-97f03181ff77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:41.350626 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704d810-56b7-4265-886c-97f03181ff77 admin admin] PATH_INFO: `/v3/users/5b6bc2e2ffc84881b5a4cb9050437ead` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:41.351998 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704d810-56b7-4265-886c-97f03181ff77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b6bc2e2ffc84881b5a4cb9050437ead)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:41.354197 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704d810-56b7-4265-886c-97f03181ff77 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:41.397948 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-61c7a883-5f08-4973-ab9f-b38fff0c793d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39ffd9f21cb0491aa8fb3996abc73314'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:41.402359 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-4704d810-56b7-4265-886c-97f03181ff77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b6bc2e2ffc84881b5a4cb9050437ead'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:41.403034 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-4704d810-56b7-4265-886c-97f03181ff77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b6bc2e2ffc84881b5a4cb9050437ead'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:41.404776 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-61c7a883-5f08-4973-ab9f-b38fff0c793d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39ffd9f21cb0491aa8fb3996abc73314'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:41.405678 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-61c7a883-5f08-4973-ab9f-b38fff0c793d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39ffd9f21cb0491aa8fb3996abc73314'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:41.406417 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-61c7a883-5f08-4973-ab9f-b38fff0c793d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39ffd9f21cb0491aa8fb3996abc73314'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:41.416623 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-4704d810-56b7-4265-886c-97f03181ff77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b6bc2e2ffc84881b5a4cb9050437ead'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:41.417743 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-4704d810-56b7-4265-886c-97f03181ff77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b6bc2e2ffc84881b5a4cb9050437ead'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:41.419919 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-61c7a883-5f08-4973-ab9f-b38fff0c793d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39ffd9f21cb0491aa8fb3996abc73314'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:41.425043 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-4704d810-56b7-4265-886c-97f03181ff77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b6bc2e2ffc84881b5a4cb9050437ead'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:41.437524 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 972/1912] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:05:41 2022] DELETE /identity/v3/users/39ffd9f21cb0491aa8fb3996abc73314 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:41.445506 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 941/1913] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:05:41 2022] DELETE /identity/v3/users/5b6bc2e2ffc84881b5a4cb9050437ead => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:41.888083 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7a883-5f08-4973-ab9f-b38fff0c793d admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:41.889694 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-61c7a883-5f08-4973-ab9f-b38fff0c793d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:41.928343 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704d810-56b7-4265-886c-97f03181ff77 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:41.930320 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-4704d810-56b7-4265-886c-97f03181ff77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:41.995811 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7a883-5f08-4973-ab9f-b38fff0c793d admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:42.028757 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704d810-56b7-4265-886c-97f03181ff77 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:42.034086 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ffe5f-fb1e-4074-b3b5-ee9806213fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:42.036321 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ffe5f-fb1e-4074-b3b5-ee9806213fec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:42.037363 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ffe5f-fb1e-4074-b3b5-ee9806213fec admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:42.037637 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ffe5f-fb1e-4074-b3b5-ee9806213fec admin admin] PATH_INFO: `/v3/projects/5a30c1027ac346c0b00a5b6f976b3586` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:42.038943 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ffe5f-fb1e-4074-b3b5-ee9806213fec admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a30c1027ac346c0b00a5b6f976b3586)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:42.040962 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ffe5f-fb1e-4074-b3b5-ee9806213fec admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:42.050339 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3648fa-591e-47c2-84dc-2f437824c9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:42.051223 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3648fa-591e-47c2-84dc-2f437824c9dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:42.051502 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3648fa-591e-47c2-84dc-2f437824c9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:42.051796 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3648fa-591e-47c2-84dc-2f437824c9dd admin admin] PATH_INFO: `/v3/projects/a66448ee992f4376a6afc444c8d1df9a` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:42.052990 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3648fa-591e-47c2-84dc-2f437824c9dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a66448ee992f4376a6afc444c8d1df9a)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:42.054925 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3648fa-591e-47c2-84dc-2f437824c9dd admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:42.093108 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3d5ffe5f-fb1e-4074-b3b5-ee9806213fec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a30c1027ac346c0b00a5b6f976b3586', 'request_id': 'req-3d5ffe5f-fb1e-4074-b3b5-ee9806213fec'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:42.102585 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3d5ffe5f-fb1e-4074-b3b5-ee9806213fec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a30c1027ac346c0b00a5b6f976b3586', 'request_id': 'req-3d5ffe5f-fb1e-4074-b3b5-ee9806213fec'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:42.107150 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-cf3648fa-591e-47c2-84dc-2f437824c9dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a66448ee992f4376a6afc444c8d1df9a', 'request_id': 'req-cf3648fa-591e-47c2-84dc-2f437824c9dd'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:42.110600 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3d5ffe5f-fb1e-4074-b3b5-ee9806213fec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a30c1027ac346c0b00a5b6f976b3586', 'request_id': 'req-3d5ffe5f-fb1e-4074-b3b5-ee9806213fec'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:42.116223 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-cf3648fa-591e-47c2-84dc-2f437824c9dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a66448ee992f4376a6afc444c8d1df9a', 'request_id': 'req-cf3648fa-591e-47c2-84dc-2f437824c9dd'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:42.123235 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-cf3648fa-591e-47c2-84dc-2f437824c9dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a66448ee992f4376a6afc444c8d1df9a', 'request_id': 'req-cf3648fa-591e-47c2-84dc-2f437824c9dd'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:42.123560 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3d5ffe5f-fb1e-4074-b3b5-ee9806213fec admin admin] The token cache is being invalidate because project 5a30c1027ac346c0b00a5b6f976b3586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:05:42.124045 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3d5ffe5f-fb1e-4074-b3b5-ee9806213fec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:42.124775 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3d5ffe5f-fb1e-4074-b3b5-ee9806213fec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:42.126372 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 942/1914] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:05:41 2022] DELETE /identity/v3/projects/5a30c1027ac346c0b00a5b6f976b3586 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:05:42.131045 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bddbc-ecc0-42f4-8d6c-8858f09469fe None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:42.131392 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bddbc-ecc0-42f4-8d6c-8858f09469fe None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:42.131606 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bddbc-ecc0-42f4-8d6c-8858f09469fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:42.133923 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-cf3648fa-591e-47c2-84dc-2f437824c9dd admin admin] The token cache is being invalidate because project a66448ee992f4376a6afc444c8d1df9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:05:42.134235 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-cf3648fa-591e-47c2-84dc-2f437824c9dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:42.135049 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-cf3648fa-591e-47c2-84dc-2f437824c9dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:42.136645 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 973/1915] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:05:41 2022] DELETE /identity/v3/projects/a66448ee992f4376a6afc444c8d1df9a => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:42.141317 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b778a-b40a-4d68-953f-43be310addb7 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:42.141596 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b778a-b40a-4d68-953f-43be310addb7 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:42.141868 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b778a-b40a-4d68-953f-43be310addb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:42.149374 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-c07bddbc-ecc0-42f4-8d6c-8858f09469fe None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:42.150758 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-c07bddbc-ecc0-42f4-8d6c-8858f09469fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:42.159387 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-282b778a-b40a-4d68-953f-43be310addb7 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:42.160568 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-282b778a-b40a-4d68-953f-43be310addb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:42.210028 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 943/1916] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:05:42.216978 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 974/1917] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:05:42.218210 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70360c1d-9fce-4702-b6ec-913fd24eff96 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:42.218491 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70360c1d-9fce-4702-b6ec-913fd24eff96 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:42.218761 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70360c1d-9fce-4702-b6ec-913fd24eff96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:42.224690 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14fe55-1faf-4e2c-8420-2d8ab7d6c1e0 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:42.225206 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14fe55-1faf-4e2c-8420-2d8ab7d6c1e0 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:42.225483 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14fe55-1faf-4e2c-8420-2d8ab7d6c1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:42.236636 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-70360c1d-9fce-4702-b6ec-913fd24eff96 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:42.238327 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-70360c1d-9fce-4702-b6ec-913fd24eff96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:42.243904 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-6f14fe55-1faf-4e2c-8420-2d8ab7d6c1e0 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:42.245191 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-6f14fe55-1faf-4e2c-8420-2d8ab7d6c1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:42.246780 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 944/1918] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:05:42.250927 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70360c1d-9fce-4702-b6ec-913fd24eff96 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:42.254018 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 975/1919] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:42.258010 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14fe55-1faf-4e2c-8420-2d8ab7d6c1e0 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:42.260266 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70360c1d-9fce-4702-b6ec-913fd24eff96 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:42.264864 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c2280-0937-467d-a584-ef836f0f6ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:42.265514 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c2280-0937-467d-a584-ef836f0f6ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:42.265791 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c2280-0937-467d-a584-ef836f0f6ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:42.266065 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c2280-0937-467d-a584-ef836f0f6ec2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:42.266770 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c2280-0937-467d-a584-ef836f0f6ec2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:05:42.266939 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14fe55-1faf-4e2c-8420-2d8ab7d6c1e0 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:42.267058 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c2280-0937-467d-a584-ef836f0f6ec2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:42.268691 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c2280-0937-467d-a584-ef836f0f6ec2 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:42.271801 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51be25-8731-4816-9f0e-ded024dcb253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:42.272438 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51be25-8731-4816-9f0e-ded024dcb253 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:42.272707 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51be25-8731-4816-9f0e-ded024dcb253 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:42.272975 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51be25-8731-4816-9f0e-ded024dcb253 admin admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:42.273684 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51be25-8731-4816-9f0e-ded024dcb253 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:05:42.273981 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51be25-8731-4816-9f0e-ded024dcb253 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:42.275601 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51be25-8731-4816-9f0e-ded024dcb253 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:42.280330 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 945/1920] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 03:05:42.284486 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c2280-0937-467d-a584-ef836f0f6ec2 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:42.291425 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 976/1921] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 03:05:42.292502 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51be25-8731-4816-9f0e-ded024dcb253 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:42.293979 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c2280-0937-467d-a584-ef836f0f6ec2 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:42.298509 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75c076-790b-45e9-8c0e-a97028b3bb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:42.299172 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75c076-790b-45e9-8c0e-a97028b3bb99 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:42.299444 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75c076-790b-45e9-8c0e-a97028b3bb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:42.299708 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75c076-790b-45e9-8c0e-a97028b3bb99 admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:42.300402 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75c076-790b-45e9-8c0e-a97028b3bb99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:42.301825 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51be25-8731-4816-9f0e-ded024dcb253 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:42.302288 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75c076-790b-45e9-8c0e-a97028b3bb99 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:42.306632 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27d7c1-695c-4c19-917f-8d9deed08d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:42.307313 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27d7c1-695c-4c19-917f-8d9deed08d56 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:42.307587 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27d7c1-695c-4c19-917f-8d9deed08d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:42.307886 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27d7c1-695c-4c19-917f-8d9deed08d56 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:42.308565 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27d7c1-695c-4c19-917f-8d9deed08d56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:42.310437 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27d7c1-695c-4c19-917f-8d9deed08d56 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:42.333314 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 946/1922] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:05:42 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 03:05:42.334423 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75c076-790b-45e9-8c0e-a97028b3bb99 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:42.339074 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 977/1923] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:05:42 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 03:05:42.343174 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27d7c1-695c-4c19-917f-8d9deed08d56 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:42.394855 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75c076-790b-45e9-8c0e-a97028b3bb99 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:42.399472 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ac09d-549e-4ffd-a43d-2f03a15dabd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:42.400233 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ac09d-549e-4ffd-a43d-2f03a15dabd5 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:42.400509 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ac09d-549e-4ffd-a43d-2f03a15dabd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:42.400838 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ac09d-549e-4ffd-a43d-2f03a15dabd5 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:42.401457 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ac09d-549e-4ffd-a43d-2f03a15dabd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:42.403405 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ac09d-549e-4ffd-a43d-2f03a15dabd5 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:42.403497 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27d7c1-695c-4c19-917f-8d9deed08d56 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:42.408369 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742ffc6-496a-40c6-8c36-bf86633ac958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:42.409036 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742ffc6-496a-40c6-8c36-bf86633ac958 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:42.409312 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742ffc6-496a-40c6-8c36-bf86633ac958 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:42.409577 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742ffc6-496a-40c6-8c36-bf86633ac958 admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:42.410258 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1742ffc6-496a-40c6-8c36-bf86633ac958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:42.412190 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1742ffc6-496a-40c6-8c36-bf86633ac958 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:42.424643 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 947/1924] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:05:42 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:42.428826 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ac09d-549e-4ffd-a43d-2f03a15dabd5 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:42.439625 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 978/1925] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:05:42 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 03:05:42.439804 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ac09d-549e-4ffd-a43d-2f03a15dabd5 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:42.440782 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742ffc6-496a-40c6-8c36-bf86633ac958 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:42.444525 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65827e0e-bd1a-450a-9c3e-5698a2b395bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:42.445183 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65827e0e-bd1a-450a-9c3e-5698a2b395bf admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:42.445454 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65827e0e-bd1a-450a-9c3e-5698a2b395bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:42.445719 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65827e0e-bd1a-450a-9c3e-5698a2b395bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:42.446418 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65827e0e-bd1a-450a-9c3e-5698a2b395bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:42.448216 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65827e0e-bd1a-450a-9c3e-5698a2b395bf admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:42.450909 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742ffc6-496a-40c6-8c36-bf86633ac958 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:42.455523 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d78d4a-40a5-445d-bc7b-4cb7939e71eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:42.456201 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d78d4a-40a5-445d-bc7b-4cb7939e71eb admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:42.456478 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d78d4a-40a5-445d-bc7b-4cb7939e71eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:42.456772 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d78d4a-40a5-445d-bc7b-4cb7939e71eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:42.457495 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d78d4a-40a5-445d-bc7b-4cb7939e71eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:42.458850 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 948/1926] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:05:42.459082 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d78d4a-40a5-445d-bc7b-4cb7939e71eb admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:42.462944 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65827e0e-bd1a-450a-9c3e-5698a2b395bf admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:42.471113 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 979/1927] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:42.477051 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65827e0e-bd1a-450a-9c3e-5698a2b395bf admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:42.479461 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d78d4a-40a5-445d-bc7b-4cb7939e71eb admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:42.483672 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58dcb27-1173-4fe1-b930-2a76ac47d8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:42.484392 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58dcb27-1173-4fe1-b930-2a76ac47d8d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:42.484717 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58dcb27-1173-4fe1-b930-2a76ac47d8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:42.484989 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58dcb27-1173-4fe1-b930-2a76ac47d8d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:42.485711 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58dcb27-1173-4fe1-b930-2a76ac47d8d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:42.487326 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58dcb27-1173-4fe1-b930-2a76ac47d8d3 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:42.489884 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d78d4a-40a5-445d-bc7b-4cb7939e71eb admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:42.496088 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252d68d-6d23-41fd-82b6-e6657fbc7e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:42.497056 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252d68d-6d23-41fd-82b6-e6657fbc7e6a admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:42.497394 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252d68d-6d23-41fd-82b6-e6657fbc7e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:42.497728 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252d68d-6d23-41fd-82b6-e6657fbc7e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:42.498587 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252d68d-6d23-41fd-82b6-e6657fbc7e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:42.498702 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 949/1928] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:42.500290 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252d68d-6d23-41fd-82b6-e6657fbc7e6a admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:42.504783 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58dcb27-1173-4fe1-b930-2a76ac47d8d3 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:42.512225 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 980/1929] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:42.516289 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252d68d-6d23-41fd-82b6-e6657fbc7e6a admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:42.517128 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58dcb27-1173-4fe1-b930-2a76ac47d8d3 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:42.525477 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33495c42-5aa1-4850-87c7-06e6727a41e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:42.526523 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33495c42-5aa1-4850-87c7-06e6727a41e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:42.526791 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33495c42-5aa1-4850-87c7-06e6727a41e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:42.527054 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33495c42-5aa1-4850-87c7-06e6727a41e8 admin admin] PATH_INFO: `/v3/projects/458d061024f2422f9ee4d77009a83a70/users/30ba81fb028b49258c79c84295099d30/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:42.531003 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252d68d-6d23-41fd-82b6-e6657fbc7e6a admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:42.535638 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8264548-00f5-4ecb-9cf5-180f6969c0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:42.536541 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8264548-00f5-4ecb-9cf5-180f6969c0e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:42.536824 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8264548-00f5-4ecb-9cf5-180f6969c0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:42.537090 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8264548-00f5-4ecb-9cf5-180f6969c0e4 admin admin] PATH_INFO: `/v3/projects/b390e17947474058816639a03ca3bac2/users/84e1525d46c2415aa790d41002c066ed/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:42.541628 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33495c42-5aa1-4850-87c7-06e6727a41e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=458d061024f2422f9ee4d77009a83a70, user_id=30ba81fb028b49258c79c84295099d30, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:42.544473 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33495c42-5aa1-4850-87c7-06e6727a41e8 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:42.551635 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8264548-00f5-4ecb-9cf5-180f6969c0e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b390e17947474058816639a03ca3bac2, user_id=84e1525d46c2415aa790d41002c066ed, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:42.554349 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8264548-00f5-4ecb-9cf5-180f6969c0e4 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:42.557868 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 950/1930] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:05:42 2022] PUT /identity/v3/projects/458d061024f2422f9ee4d77009a83a70/users/30ba81fb028b49258c79c84295099d30/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:42.569360 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 981/1931] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:05:42 2022] PUT /identity/v3/projects/b390e17947474058816639a03ca3bac2/users/84e1525d46c2415aa790d41002c066ed/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:05:42.570299 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc53fc5-c9e5-417f-8d9f-55c99060e643 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:42.570578 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc53fc5-c9e5-417f-8d9f-55c99060e643 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:42.570847 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc53fc5-c9e5-417f-8d9f-55c99060e643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:42.581165 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed984040-e462-461a-a685-58fff68dd55c None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:42.581448 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed984040-e462-461a-a685-58fff68dd55c None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:42.581743 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed984040-e462-461a-a685-58fff68dd55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:42.597116 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-7fc53fc5-c9e5-417f-8d9f-55c99060e643 None None] MFA Rules not processed for user `30ba81fb028b49258c79c84295099d30`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:42.598288 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-7fc53fc5-c9e5-417f-8d9f-55c99060e643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:42.609466 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-ed984040-e462-461a-a685-58fff68dd55c None None] MFA Rules not processed for user `84e1525d46c2415aa790d41002c066ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:42.610647 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-ed984040-e462-461a-a685-58fff68dd55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:42.659894 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 951/1932] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:05:42.670702 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc53fc5-c9e5-417f-8d9f-55c99060e643 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:42.672107 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-7fc53fc5-c9e5-417f-8d9f-55c99060e643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:42.672630 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 982/1933] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:42.683341 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed984040-e462-461a-a685-58fff68dd55c None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:42.684717 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-ed984040-e462-461a-a685-58fff68dd55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:42.727911 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc53fc5-c9e5-417f-8d9f-55c99060e643 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:42.731855 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec105f-9f81-4db9-b391-6072f209a068 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:42.732498 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec105f-9f81-4db9-b391-6072f209a068 service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:42.732769 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec105f-9f81-4db9-b391-6072f209a068 service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:42.733117 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec105f-9f81-4db9-b391-6072f209a068 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:42.739171 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed984040-e462-461a-a685-58fff68dd55c None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:42.741658 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec105f-9f81-4db9-b391-6072f209a068 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:42.743060 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec105f-9f81-4db9-b391-6072f209a068 service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:42.743165 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba6b19-a246-4536-8ca7-3c63f36ae301 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a6cffa8af470388d4b063c3c49849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:42.743852 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba6b19-a246-4536-8ca7-3c63f36ae301 service glance] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:42.744136 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba6b19-a246-4536-8ca7-3c63f36ae301 service glance] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:42.744409 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba6b19-a246-4536-8ca7-3c63f36ae301 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:42.752635 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 952/1934] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:05:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 03:05:42.753710 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba6b19-a246-4536-8ca7-3c63f36ae301 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:42.755427 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba6b19-a246-4536-8ca7-3c63f36ae301 service glance] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:42.766055 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 983/1935] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:05:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 03:05:54.682606 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec105f-9f81-4db9-b391-6072f209a068 service cinder] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:54.757865 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec105f-9f81-4db9-b391-6072f209a068 service cinder] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:54.777312 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd263ed-93df-47f5-8707-34559a92e4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:54.778328 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd263ed-93df-47f5-8707-34559a92e4aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:54.778671 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd263ed-93df-47f5-8707-34559a92e4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:54.779068 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd263ed-93df-47f5-8707-34559a92e4aa admin admin] PATH_INFO: `/v3/users/30ba81fb028b49258c79c84295099d30` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:54.782211 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd263ed-93df-47f5-8707-34559a92e4aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=30ba81fb028b49258c79c84295099d30)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:54.805296 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd263ed-93df-47f5-8707-34559a92e4aa admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:54.916300 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-bcd263ed-93df-47f5-8707-34559a92e4aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30ba81fb028b49258c79c84295099d30'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:54.917051 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-bcd263ed-93df-47f5-8707-34559a92e4aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30ba81fb028b49258c79c84295099d30'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:54.942603 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-bcd263ed-93df-47f5-8707-34559a92e4aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30ba81fb028b49258c79c84295099d30'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:54.943623 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-bcd263ed-93df-47f5-8707-34559a92e4aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30ba81fb028b49258c79c84295099d30'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:54.954434 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-bcd263ed-93df-47f5-8707-34559a92e4aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30ba81fb028b49258c79c84295099d30'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:54.983758 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 953/1936] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:05:54 2022] DELETE /identity/v3/users/30ba81fb028b49258c79c84295099d30 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:54.990676 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75739eda-ad8e-4791-b540-4becdeda2232 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:54.992874 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75739eda-ad8e-4791-b540-4becdeda2232 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:54.993173 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75739eda-ad8e-4791-b540-4becdeda2232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:55.053810 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-75739eda-ad8e-4791-b540-4becdeda2232 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:55.055526 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-75739eda-ad8e-4791-b540-4becdeda2232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:55.205002 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 984/1937] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:05:55.222954 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd263ed-93df-47f5-8707-34559a92e4aa admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:55.228152 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-bcd263ed-93df-47f5-8707-34559a92e4aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:55.308524 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd263ed-93df-47f5-8707-34559a92e4aa admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:55.312453 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60730c09-fb06-4b05-8854-7345c4e4350a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:55.312847 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60730c09-fb06-4b05-8854-7345c4e4350a service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:55.313162 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60730c09-fb06-4b05-8854-7345c4e4350a service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:55.313389 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60730c09-fb06-4b05-8854-7345c4e4350a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:55.327602 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60730c09-fb06-4b05-8854-7345c4e4350a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:55.329986 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60730c09-fb06-4b05-8854-7345c4e4350a service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:55.343141 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 954/1938] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:05:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:05:55.770785 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75739eda-ad8e-4791-b540-4becdeda2232 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:55.772508 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-75739eda-ad8e-4791-b540-4becdeda2232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:55.786164 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75739eda-ad8e-4791-b540-4becdeda2232 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:55.791912 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f4707-db72-4527-bddb-9fb791a8731a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:55.792854 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f4707-db72-4527-bddb-9fb791a8731a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:55.793125 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f4707-db72-4527-bddb-9fb791a8731a admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:55.793398 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f4707-db72-4527-bddb-9fb791a8731a admin admin] PATH_INFO: `/v3/projects/458d061024f2422f9ee4d77009a83a70` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:55.794592 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f4707-db72-4527-bddb-9fb791a8731a admin admin] RBAC: Authorizing `identity:delete_project(project_id=458d061024f2422f9ee4d77009a83a70)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:55.797965 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f4707-db72-4527-bddb-9fb791a8731a admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:55.856460 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-912f4707-db72-4527-bddb-9fb791a8731a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '458d061024f2422f9ee4d77009a83a70', 'request_id': 'req-912f4707-db72-4527-bddb-9fb791a8731a'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:55.865046 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-912f4707-db72-4527-bddb-9fb791a8731a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '458d061024f2422f9ee4d77009a83a70', 'request_id': 'req-912f4707-db72-4527-bddb-9fb791a8731a'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:55.871236 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-912f4707-db72-4527-bddb-9fb791a8731a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '458d061024f2422f9ee4d77009a83a70', 'request_id': 'req-912f4707-db72-4527-bddb-9fb791a8731a'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:55.881159 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-912f4707-db72-4527-bddb-9fb791a8731a admin admin] The token cache is being invalidate because project 458d061024f2422f9ee4d77009a83a70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:05:55.881379 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-912f4707-db72-4527-bddb-9fb791a8731a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:55.882015 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-912f4707-db72-4527-bddb-9fb791a8731a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:05:55.883587 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 985/1939] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:05:55 2022] DELETE /identity/v3/projects/458d061024f2422f9ee4d77009a83a70 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:55.889009 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c5e45-45bf-4026-82e7-cf8bc2cec527 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:55.889651 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c5e45-45bf-4026-82e7-cf8bc2cec527 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:55.889651 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c5e45-45bf-4026-82e7-cf8bc2cec527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:55.907675 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-305c5e45-45bf-4026-82e7-cf8bc2cec527 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:55.908943 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-305c5e45-45bf-4026-82e7-cf8bc2cec527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:55.968282 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 955/1940] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:55.975813 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d16dd-6135-4741-ad77-1d010702e4c5 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:55.976205 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d16dd-6135-4741-ad77-1d010702e4c5 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:55.976368 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d16dd-6135-4741-ad77-1d010702e4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:55.996773 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-f23d16dd-6135-4741-ad77-1d010702e4c5 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:55.997942 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-f23d16dd-6135-4741-ad77-1d010702e4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:56.005933 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 986/1941] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:56.010322 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c5e45-45bf-4026-82e7-cf8bc2cec527 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:56.020329 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c5e45-45bf-4026-82e7-cf8bc2cec527 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:56.024946 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17fdff-4086-4c55-8200-054073c6c42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:56.025601 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17fdff-4086-4c55-8200-054073c6c42f admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:56.025876 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17fdff-4086-4c55-8200-054073c6c42f admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:56.026144 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17fdff-4086-4c55-8200-054073c6c42f admin admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:56.026864 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17fdff-4086-4c55-8200-054073c6c42f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:05:56.027166 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17fdff-4086-4c55-8200-054073c6c42f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:56.028896 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17fdff-4086-4c55-8200-054073c6c42f admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:56.041799 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 956/1942] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 03:05:56.046517 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d16dd-6135-4741-ad77-1d010702e4c5 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:56.056677 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d16dd-6135-4741-ad77-1d010702e4c5 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:56.061914 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57f7a1-d4f0-41ff-adc5-99225b7dd00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:56.062567 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57f7a1-d4f0-41ff-adc5-99225b7dd00b admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:56.062841 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57f7a1-d4f0-41ff-adc5-99225b7dd00b admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:56.063085 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57f7a1-d4f0-41ff-adc5-99225b7dd00b admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:56.063929 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e57f7a1-d4f0-41ff-adc5-99225b7dd00b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:56.065912 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e57f7a1-d4f0-41ff-adc5-99225b7dd00b admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:56.098827 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 987/1943] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:05:56 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:56.100032 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17fdff-4086-4c55-8200-054073c6c42f admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:56.110406 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17fdff-4086-4c55-8200-054073c6c42f admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:56.168409 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217fa1b-9f75-4df8-8492-1e96293ffb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:56.169094 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217fa1b-9f75-4df8-8492-1e96293ffb41 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:56.169380 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217fa1b-9f75-4df8-8492-1e96293ffb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:56.169649 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217fa1b-9f75-4df8-8492-1e96293ffb41 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:56.170405 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217fa1b-9f75-4df8-8492-1e96293ffb41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:56.172798 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217fa1b-9f75-4df8-8492-1e96293ffb41 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:56.198526 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 957/1944] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:05:56 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:56.203310 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57f7a1-d4f0-41ff-adc5-99225b7dd00b admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:56.215897 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57f7a1-d4f0-41ff-adc5-99225b7dd00b admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:56.220677 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e978839-1a4f-40c5-aa07-ebaa94b1feea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:56.221370 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e978839-1a4f-40c5-aa07-ebaa94b1feea admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:56.221642 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e978839-1a4f-40c5-aa07-ebaa94b1feea admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:56.221901 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e978839-1a4f-40c5-aa07-ebaa94b1feea admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:56.222626 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e978839-1a4f-40c5-aa07-ebaa94b1feea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:56.224243 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e978839-1a4f-40c5-aa07-ebaa94b1feea admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:56.234820 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 988/1945] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:56.238853 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217fa1b-9f75-4df8-8492-1e96293ffb41 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:56.248747 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217fa1b-9f75-4df8-8492-1e96293ffb41 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:56.257348 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223f1c9-0048-4913-8d2b-05d1d5c0714d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:56.258448 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223f1c9-0048-4913-8d2b-05d1d5c0714d admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:56.258788 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223f1c9-0048-4913-8d2b-05d1d5c0714d admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:56.259167 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223f1c9-0048-4913-8d2b-05d1d5c0714d admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:56.260225 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223f1c9-0048-4913-8d2b-05d1d5c0714d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:56.262757 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223f1c9-0048-4913-8d2b-05d1d5c0714d admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:56.276897 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 958/1946] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:56.282663 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e978839-1a4f-40c5-aa07-ebaa94b1feea admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:56.292875 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e978839-1a4f-40c5-aa07-ebaa94b1feea admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:56.298751 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6ced1-ff35-4388-8420-0ef2154aa324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:56.299625 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6ced1-ff35-4388-8420-0ef2154aa324 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:56.299940 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6ced1-ff35-4388-8420-0ef2154aa324 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:56.300180 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6ced1-ff35-4388-8420-0ef2154aa324 admin admin] PATH_INFO: `/v3/projects/e636eec82d564d38825d4e25b4bdb32c/users/57772f7d377c483b9f6cc67790f08ccf/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:56.316188 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6ced1-ff35-4388-8420-0ef2154aa324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e636eec82d564d38825d4e25b4bdb32c, user_id=57772f7d377c483b9f6cc67790f08ccf, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:56.318871 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6ced1-ff35-4388-8420-0ef2154aa324 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:56.335970 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 989/1947] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:05:56 2022] PUT /identity/v3/projects/e636eec82d564d38825d4e25b4bdb32c/users/57772f7d377c483b9f6cc67790f08ccf/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:05:56.347775 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3549b1-b16b-49ce-ae77-85473f0dcb1d None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:56.348081 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3549b1-b16b-49ce-ae77-85473f0dcb1d None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:56.348350 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3549b1-b16b-49ce-ae77-85473f0dcb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:56.375374 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-2e3549b1-b16b-49ce-ae77-85473f0dcb1d None None] MFA Rules not processed for user `57772f7d377c483b9f6cc67790f08ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:56.376603 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-2e3549b1-b16b-49ce-ae77-85473f0dcb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:56.444189 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 959/1948] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:56.448614 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6ced1-ff35-4388-8420-0ef2154aa324 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:56.521504 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6ced1-ff35-4388-8420-0ef2154aa324 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:56.526351 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256a1d0-6000-48ea-9df6-31a478e84dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:56.527047 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256a1d0-6000-48ea-9df6-31a478e84dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:56.527330 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256a1d0-6000-48ea-9df6-31a478e84dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:56.527604 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256a1d0-6000-48ea-9df6-31a478e84dc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:56.528341 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4256a1d0-6000-48ea-9df6-31a478e84dc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:56.530385 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4256a1d0-6000-48ea-9df6-31a478e84dc0 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:56.562562 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 990/1949] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:05:56 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 03:05:56.566745 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3549b1-b16b-49ce-ae77-85473f0dcb1d None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:56.579444 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3549b1-b16b-49ce-ae77-85473f0dcb1d None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:56.640468 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef41d32-fa9c-4d97-98fe-638c9855dc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:56.641352 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef41d32-fa9c-4d97-98fe-638c9855dc15 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:56.641692 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef41d32-fa9c-4d97-98fe-638c9855dc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:56.641972 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef41d32-fa9c-4d97-98fe-638c9855dc15 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:56.642665 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef41d32-fa9c-4d97-98fe-638c9855dc15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:56.644956 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef41d32-fa9c-4d97-98fe-638c9855dc15 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:56.666157 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 960/1950] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:05:56 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:56.670024 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256a1d0-6000-48ea-9df6-31a478e84dc0 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:56.681743 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256a1d0-6000-48ea-9df6-31a478e84dc0 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:56.687611 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce228d-77d9-4475-98bd-f37d2c2cea99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:56.688344 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce228d-77d9-4475-98bd-f37d2c2cea99 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:56.688597 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce228d-77d9-4475-98bd-f37d2c2cea99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:56.688902 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce228d-77d9-4475-98bd-f37d2c2cea99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:56.689637 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce228d-77d9-4475-98bd-f37d2c2cea99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:56.691241 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce228d-77d9-4475-98bd-f37d2c2cea99 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:56.706219 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 991/1951] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:56.707508 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef41d32-fa9c-4d97-98fe-638c9855dc15 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:56.718091 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef41d32-fa9c-4d97-98fe-638c9855dc15 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:56.723081 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb14acc-80e7-4bec-a5ee-5997255e958a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:56.723813 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb14acc-80e7-4bec-a5ee-5997255e958a admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:56.724096 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb14acc-80e7-4bec-a5ee-5997255e958a admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:56.724356 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb14acc-80e7-4bec-a5ee-5997255e958a admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:56.725091 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb14acc-80e7-4bec-a5ee-5997255e958a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:56.726706 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb14acc-80e7-4bec-a5ee-5997255e958a admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:56.739969 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 961/1952] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:56.741882 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce228d-77d9-4475-98bd-f37d2c2cea99 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:56.752039 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce228d-77d9-4475-98bd-f37d2c2cea99 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:56.757233 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e7306-d5c8-49a0-a5b3-1c745bf316dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:56.758707 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e7306-d5c8-49a0-a5b3-1c745bf316dc admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:56.759096 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e7306-d5c8-49a0-a5b3-1c745bf316dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:56.759454 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e7306-d5c8-49a0-a5b3-1c745bf316dc admin admin] PATH_INFO: `/v3/projects/e1a0f09040ad4d7b9409801a76855b05/users/eb6b0f3b1bc743a9a21656e48ab72251/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:56.775910 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e7306-d5c8-49a0-a5b3-1c745bf316dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a0f09040ad4d7b9409801a76855b05, user_id=eb6b0f3b1bc743a9a21656e48ab72251, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:56.778575 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e7306-d5c8-49a0-a5b3-1c745bf316dc admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:56.796602 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 992/1953] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:05:56 2022] PUT /identity/v3/projects/e1a0f09040ad4d7b9409801a76855b05/users/eb6b0f3b1bc743a9a21656e48ab72251/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:56.807775 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81e719-8f21-4425-8967-3c85bd40bfe8 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:56.808104 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81e719-8f21-4425-8967-3c85bd40bfe8 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:56.808367 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81e719-8f21-4425-8967-3c85bd40bfe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:56.836231 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-7f81e719-8f21-4425-8967-3c85bd40bfe8 None None] MFA Rules not processed for user `eb6b0f3b1bc743a9a21656e48ab72251`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:56.837400 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-7f81e719-8f21-4425-8967-3c85bd40bfe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:56.910201 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 962/1954] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:56.914988 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e7306-d5c8-49a0-a5b3-1c745bf316dc admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:56.981864 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e7306-d5c8-49a0-a5b3-1c745bf316dc admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:56.987284 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2190f67-44ce-4cc7-8a08-8c5a9324d090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:56.988002 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2190f67-44ce-4cc7-8a08-8c5a9324d090 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:56.988279 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2190f67-44ce-4cc7-8a08-8c5a9324d090 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:56.988548 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2190f67-44ce-4cc7-8a08-8c5a9324d090 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:56.989234 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2190f67-44ce-4cc7-8a08-8c5a9324d090 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:56.991120 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2190f67-44ce-4cc7-8a08-8c5a9324d090 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:57.024393 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 993/1955] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:05:56 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:57.028551 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81e719-8f21-4425-8967-3c85bd40bfe8 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:57.039693 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81e719-8f21-4425-8967-3c85bd40bfe8 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:57.100642 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af3358-6236-47c1-85eb-5b911ebc6385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:57.100976 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af3358-6236-47c1-85eb-5b911ebc6385 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:57.101265 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af3358-6236-47c1-85eb-5b911ebc6385 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:57.101533 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af3358-6236-47c1-85eb-5b911ebc6385 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:57.102242 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af3358-6236-47c1-85eb-5b911ebc6385 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:57.104265 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af3358-6236-47c1-85eb-5b911ebc6385 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:57.124760 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 963/1956] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:05:57 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:05:57.128728 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2190f67-44ce-4cc7-8a08-8c5a9324d090 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:57.138804 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2190f67-44ce-4cc7-8a08-8c5a9324d090 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:57.143863 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee823717-b9fc-44a4-b67a-1baa514959ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:57.144512 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee823717-b9fc-44a4-b67a-1baa514959ba admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:57.144790 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee823717-b9fc-44a4-b67a-1baa514959ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:57.145058 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee823717-b9fc-44a4-b67a-1baa514959ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:57.145766 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee823717-b9fc-44a4-b67a-1baa514959ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:57.147350 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee823717-b9fc-44a4-b67a-1baa514959ba admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:57.157944 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 994/1957] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:57.162568 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af3358-6236-47c1-85eb-5b911ebc6385 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:57.179038 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af3358-6236-47c1-85eb-5b911ebc6385 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:57.187471 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf1279-4fbd-43ad-90e5-83e389520562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:57.188394 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf1279-4fbd-43ad-90e5-83e389520562 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:57.188658 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf1279-4fbd-43ad-90e5-83e389520562 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:57.188921 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf1279-4fbd-43ad-90e5-83e389520562 admin admin] PATH_INFO: `/v3/projects/839fcabfe1a347c9923309690593d147/users/435d5b8bbbef4d4e94f0eb37411e3681/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:57.207386 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf1279-4fbd-43ad-90e5-83e389520562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=839fcabfe1a347c9923309690593d147, user_id=435d5b8bbbef4d4e94f0eb37411e3681, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:57.210526 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf1279-4fbd-43ad-90e5-83e389520562 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:57.228384 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 964/1958] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:05:57 2022] PUT /identity/v3/projects/839fcabfe1a347c9923309690593d147/users/435d5b8bbbef4d4e94f0eb37411e3681/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:57.232476 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee823717-b9fc-44a4-b67a-1baa514959ba admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:57.242356 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee823717-b9fc-44a4-b67a-1baa514959ba admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:57.302248 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738f108-40c9-48f0-a884-d95da3694547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:57.302929 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738f108-40c9-48f0-a884-d95da3694547 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:57.303176 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738f108-40c9-48f0-a884-d95da3694547 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:57.303475 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738f108-40c9-48f0-a884-d95da3694547 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:57.307070 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738f108-40c9-48f0-a884-d95da3694547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:57.308972 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738f108-40c9-48f0-a884-d95da3694547 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:57.319361 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 995/1959] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:05:57.323778 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf1279-4fbd-43ad-90e5-83e389520562 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:57.335044 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf1279-4fbd-43ad-90e5-83e389520562 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:57.339843 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454aea3-78f5-4f43-a815-7b9ec28262a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:57.340768 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454aea3-78f5-4f43-a815-7b9ec28262a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:57.341087 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454aea3-78f5-4f43-a815-7b9ec28262a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:57.341490 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454aea3-78f5-4f43-a815-7b9ec28262a0 admin admin] PATH_INFO: `/v3/projects/839fcabfe1a347c9923309690593d147/users/435d5b8bbbef4d4e94f0eb37411e3681/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:57.343819 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454aea3-78f5-4f43-a815-7b9ec28262a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=839fcabfe1a347c9923309690593d147, user_id=435d5b8bbbef4d4e94f0eb37411e3681, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:57.346549 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454aea3-78f5-4f43-a815-7b9ec28262a0 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:57.356998 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 965/1960] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:05:57 2022] PUT /identity/v3/projects/839fcabfe1a347c9923309690593d147/users/435d5b8bbbef4d4e94f0eb37411e3681/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:05:57.367528 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0fb18-1298-4154-b339-5aa7fc7ab44d None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:57.367846 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0fb18-1298-4154-b339-5aa7fc7ab44d None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:57.368120 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0fb18-1298-4154-b339-5aa7fc7ab44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:57.394174 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-15b0fb18-1298-4154-b339-5aa7fc7ab44d None None] MFA Rules not processed for user `435d5b8bbbef4d4e94f0eb37411e3681`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:05:57.395378 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-15b0fb18-1298-4154-b339-5aa7fc7ab44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:57.460576 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 996/1961] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:05:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:05:57.472986 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454aea3-78f5-4f43-a815-7b9ec28262a0 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:05:57.474937 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-c454aea3-78f5-4f43-a815-7b9ec28262a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:05:57.538254 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454aea3-78f5-4f43-a815-7b9ec28262a0 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:05:57.542121 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f2319-5c8a-41ca-82a6-ae72908a8800 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:05:57.544391 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f2319-5c8a-41ca-82a6-ae72908a8800 service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:05:57.544391 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f2319-5c8a-41ca-82a6-ae72908a8800 service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:05:57.544391 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f2319-5c8a-41ca-82a6-ae72908a8800 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:05:57.599826 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f2319-5c8a-41ca-82a6-ae72908a8800 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:05:57.601279 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f2319-5c8a-41ca-82a6-ae72908a8800 service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:05:57.610351 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 966/1962] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:05:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:06:00.149684 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0fb18-1298-4154-b339-5aa7fc7ab44d None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:00.159303 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0fb18-1298-4154-b339-5aa7fc7ab44d None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:00.163182 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c66f0-d154-4764-a2ce-260141d371ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:00.163974 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c66f0-d154-4764-a2ce-260141d371ab service cinder] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:00.164335 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c66f0-d154-4764-a2ce-260141d371ab service cinder] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:00.164807 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c66f0-d154-4764-a2ce-260141d371ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:00.221631 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c66f0-d154-4764-a2ce-260141d371ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:00.223164 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c66f0-d154-4764-a2ce-260141d371ab service cinder] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:00.231869 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 997/1963] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:06:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:06:00.802368 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f2319-5c8a-41ca-82a6-ae72908a8800 service cinder] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:00.814399 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f2319-5c8a-41ca-82a6-ae72908a8800 service cinder] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:00.820442 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ba5c1-ff12-418b-b4f4-0633ec1fc96a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:00.821419 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ba5c1-ff12-418b-b4f4-0633ec1fc96a service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:00.822066 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ba5c1-ff12-418b-b4f4-0633ec1fc96a service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:00.822532 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ba5c1-ff12-418b-b4f4-0633ec1fc96a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:00.837198 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ba5c1-ff12-418b-b4f4-0633ec1fc96a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:00.839126 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ba5c1-ff12-418b-b4f4-0633ec1fc96a service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:00.849898 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 967/1964] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:06:00 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:06:03.294769 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c66f0-d154-4764-a2ce-260141d371ab service cinder] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:03.296823 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-d22c66f0-d154-4764-a2ce-260141d371ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:03.362310 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c66f0-d154-4764-a2ce-260141d371ab service cinder] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:03.367324 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a7d54-0784-4675-a2a1-0bf2eef97b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:03.368463 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a7d54-0784-4675-a2a1-0bf2eef97b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:03.368959 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a7d54-0784-4675-a2a1-0bf2eef97b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:03.377859 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a7d54-0784-4675-a2a1-0bf2eef97b29 admin admin] PATH_INFO: `/v3/users/43a69366717d47dc98aaf131b53de9da` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:03.379696 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a7d54-0784-4675-a2a1-0bf2eef97b29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43a69366717d47dc98aaf131b53de9da)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:03.380869 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a7d54-0784-4675-a2a1-0bf2eef97b29 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:03.437962 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-e30a7d54-0784-4675-a2a1-0bf2eef97b29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43a69366717d47dc98aaf131b53de9da'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:03.445112 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-e30a7d54-0784-4675-a2a1-0bf2eef97b29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43a69366717d47dc98aaf131b53de9da'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:03.445811 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-e30a7d54-0784-4675-a2a1-0bf2eef97b29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43a69366717d47dc98aaf131b53de9da'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:03.446411 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-e30a7d54-0784-4675-a2a1-0bf2eef97b29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43a69366717d47dc98aaf131b53de9da'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:03.461869 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-e30a7d54-0784-4675-a2a1-0bf2eef97b29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43a69366717d47dc98aaf131b53de9da'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:03.485266 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 998/1965] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:06:03 2022] DELETE /identity/v3/users/43a69366717d47dc98aaf131b53de9da => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:06:03.489796 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2f070-6d39-4025-a8ff-aeabf5b74abf None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:03.490270 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2f070-6d39-4025-a8ff-aeabf5b74abf None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:03.490444 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2f070-6d39-4025-a8ff-aeabf5b74abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:03.516889 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-c8e2f070-6d39-4025-a8ff-aeabf5b74abf None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:06:03.518338 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-c8e2f070-6d39-4025-a8ff-aeabf5b74abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:03.611904 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 968/1966] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:06:03.621465 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a7d54-0784-4675-a2a1-0bf2eef97b29 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:03.623404 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-e30a7d54-0784-4675-a2a1-0bf2eef97b29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:03.687226 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a7d54-0784-4675-a2a1-0bf2eef97b29 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:03.699051 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826575f5-aa77-4151-ba0b-0facef1ecb12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:03.699746 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826575f5-aa77-4151-ba0b-0facef1ecb12 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:03.700588 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826575f5-aa77-4151-ba0b-0facef1ecb12 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:03.700862 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826575f5-aa77-4151-ba0b-0facef1ecb12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:03.719547 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826575f5-aa77-4151-ba0b-0facef1ecb12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:03.724203 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826575f5-aa77-4151-ba0b-0facef1ecb12 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:03.752052 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 999/1967] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:06:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:06:04.058211 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2f070-6d39-4025-a8ff-aeabf5b74abf None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:04.059856 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-c8e2f070-6d39-4025-a8ff-aeabf5b74abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:04.081542 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2f070-6d39-4025-a8ff-aeabf5b74abf None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:04.099298 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bae57a-0686-4af2-bd59-904bb4dcc05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:04.100435 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bae57a-0686-4af2-bd59-904bb4dcc05d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:04.100707 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bae57a-0686-4af2-bd59-904bb4dcc05d admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:04.100977 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bae57a-0686-4af2-bd59-904bb4dcc05d admin admin] PATH_INFO: `/v3/projects/350d413574414300ae9cb2a4086e518e` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:04.102868 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bae57a-0686-4af2-bd59-904bb4dcc05d admin admin] RBAC: Authorizing `identity:delete_project(project_id=350d413574414300ae9cb2a4086e518e)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:04.104834 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bae57a-0686-4af2-bd59-904bb4dcc05d admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:04.153867 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-d8bae57a-0686-4af2-bd59-904bb4dcc05d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '350d413574414300ae9cb2a4086e518e', 'request_id': 'req-d8bae57a-0686-4af2-bd59-904bb4dcc05d'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:04.162626 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-d8bae57a-0686-4af2-bd59-904bb4dcc05d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '350d413574414300ae9cb2a4086e518e', 'request_id': 'req-d8bae57a-0686-4af2-bd59-904bb4dcc05d'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:04.168956 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-d8bae57a-0686-4af2-bd59-904bb4dcc05d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '350d413574414300ae9cb2a4086e518e', 'request_id': 'req-d8bae57a-0686-4af2-bd59-904bb4dcc05d'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:04.179619 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-d8bae57a-0686-4af2-bd59-904bb4dcc05d admin admin] The token cache is being invalidate because project 350d413574414300ae9cb2a4086e518e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:06:04.179943 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-d8bae57a-0686-4af2-bd59-904bb4dcc05d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:04.180572 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-d8bae57a-0686-4af2-bd59-904bb4dcc05d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:04.182093 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 969/1968] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:06:04 2022] DELETE /identity/v3/projects/350d413574414300ae9cb2a4086e518e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:06:04.186187 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826575f5-aa77-4151-ba0b-0facef1ecb12 service neutron] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:04.196389 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826575f5-aa77-4151-ba0b-0facef1ecb12 service neutron] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:04.258233 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a4bba-8c13-45e6-93a9-8d012531b8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:04.258972 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a4bba-8c13-45e6-93a9-8d012531b8c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:04.259272 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a4bba-8c13-45e6-93a9-8d012531b8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:04.259547 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a4bba-8c13-45e6-93a9-8d012531b8c3 admin admin] PATH_INFO: `/v3/users/bd421f3ef89a4390a7a7035fbd710bff` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:04.260834 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990a4bba-8c13-45e6-93a9-8d012531b8c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd421f3ef89a4390a7a7035fbd710bff)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:04.262856 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990a4bba-8c13-45e6-93a9-8d012531b8c3 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:04.310795 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-990a4bba-8c13-45e6-93a9-8d012531b8c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd421f3ef89a4390a7a7035fbd710bff'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:04.321581 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-990a4bba-8c13-45e6-93a9-8d012531b8c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd421f3ef89a4390a7a7035fbd710bff'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:04.322417 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-990a4bba-8c13-45e6-93a9-8d012531b8c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd421f3ef89a4390a7a7035fbd710bff'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:04.323199 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-990a4bba-8c13-45e6-93a9-8d012531b8c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd421f3ef89a4390a7a7035fbd710bff'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:04.337714 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-990a4bba-8c13-45e6-93a9-8d012531b8c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd421f3ef89a4390a7a7035fbd710bff'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:04.352555 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1000/1969] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:06:04 2022] DELETE /identity/v3/users/bd421f3ef89a4390a7a7035fbd710bff => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:06:04.885339 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bae57a-0686-4af2-bd59-904bb4dcc05d admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:04.886835 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-d8bae57a-0686-4af2-bd59-904bb4dcc05d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:04.913041 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bae57a-0686-4af2-bd59-904bb4dcc05d admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:04.929954 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a4bba-8c13-45e6-93a9-8d012531b8c3 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:04.931470 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-990a4bba-8c13-45e6-93a9-8d012531b8c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:05.056990 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d72388-34b5-4146-9585-7a4fefa4cce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:05.057438 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a4bba-8c13-45e6-93a9-8d012531b8c3 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:05.058398 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d72388-34b5-4146-9585-7a4fefa4cce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:05.058968 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d72388-34b5-4146-9585-7a4fefa4cce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:05.059434 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d72388-34b5-4146-9585-7a4fefa4cce6 admin admin] PATH_INFO: `/v3/projects/d26968553346437cb9159bf079d0f7de` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:05.061021 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d72388-34b5-4146-9585-7a4fefa4cce6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d26968553346437cb9159bf079d0f7de)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:05.063229 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d72388-34b5-4146-9585-7a4fefa4cce6 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:05.076238 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8e1a5-e2bb-491f-80b7-58ed56964b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:05.077385 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8e1a5-e2bb-491f-80b7-58ed56964b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:05.077731 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8e1a5-e2bb-491f-80b7-58ed56964b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:05.078076 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8e1a5-e2bb-491f-80b7-58ed56964b84 admin admin] PATH_INFO: `/v3/users/57772f7d377c483b9f6cc67790f08ccf` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:05.080107 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8e1a5-e2bb-491f-80b7-58ed56964b84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57772f7d377c483b9f6cc67790f08ccf)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:05.082345 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8e1a5-e2bb-491f-80b7-58ed56964b84 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:05.180147 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-93d72388-34b5-4146-9585-7a4fefa4cce6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd26968553346437cb9159bf079d0f7de', 'request_id': 'req-93d72388-34b5-4146-9585-7a4fefa4cce6'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:05.189132 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-93d72388-34b5-4146-9585-7a4fefa4cce6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd26968553346437cb9159bf079d0f7de', 'request_id': 'req-93d72388-34b5-4146-9585-7a4fefa4cce6'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:05.198508 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-93d72388-34b5-4146-9585-7a4fefa4cce6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd26968553346437cb9159bf079d0f7de', 'request_id': 'req-93d72388-34b5-4146-9585-7a4fefa4cce6'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:05.211812 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-93d72388-34b5-4146-9585-7a4fefa4cce6 admin admin] The token cache is being invalidate because project d26968553346437cb9159bf079d0f7de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:06:05.212190 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-93d72388-34b5-4146-9585-7a4fefa4cce6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:05.213062 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-93d72388-34b5-4146-9585-7a4fefa4cce6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:05.215419 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 970/1970] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:06:04 2022] DELETE /identity/v3/projects/d26968553346437cb9159bf079d0f7de => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:06:05.220205 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1993c-cfe5-4d24-94d3-1027a953dccc None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:05.220568 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1993c-cfe5-4d24-94d3-1027a953dccc None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:05.220907 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1993c-cfe5-4d24-94d3-1027a953dccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:05.231822 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-2be8e1a5-e2bb-491f-80b7-58ed56964b84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57772f7d377c483b9f6cc67790f08ccf'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:05.254827 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-2be8e1a5-e2bb-491f-80b7-58ed56964b84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57772f7d377c483b9f6cc67790f08ccf'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:05.256185 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-2be8e1a5-e2bb-491f-80b7-58ed56964b84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57772f7d377c483b9f6cc67790f08ccf'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:05.257767 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-2be8e1a5-e2bb-491f-80b7-58ed56964b84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57772f7d377c483b9f6cc67790f08ccf'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:05.260248 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-27f1993c-cfe5-4d24-94d3-1027a953dccc None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:06:05.265005 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-27f1993c-cfe5-4d24-94d3-1027a953dccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:05.295942 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-2be8e1a5-e2bb-491f-80b7-58ed56964b84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57772f7d377c483b9f6cc67790f08ccf'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:05.319453 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1001/1971] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:06:04 2022] DELETE /identity/v3/users/57772f7d377c483b9f6cc67790f08ccf => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:06:05.324349 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a54733-f0e6-4e59-a6b9-9fc94eb08c9d None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:05.324800 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a54733-f0e6-4e59-a6b9-9fc94eb08c9d None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:05.326601 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a54733-f0e6-4e59-a6b9-9fc94eb08c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:05.357775 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 971/1972] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:06:05.361323 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16254f54-946a-496d-8191-a32e7a08d20f None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:05.361684 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16254f54-946a-496d-8191-a32e7a08d20f None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:05.362025 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16254f54-946a-496d-8191-a32e7a08d20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:05.365329 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-00a54733-f0e6-4e59-a6b9-9fc94eb08c9d None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:06:05.366738 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-00a54733-f0e6-4e59-a6b9-9fc94eb08c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:05.390557 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-16254f54-946a-496d-8191-a32e7a08d20f None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:06:05.391792 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-16254f54-946a-496d-8191-a32e7a08d20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:05.452427 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1002/1973] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:06:05.460083 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 972/1974] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:06:05.464349 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a54733-f0e6-4e59-a6b9-9fc94eb08c9d None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:05.464584 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16254f54-946a-496d-8191-a32e7a08d20f None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:05.465846 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-16254f54-946a-496d-8191-a32e7a08d20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:05.479118 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a54733-f0e6-4e59-a6b9-9fc94eb08c9d None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:05.486156 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc1a1d-473e-4480-bfa0-605e6177a50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:05.487202 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc1a1d-473e-4480-bfa0-605e6177a50d admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:05.487702 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc1a1d-473e-4480-bfa0-605e6177a50d admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:05.488249 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc1a1d-473e-4480-bfa0-605e6177a50d admin admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:05.489079 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc1a1d-473e-4480-bfa0-605e6177a50d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:06:05.489481 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc1a1d-473e-4480-bfa0-605e6177a50d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:05.491693 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc1a1d-473e-4480-bfa0-605e6177a50d admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:05.507793 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1003/1975] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:06:05.510351 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc1a1d-473e-4480-bfa0-605e6177a50d admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:05.529893 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc1a1d-473e-4480-bfa0-605e6177a50d admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:05.536912 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa09c8b-62c3-4555-8136-3590dae3d147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:05.537897 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa09c8b-62c3-4555-8136-3590dae3d147 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:05.538450 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa09c8b-62c3-4555-8136-3590dae3d147 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:05.538929 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa09c8b-62c3-4555-8136-3590dae3d147 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:05.539362 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16254f54-946a-496d-8191-a32e7a08d20f None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:05.540112 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa09c8b-62c3-4555-8136-3590dae3d147 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:05.542602 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa09c8b-62c3-4555-8136-3590dae3d147 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:05.543587 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4785c6d-84c7-4b6a-a212-fea48f62ca27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:05.544275 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4785c6d-84c7-4b6a-a212-fea48f62ca27 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:05.544549 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4785c6d-84c7-4b6a-a212-fea48f62ca27 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:05.544814 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4785c6d-84c7-4b6a-a212-fea48f62ca27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:05.557042 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4785c6d-84c7-4b6a-a212-fea48f62ca27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:05.558874 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4785c6d-84c7-4b6a-a212-fea48f62ca27 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:05.571447 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 973/1976] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:06:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:06:05.606233 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1004/1977] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:06:05 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:06:05.610273 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4785c6d-84c7-4b6a-a212-fea48f62ca27 service neutron] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:05.624207 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4785c6d-84c7-4b6a-a212-fea48f62ca27 service neutron] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:05.691082 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378d799-a2bc-4473-b640-685a4c6bf08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:05.691794 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378d799-a2bc-4473-b640-685a4c6bf08e admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:05.692066 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378d799-a2bc-4473-b640-685a4c6bf08e admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:05.692329 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378d799-a2bc-4473-b640-685a4c6bf08e admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:05.693029 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378d799-a2bc-4473-b640-685a4c6bf08e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:05.695074 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378d799-a2bc-4473-b640-685a4c6bf08e admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:05.723413 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa09c8b-62c3-4555-8136-3590dae3d147 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:05.723965 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 974/1978] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:06:05 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:06:05.733821 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa09c8b-62c3-4555-8136-3590dae3d147 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:05.738733 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4610e-ef5e-4c94-969c-e13ee8e6d498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:05.739400 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4610e-ef5e-4c94-969c-e13ee8e6d498 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:05.739673 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4610e-ef5e-4c94-969c-e13ee8e6d498 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:05.739968 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4610e-ef5e-4c94-969c-e13ee8e6d498 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:05.740690 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4610e-ef5e-4c94-969c-e13ee8e6d498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:05.742269 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4610e-ef5e-4c94-969c-e13ee8e6d498 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:05.752949 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1005/1979] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:06:05.757028 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378d799-a2bc-4473-b640-685a4c6bf08e admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:05.767862 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378d799-a2bc-4473-b640-685a4c6bf08e admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:05.773930 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438824e-984d-4407-87f1-b40dee00a6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:05.774807 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438824e-984d-4407-87f1-b40dee00a6fc admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:05.775149 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438824e-984d-4407-87f1-b40dee00a6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:05.775478 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438824e-984d-4407-87f1-b40dee00a6fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:05.776742 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438824e-984d-4407-87f1-b40dee00a6fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:05.778595 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438824e-984d-4407-87f1-b40dee00a6fc admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:05.789362 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 975/1980] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:06:05.793547 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4610e-ef5e-4c94-969c-e13ee8e6d498 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:05.809220 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4610e-ef5e-4c94-969c-e13ee8e6d498 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:05.815157 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa02fd2-c71c-45b5-a4f0-3142c646cd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:05.816411 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa02fd2-c71c-45b5-a4f0-3142c646cd04 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:05.817183 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa02fd2-c71c-45b5-a4f0-3142c646cd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:05.817656 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa02fd2-c71c-45b5-a4f0-3142c646cd04 admin admin] PATH_INFO: `/v3/projects/2f720e218b9a4428b65c5528a54188da/users/e0d44f3311b146508cafaa4cb8b8dec3/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:05.835159 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa02fd2-c71c-45b5-a4f0-3142c646cd04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f720e218b9a4428b65c5528a54188da, user_id=e0d44f3311b146508cafaa4cb8b8dec3, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:05.838452 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa02fd2-c71c-45b5-a4f0-3142c646cd04 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:05.853577 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1006/1981] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:06:05 2022] PUT /identity/v3/projects/2f720e218b9a4428b65c5528a54188da/users/e0d44f3311b146508cafaa4cb8b8dec3/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:06:05.865364 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10079f6-22ec-473a-aa82-71af87c9e770 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:05.865835 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10079f6-22ec-473a-aa82-71af87c9e770 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:05.866274 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10079f6-22ec-473a-aa82-71af87c9e770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:05.898302 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-c10079f6-22ec-473a-aa82-71af87c9e770 None None] MFA Rules not processed for user `e0d44f3311b146508cafaa4cb8b8dec3`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:06:05.898908 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa02fd2-c71c-45b5-a4f0-3142c646cd04 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:05.899504 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-c10079f6-22ec-473a-aa82-71af87c9e770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:05.902281 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-9aa02fd2-c71c-45b5-a4f0-3142c646cd04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:05.970624 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 976/1982] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:06:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:06:05.975327 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10079f6-22ec-473a-aa82-71af87c9e770 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:05.975563 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa02fd2-c71c-45b5-a4f0-3142c646cd04 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:05.980248 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dbd203-1ebc-44a9-bc9f-27eb0695f0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:05.981286 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbd203-1ebc-44a9-bc9f-27eb0695f0bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:05.981563 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbd203-1ebc-44a9-bc9f-27eb0695f0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:05.981833 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbd203-1ebc-44a9-bc9f-27eb0695f0bb admin admin] PATH_INFO: `/v3/projects/e636eec82d564d38825d4e25b4bdb32c` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:05.983067 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dbd203-1ebc-44a9-bc9f-27eb0695f0bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e636eec82d564d38825d4e25b4bdb32c)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:05.985120 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dbd203-1ebc-44a9-bc9f-27eb0695f0bb admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:05.987318 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10079f6-22ec-473a-aa82-71af87c9e770 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:05.992289 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb6d73-09e6-4820-9bf1-0cbfc6dd5b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:05.993617 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb6d73-09e6-4820-9bf1-0cbfc6dd5b07 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:05.993959 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb6d73-09e6-4820-9bf1-0cbfc6dd5b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:05.994302 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb6d73-09e6-4820-9bf1-0cbfc6dd5b07 admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:05.994999 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb6d73-09e6-4820-9bf1-0cbfc6dd5b07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:05.997205 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb6d73-09e6-4820-9bf1-0cbfc6dd5b07 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:06.031433 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 977/1983] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:06:05 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:06:06.032895 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb6d73-09e6-4820-9bf1-0cbfc6dd5b07 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:06.035962 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-85dbd203-1ebc-44a9-bc9f-27eb0695f0bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e636eec82d564d38825d4e25b4bdb32c', 'request_id': 'req-85dbd203-1ebc-44a9-bc9f-27eb0695f0bb'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:06.045151 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-85dbd203-1ebc-44a9-bc9f-27eb0695f0bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e636eec82d564d38825d4e25b4bdb32c', 'request_id': 'req-85dbd203-1ebc-44a9-bc9f-27eb0695f0bb'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:06.054002 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-85dbd203-1ebc-44a9-bc9f-27eb0695f0bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e636eec82d564d38825d4e25b4bdb32c', 'request_id': 'req-85dbd203-1ebc-44a9-bc9f-27eb0695f0bb'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:06.066969 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-85dbd203-1ebc-44a9-bc9f-27eb0695f0bb admin admin] The token cache is being invalidate because project e636eec82d564d38825d4e25b4bdb32c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:06:06.067369 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-85dbd203-1ebc-44a9-bc9f-27eb0695f0bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:06.068192 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-85dbd203-1ebc-44a9-bc9f-27eb0695f0bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:06.070167 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1007/1984] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:06:05 2022] DELETE /identity/v3/projects/e636eec82d564d38825d4e25b4bdb32c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:06:06.074251 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dbd203-1ebc-44a9-bc9f-27eb0695f0bb admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:06.076299 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-85dbd203-1ebc-44a9-bc9f-27eb0695f0bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:06.105548 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb6d73-09e6-4820-9bf1-0cbfc6dd5b07 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:06.111976 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d5644-61ef-4299-8b29-9adde8b0598c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:06.112855 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d5644-61ef-4299-8b29-9adde8b0598c admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:06.113251 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d5644-61ef-4299-8b29-9adde8b0598c admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:06.113673 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d5644-61ef-4299-8b29-9adde8b0598c admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:06.114463 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d5644-61ef-4299-8b29-9adde8b0598c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:06.116536 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d5644-61ef-4299-8b29-9adde8b0598c admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:06.144963 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 978/1985] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:06:06 2022] POST /identity/v3/users => generated 298 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:06:06.146721 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d5644-61ef-4299-8b29-9adde8b0598c admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:06.148387 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dbd203-1ebc-44a9-bc9f-27eb0695f0bb admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:06.148705 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-e74d5644-61ef-4299-8b29-9adde8b0598c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:06.153848 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e425c-86db-4f6a-a13c-a251305552ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:06.155021 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e425c-86db-4f6a-a13c-a251305552ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:06.155715 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e425c-86db-4f6a-a13c-a251305552ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:06.156298 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e425c-86db-4f6a-a13c-a251305552ef admin admin] PATH_INFO: `/v3/users/eb6b0f3b1bc743a9a21656e48ab72251` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:06.157873 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e425c-86db-4f6a-a13c-a251305552ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb6b0f3b1bc743a9a21656e48ab72251)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:06.160277 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e425c-86db-4f6a-a13c-a251305552ef admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:06.162944 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d5644-61ef-4299-8b29-9adde8b0598c admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:06.168724 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84f3d4-f085-4580-9300-6f84d9f29d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:06.169420 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84f3d4-f085-4580-9300-6f84d9f29d3c admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:06.169724 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84f3d4-f085-4580-9300-6f84d9f29d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:06.170000 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84f3d4-f085-4580-9300-6f84d9f29d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:06.170746 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84f3d4-f085-4580-9300-6f84d9f29d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:06.172556 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84f3d4-f085-4580-9300-6f84d9f29d3c admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:06.186888 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 979/1986] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:06:06.186888 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84f3d4-f085-4580-9300-6f84d9f29d3c admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:06.186888 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-1d84f3d4-f085-4580-9300-6f84d9f29d3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:06.200989 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84f3d4-f085-4580-9300-6f84d9f29d3c admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:06.207611 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b37cf2-36cb-4983-83ec-24d03a1647ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:06.208825 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b37cf2-36cb-4983-83ec-24d03a1647ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:06.209118 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b37cf2-36cb-4983-83ec-24d03a1647ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:06.209393 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b37cf2-36cb-4983-83ec-24d03a1647ff admin admin] PATH_INFO: `/v3/users/84e1525d46c2415aa790d41002c066ed` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:06.210902 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b37cf2-36cb-4983-83ec-24d03a1647ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=84e1525d46c2415aa790d41002c066ed)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:06.220652 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b37cf2-36cb-4983-83ec-24d03a1647ff admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:06.227249 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-2a1e425c-86db-4f6a-a13c-a251305552ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb6b0f3b1bc743a9a21656e48ab72251'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:06.242676 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-2a1e425c-86db-4f6a-a13c-a251305552ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb6b0f3b1bc743a9a21656e48ab72251'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:06.243405 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-2a1e425c-86db-4f6a-a13c-a251305552ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb6b0f3b1bc743a9a21656e48ab72251'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:06.244046 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-2a1e425c-86db-4f6a-a13c-a251305552ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb6b0f3b1bc743a9a21656e48ab72251'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:06.261033 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-2a1e425c-86db-4f6a-a13c-a251305552ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb6b0f3b1bc743a9a21656e48ab72251'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:06.276734 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-83b37cf2-36cb-4983-83ec-24d03a1647ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84e1525d46c2415aa790d41002c066ed'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:06.277420 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-83b37cf2-36cb-4983-83ec-24d03a1647ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84e1525d46c2415aa790d41002c066ed'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:06.283605 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1008/1987] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:06:06 2022] DELETE /identity/v3/users/eb6b0f3b1bc743a9a21656e48ab72251 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:06:06.283605 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e425c-86db-4f6a-a13c-a251305552ef admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:06.284233 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-2a1e425c-86db-4f6a-a13c-a251305552ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:06.293431 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-83b37cf2-36cb-4983-83ec-24d03a1647ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84e1525d46c2415aa790d41002c066ed'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:06.294403 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-83b37cf2-36cb-4983-83ec-24d03a1647ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84e1525d46c2415aa790d41002c066ed'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:06.309963 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-83b37cf2-36cb-4983-83ec-24d03a1647ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84e1525d46c2415aa790d41002c066ed'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:06.328335 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 980/1988] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:06:06 2022] DELETE /identity/v3/users/84e1525d46c2415aa790d41002c066ed => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:06:06.334499 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d00eb4-4c35-4022-97de-a5f92eb14553 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:06.334850 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d00eb4-4c35-4022-97de-a5f92eb14553 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:06.335127 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d00eb4-4c35-4022-97de-a5f92eb14553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:06.356335 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-c2d00eb4-4c35-4022-97de-a5f92eb14553 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:06:06.357613 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-c2d00eb4-4c35-4022-97de-a5f92eb14553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:06.373551 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e425c-86db-4f6a-a13c-a251305552ef admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:06.447105 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 981/1989] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:06:06.461208 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea658389-c5df-413f-b753-18780fc5226b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:06.462272 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea658389-c5df-413f-b753-18780fc5226b admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:06.462610 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea658389-c5df-413f-b753-18780fc5226b admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:06.462956 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea658389-c5df-413f-b753-18780fc5226b admin admin] PATH_INFO: `/v3/projects/39f71ab94e294d548f316a63868c05b7/users/6be63ebf4cd44424b1ae7c1104b2c603/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:06.466744 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d00eb4-4c35-4022-97de-a5f92eb14553 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:06.468224 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-c2d00eb4-4c35-4022-97de-a5f92eb14553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:06.481219 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea658389-c5df-413f-b753-18780fc5226b admin admin] RBAC: Authorizing `identity:create_grant(project_id=39f71ab94e294d548f316a63868c05b7, user_id=6be63ebf4cd44424b1ae7c1104b2c603, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:06.484958 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea658389-c5df-413f-b753-18780fc5226b admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:06.504363 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1009/1990] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:06:06 2022] PUT /identity/v3/projects/39f71ab94e294d548f316a63868c05b7/users/6be63ebf4cd44424b1ae7c1104b2c603/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:06:06.508747 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea658389-c5df-413f-b753-18780fc5226b admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:06.511972 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-ea658389-c5df-413f-b753-18780fc5226b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:06.580350 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d00eb4-4c35-4022-97de-a5f92eb14553 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:06.600685 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea658389-c5df-413f-b753-18780fc5226b admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:06.609231 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a135c9b3-b4c6-4625-9549-149b718a4c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:06.610290 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135c9b3-b4c6-4625-9549-149b718a4c50 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:06.610656 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135c9b3-b4c6-4625-9549-149b718a4c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:06.611539 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135c9b3-b4c6-4625-9549-149b718a4c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:06.612438 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a135c9b3-b4c6-4625-9549-149b718a4c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:06.614808 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a135c9b3-b4c6-4625-9549-149b718a4c50 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:06.631763 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1010/1991] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:06:06.633225 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a135c9b3-b4c6-4625-9549-149b718a4c50 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:06.646541 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a135c9b3-b4c6-4625-9549-149b718a4c50 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:06.662803 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b3844-cbfb-4b65-8250-80b039b9035d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:06.663467 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b3844-cbfb-4b65-8250-80b039b9035d service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:06.663754 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b3844-cbfb-4b65-8250-80b039b9035d service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:06.664020 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b3844-cbfb-4b65-8250-80b039b9035d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:06.665565 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321df7cc-411c-49e7-bf84-50f82c46aa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:06.667636 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321df7cc-411c-49e7-bf84-50f82c46aa08 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:06.667636 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321df7cc-411c-49e7-bf84-50f82c46aa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:06.667845 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321df7cc-411c-49e7-bf84-50f82c46aa08 admin admin] PATH_INFO: `/v3/projects/39f71ab94e294d548f316a63868c05b7/users/6be63ebf4cd44424b1ae7c1104b2c603/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:06.672151 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321df7cc-411c-49e7-bf84-50f82c46aa08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39f71ab94e294d548f316a63868c05b7, user_id=6be63ebf4cd44424b1ae7c1104b2c603, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:06.683970 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321df7cc-411c-49e7-bf84-50f82c46aa08 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:06.684548 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b3844-cbfb-4b65-8250-80b039b9035d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:06.686014 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b3844-cbfb-4b65-8250-80b039b9035d service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:06.699960 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 982/1992] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:06:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 03:06:06.706346 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1011/1993] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:06:06 2022] PUT /identity/v3/projects/39f71ab94e294d548f316a63868c05b7/users/6be63ebf4cd44424b1ae7c1104b2c603/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:06:06.716686 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d31939-f2a5-4580-a156-44a556caf3db None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:06.716989 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d31939-f2a5-4580-a156-44a556caf3db None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:06.717499 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d31939-f2a5-4580-a156-44a556caf3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:06.765693 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-a3d31939-f2a5-4580-a156-44a556caf3db None None] MFA Rules not processed for user `6be63ebf4cd44424b1ae7c1104b2c603`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:06:06.768203 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-a3d31939-f2a5-4580-a156-44a556caf3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:06.770872 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321df7cc-411c-49e7-bf84-50f82c46aa08 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:06.772588 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-321df7cc-411c-49e7-bf84-50f82c46aa08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:06.901151 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 983/1994] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:06:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:06:06.901793 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321df7cc-411c-49e7-bf84-50f82c46aa08 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:06.908881 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d31939-f2a5-4580-a156-44a556caf3db None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:06.910267 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-a3d31939-f2a5-4580-a156-44a556caf3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:06.923315 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9dc47-ad64-4bbe-a2df-7030ef68079a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:06.925273 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9dc47-ad64-4bbe-a2df-7030ef68079a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:06.925923 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9dc47-ad64-4bbe-a2df-7030ef68079a admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:06.926262 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9dc47-ad64-4bbe-a2df-7030ef68079a admin admin] PATH_INFO: `/v3/projects/e1a0f09040ad4d7b9409801a76855b05` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:06.927631 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9dc47-ad64-4bbe-a2df-7030ef68079a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1a0f09040ad4d7b9409801a76855b05)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:06.929705 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9dc47-ad64-4bbe-a2df-7030ef68079a admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:06.986572 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d31939-f2a5-4580-a156-44a556caf3db None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:06.994102 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-19b9dc47-ad64-4bbe-a2df-7030ef68079a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1a0f09040ad4d7b9409801a76855b05', 'request_id': 'req-19b9dc47-ad64-4bbe-a2df-7030ef68079a'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:07.006022 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-19b9dc47-ad64-4bbe-a2df-7030ef68079a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1a0f09040ad4d7b9409801a76855b05', 'request_id': 'req-19b9dc47-ad64-4bbe-a2df-7030ef68079a'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:07.018676 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-19b9dc47-ad64-4bbe-a2df-7030ef68079a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1a0f09040ad4d7b9409801a76855b05', 'request_id': 'req-19b9dc47-ad64-4bbe-a2df-7030ef68079a'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:07.039467 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-19b9dc47-ad64-4bbe-a2df-7030ef68079a admin admin] The token cache is being invalidate because project e1a0f09040ad4d7b9409801a76855b05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:06:07.039765 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-19b9dc47-ad64-4bbe-a2df-7030ef68079a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:07.040458 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-19b9dc47-ad64-4bbe-a2df-7030ef68079a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:07.042498 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1012/1995] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:06:06 2022] DELETE /identity/v3/projects/e1a0f09040ad4d7b9409801a76855b05 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:06:07.046262 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9dc47-ad64-4bbe-a2df-7030ef68079a admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:07.047886 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-19b9dc47-ad64-4bbe-a2df-7030ef68079a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:07.059635 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90684a8-ed69-4a5b-8955-37a563ce33e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:07.060315 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90684a8-ed69-4a5b-8955-37a563ce33e4 service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:07.060588 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90684a8-ed69-4a5b-8955-37a563ce33e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:07.060852 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90684a8-ed69-4a5b-8955-37a563ce33e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:07.063251 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-c90684a8-ed69-4a5b-8955-37a563ce33e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:07.131941 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9dc47-ad64-4bbe-a2df-7030ef68079a admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:07.137863 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d684d1-7fc7-45d1-8d72-1cee1730a953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:07.139159 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d684d1-7fc7-45d1-8d72-1cee1730a953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:07.139439 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d684d1-7fc7-45d1-8d72-1cee1730a953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:07.139838 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d684d1-7fc7-45d1-8d72-1cee1730a953 admin admin] PATH_INFO: `/v3/users/435d5b8bbbef4d4e94f0eb37411e3681` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:07.141990 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d684d1-7fc7-45d1-8d72-1cee1730a953 admin admin] RBAC: Authorizing `identity:delete_user(user_id=435d5b8bbbef4d4e94f0eb37411e3681)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:07.144011 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d684d1-7fc7-45d1-8d72-1cee1730a953 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:07.188364 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90684a8-ed69-4a5b-8955-37a563ce33e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:07.191977 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90684a8-ed69-4a5b-8955-37a563ce33e4 service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:07.220276 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 984/1996] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:06:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 03:06:07.221988 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90684a8-ed69-4a5b-8955-37a563ce33e4 service cinder] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:07.223882 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-c90684a8-ed69-4a5b-8955-37a563ce33e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:07.241620 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-52d684d1-7fc7-45d1-8d72-1cee1730a953 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '435d5b8bbbef4d4e94f0eb37411e3681'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:07.254044 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90684a8-ed69-4a5b-8955-37a563ce33e4 service cinder] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:07.260337 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f49c84-eb1b-43ac-9904-78a7929c758f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:07.260995 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-52d684d1-7fc7-45d1-8d72-1cee1730a953 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '435d5b8bbbef4d4e94f0eb37411e3681'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:07.261271 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f49c84-eb1b-43ac-9904-78a7929c758f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:07.261557 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f49c84-eb1b-43ac-9904-78a7929c758f admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:07.261991 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f49c84-eb1b-43ac-9904-78a7929c758f admin admin] PATH_INFO: `/v3/projects/b390e17947474058816639a03ca3bac2` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:07.263200 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f49c84-eb1b-43ac-9904-78a7929c758f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b390e17947474058816639a03ca3bac2)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:07.265282 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f49c84-eb1b-43ac-9904-78a7929c758f admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:07.266166 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-52d684d1-7fc7-45d1-8d72-1cee1730a953 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '435d5b8bbbef4d4e94f0eb37411e3681'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:07.268428 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-52d684d1-7fc7-45d1-8d72-1cee1730a953 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '435d5b8bbbef4d4e94f0eb37411e3681'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:07.297633 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-52d684d1-7fc7-45d1-8d72-1cee1730a953 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '435d5b8bbbef4d4e94f0eb37411e3681'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:07.326068 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1013/1997] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:06:07 2022] DELETE /identity/v3/users/435d5b8bbbef4d4e94f0eb37411e3681 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:06:07.341050 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-94f49c84-eb1b-43ac-9904-78a7929c758f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b390e17947474058816639a03ca3bac2', 'request_id': 'req-94f49c84-eb1b-43ac-9904-78a7929c758f'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:07.352476 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-94f49c84-eb1b-43ac-9904-78a7929c758f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b390e17947474058816639a03ca3bac2', 'request_id': 'req-94f49c84-eb1b-43ac-9904-78a7929c758f'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:07.366355 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-94f49c84-eb1b-43ac-9904-78a7929c758f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b390e17947474058816639a03ca3bac2', 'request_id': 'req-94f49c84-eb1b-43ac-9904-78a7929c758f'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:07.388485 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-94f49c84-eb1b-43ac-9904-78a7929c758f admin admin] The token cache is being invalidate because project b390e17947474058816639a03ca3bac2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:06:07.388485 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-94f49c84-eb1b-43ac-9904-78a7929c758f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:07.389237 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-94f49c84-eb1b-43ac-9904-78a7929c758f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:07.391358 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 985/1998] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:06:07 2022] DELETE /identity/v3/projects/b390e17947474058816639a03ca3bac2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:06:07.398518 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf443f4-c39e-4c80-9aab-cb622531abf9 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:07.399052 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf443f4-c39e-4c80-9aab-cb622531abf9 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:07.399225 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf443f4-c39e-4c80-9aab-cb622531abf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:07.475066 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-7cf443f4-c39e-4c80-9aab-cb622531abf9 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:06:07.478970 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-7cf443f4-c39e-4c80-9aab-cb622531abf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:07.610300 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1014/1999] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:06:07.617854 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2ba91-82db-427c-bfe3-5cf316bd70a9 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:07.618193 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2ba91-82db-427c-bfe3-5cf316bd70a9 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:07.618538 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2ba91-82db-427c-bfe3-5cf316bd70a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:07.639237 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-eec2ba91-82db-427c-bfe3-5cf316bd70a9 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:06:07.642135 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-eec2ba91-82db-427c-bfe3-5cf316bd70a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:07.676471 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 986/2000] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:06:07.677000 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf443f4-c39e-4c80-9aab-cb622531abf9 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:07.694080 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf443f4-c39e-4c80-9aab-cb622531abf9 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:07.706680 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ebf06-3f49-4fc3-8dc8-c5c3937af3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:07.707491 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ebf06-3f49-4fc3-8dc8-c5c3937af3ff admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:07.707631 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ebf06-3f49-4fc3-8dc8-c5c3937af3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:07.708036 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ebf06-3f49-4fc3-8dc8-c5c3937af3ff admin admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:07.708691 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ebf06-3f49-4fc3-8dc8-c5c3937af3ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:06:07.708999 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ebf06-3f49-4fc3-8dc8-c5c3937af3ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:07.710599 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ebf06-3f49-4fc3-8dc8-c5c3937af3ff admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:07.740099 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1015/2001] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 03:06:07.744494 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2ba91-82db-427c-bfe3-5cf316bd70a9 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:07.754582 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2ba91-82db-427c-bfe3-5cf316bd70a9 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:07.760349 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dcf9a2-c636-47a4-ab5b-1e12a6554a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:07.761019 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dcf9a2-c636-47a4-ab5b-1e12a6554a13 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:07.761298 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dcf9a2-c636-47a4-ab5b-1e12a6554a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:07.761571 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dcf9a2-c636-47a4-ab5b-1e12a6554a13 admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:07.762309 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dcf9a2-c636-47a4-ab5b-1e12a6554a13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:07.764505 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dcf9a2-c636-47a4-ab5b-1e12a6554a13 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:07.808032 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ebf06-3f49-4fc3-8dc8-c5c3937af3ff admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:07.810485 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-b74ebf06-3f49-4fc3-8dc8-c5c3937af3ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:07.813269 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 987/2002] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:06:07 2022] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 03:06:07.816987 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dcf9a2-c636-47a4-ab5b-1e12a6554a13 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:07.835049 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ebf06-3f49-4fc3-8dc8-c5c3937af3ff admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:07.938767 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dcf9a2-c636-47a4-ab5b-1e12a6554a13 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:07.943906 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d1683-200b-432c-a084-eab1b9d50f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:07.944593 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d1683-200b-432c-a084-eab1b9d50f03 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:07.944871 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d1683-200b-432c-a084-eab1b9d50f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:07.945142 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d1683-200b-432c-a084-eab1b9d50f03 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:07.945832 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d1683-200b-432c-a084-eab1b9d50f03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:07.947796 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d1683-200b-432c-a084-eab1b9d50f03 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:07.951561 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e60bff-02ae-46d0-86f6-8fbb24e2df0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:07.952717 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e60bff-02ae-46d0-86f6-8fbb24e2df0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:07.952997 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e60bff-02ae-46d0-86f6-8fbb24e2df0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:07.953265 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e60bff-02ae-46d0-86f6-8fbb24e2df0a admin admin] PATH_INFO: `/v3/projects/839fcabfe1a347c9923309690593d147` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:07.965712 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e60bff-02ae-46d0-86f6-8fbb24e2df0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=839fcabfe1a347c9923309690593d147)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:07.967680 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e60bff-02ae-46d0-86f6-8fbb24e2df0a admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:07.982862 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 988/2003] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:06:07 2022] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 03:06:07.985668 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d1683-200b-432c-a084-eab1b9d50f03 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:08.006893 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d1683-200b-432c-a084-eab1b9d50f03 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:08.020295 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc95cd-992e-4d74-a693-3cfb15eb087b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:08.021199 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc95cd-992e-4d74-a693-3cfb15eb087b admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:08.021543 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc95cd-992e-4d74-a693-3cfb15eb087b admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:08.022036 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc95cd-992e-4d74-a693-3cfb15eb087b admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:08.022991 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc95cd-992e-4d74-a693-3cfb15eb087b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:08.025568 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc95cd-992e-4d74-a693-3cfb15eb087b admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:08.049366 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 989/2004] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:06:08.053461 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc95cd-992e-4d74-a693-3cfb15eb087b admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:08.072966 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc95cd-992e-4d74-a693-3cfb15eb087b admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:08.082292 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-f6e60bff-02ae-46d0-86f6-8fbb24e2df0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '839fcabfe1a347c9923309690593d147', 'request_id': 'req-f6e60bff-02ae-46d0-86f6-8fbb24e2df0a'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:08.094571 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-f6e60bff-02ae-46d0-86f6-8fbb24e2df0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '839fcabfe1a347c9923309690593d147', 'request_id': 'req-f6e60bff-02ae-46d0-86f6-8fbb24e2df0a'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:08.104876 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-f6e60bff-02ae-46d0-86f6-8fbb24e2df0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '839fcabfe1a347c9923309690593d147', 'request_id': 'req-f6e60bff-02ae-46d0-86f6-8fbb24e2df0a'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:08.116654 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-f6e60bff-02ae-46d0-86f6-8fbb24e2df0a admin admin] The token cache is being invalidate because project 839fcabfe1a347c9923309690593d147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:06:08.117006 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-f6e60bff-02ae-46d0-86f6-8fbb24e2df0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:08.117595 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-f6e60bff-02ae-46d0-86f6-8fbb24e2df0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:08.119773 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1016/2005] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:06:07 2022] DELETE /identity/v3/projects/839fcabfe1a347c9923309690593d147 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:06:08.125772 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f5feb-f847-45f0-ae9f-a964b8f92673 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:08.125772 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f5feb-f847-45f0-ae9f-a964b8f92673 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:08.125920 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f5feb-f847-45f0-ae9f-a964b8f92673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:08.158431 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025bf2a-f1c4-4223-9199-e01bdda9eeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:08.159434 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025bf2a-f1c4-4223-9199-e01bdda9eeb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:08.159709 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025bf2a-f1c4-4223-9199-e01bdda9eeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:08.160005 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025bf2a-f1c4-4223-9199-e01bdda9eeb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:08.160822 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0025bf2a-f1c4-4223-9199-e01bdda9eeb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:08.161136 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-9c5f5feb-f847-45f0-ae9f-a964b8f92673 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:06:08.162454 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0025bf2a-f1c4-4223-9199-e01bdda9eeb3 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:08.163376 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-9c5f5feb-f847-45f0-ae9f-a964b8f92673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:08.182919 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1017/2006] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:06:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:06:08.184676 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2fb3d-e814-4d40-bee7-7ea57b569a1f None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:08.185032 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2fb3d-e814-4d40-bee7-7ea57b569a1f None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:08.185402 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2fb3d-e814-4d40-bee7-7ea57b569a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:08.186323 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 990/2007] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:06:08.191784 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025bf2a-f1c4-4223-9199-e01bdda9eeb3 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:08.196338 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-0025bf2a-f1c4-4223-9199-e01bdda9eeb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:08.208976 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-dfd2fb3d-e814-4d40-bee7-7ea57b569a1f None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:06:08.210547 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-dfd2fb3d-e814-4d40-bee7-7ea57b569a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:08.227286 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025bf2a-f1c4-4223-9199-e01bdda9eeb3 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:08.231854 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1018/2008] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:06:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:06:08.232966 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ed771-bfb4-474f-9679-671b5f0a7a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:08.234310 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ed771-bfb4-474f-9679-671b5f0a7a23 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:08.234745 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ed771-bfb4-474f-9679-671b5f0a7a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:08.235141 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ed771-bfb4-474f-9679-671b5f0a7a23 admin admin] PATH_INFO: `/v3/projects/a134a9769e154bdfadfd0f324beab10e/users/313a67a43444456fbe8c80d2ee35d2ba/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:08.238836 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2fb3d-e814-4d40-bee7-7ea57b569a1f None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:08.253902 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2fb3d-e814-4d40-bee7-7ea57b569a1f None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:08.255094 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ed771-bfb4-474f-9679-671b5f0a7a23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a134a9769e154bdfadfd0f324beab10e, user_id=313a67a43444456fbe8c80d2ee35d2ba, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:08.258954 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ed771-bfb4-474f-9679-671b5f0a7a23 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:08.260323 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9104add-6e10-4d61-8072-9f0e04c7ebac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:08.261102 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9104add-6e10-4d61-8072-9f0e04c7ebac admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:08.262046 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9104add-6e10-4d61-8072-9f0e04c7ebac admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:08.262046 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9104add-6e10-4d61-8072-9f0e04c7ebac admin admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:08.262776 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9104add-6e10-4d61-8072-9f0e04c7ebac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:06:08.263254 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9104add-6e10-4d61-8072-9f0e04c7ebac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:08.265172 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9104add-6e10-4d61-8072-9f0e04c7ebac admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:08.284332 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1019/2009] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 03:06:08.285373 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9104add-6e10-4d61-8072-9f0e04c7ebac admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:08.287391 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 991/2010] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:06:08 2022] PUT /identity/v3/projects/a134a9769e154bdfadfd0f324beab10e/users/313a67a43444456fbe8c80d2ee35d2ba/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:06:08.295558 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9104add-6e10-4d61-8072-9f0e04c7ebac admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:08.299101 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc2478-dcfa-41b3-b936-f1725556dd72 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:08.299787 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc2478-dcfa-41b3-b936-f1725556dd72 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:08.300369 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc2478-dcfa-41b3-b936-f1725556dd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:08.335461 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-e8fc2478-dcfa-41b3-b936-f1725556dd72 None None] MFA Rules not processed for user `313a67a43444456fbe8c80d2ee35d2ba`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:06:08.337338 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-e8fc2478-dcfa-41b3-b936-f1725556dd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:08.361646 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfabf7f-5bf3-4a69-84e5-a40f1df5e2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:08.362248 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfabf7f-5bf3-4a69-84e5-a40f1df5e2ae admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:08.362532 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfabf7f-5bf3-4a69-84e5-a40f1df5e2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:08.362807 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfabf7f-5bf3-4a69-84e5-a40f1df5e2ae admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:08.363496 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfabf7f-5bf3-4a69-84e5-a40f1df5e2ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:08.365440 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfabf7f-5bf3-4a69-84e5-a40f1df5e2ae admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:08.394524 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1020/2011] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:06:08 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:06:08.398761 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfabf7f-5bf3-4a69-84e5-a40f1df5e2ae admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:08.415006 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 992/2012] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:06:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:06:08.428293 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc2478-dcfa-41b3-b936-f1725556dd72 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:08.430144 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-e8fc2478-dcfa-41b3-b936-f1725556dd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:08.462559 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfabf7f-5bf3-4a69-84e5-a40f1df5e2ae admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:08.467682 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dce50d-281c-4037-a727-5fcfbad1fe86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:08.468136 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dce50d-281c-4037-a727-5fcfbad1fe86 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:08.468413 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dce50d-281c-4037-a727-5fcfbad1fe86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:08.468867 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dce50d-281c-4037-a727-5fcfbad1fe86 admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:08.469357 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dce50d-281c-4037-a727-5fcfbad1fe86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:08.471345 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dce50d-281c-4037-a727-5fcfbad1fe86 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:08.493384 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1021/2013] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:06:08 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 03:06:08.500971 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dce50d-281c-4037-a727-5fcfbad1fe86 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:08.501549 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc2478-dcfa-41b3-b936-f1725556dd72 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:08.511465 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dce50d-281c-4037-a727-5fcfbad1fe86 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:08.522627 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148882f-627b-498d-a75c-aa4b1ad595d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:08.523626 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148882f-627b-498d-a75c-aa4b1ad595d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:08.524113 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148882f-627b-498d-a75c-aa4b1ad595d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:08.524557 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148882f-627b-498d-a75c-aa4b1ad595d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:08.525859 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148882f-627b-498d-a75c-aa4b1ad595d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:08.527778 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148882f-627b-498d-a75c-aa4b1ad595d8 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:08.540420 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1022/2014] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:06:08.546058 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148882f-627b-498d-a75c-aa4b1ad595d8 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:08.560741 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148882f-627b-498d-a75c-aa4b1ad595d8 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:08.568326 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d424ef-355d-42f5-a4da-b89035ba4dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:08.569087 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d424ef-355d-42f5-a4da-b89035ba4dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:08.570596 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d424ef-355d-42f5-a4da-b89035ba4dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:08.571196 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d424ef-355d-42f5-a4da-b89035ba4dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:08.572199 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d424ef-355d-42f5-a4da-b89035ba4dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:08.573979 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d424ef-355d-42f5-a4da-b89035ba4dd1 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:08.593143 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e013c-aae0-4463-b091-b284e05a1b49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:08.594062 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e013c-aae0-4463-b091-b284e05a1b49 service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:08.594394 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e013c-aae0-4463-b091-b284e05a1b49 service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:08.594669 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e013c-aae0-4463-b091-b284e05a1b49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:08.598956 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1023/2015] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:06:08.600055 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d424ef-355d-42f5-a4da-b89035ba4dd1 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:08.618284 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d424ef-355d-42f5-a4da-b89035ba4dd1 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:08.624921 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e3dc3-4bb2-4f0a-a052-c3e21aa251f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:08.625852 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e3dc3-4bb2-4f0a-a052-c3e21aa251f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:08.626229 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e3dc3-4bb2-4f0a-a052-c3e21aa251f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:08.627130 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e3dc3-4bb2-4f0a-a052-c3e21aa251f2 admin admin] PATH_INFO: `/v3/projects/a1885278ac6d428291ed1b1924b5cd13/users/2a5da8f9f8664c0a910fb3318e0c0fcc/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:08.646223 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e3dc3-4bb2-4f0a-a052-c3e21aa251f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1885278ac6d428291ed1b1924b5cd13, user_id=2a5da8f9f8664c0a910fb3318e0c0fcc, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:08.650538 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e3dc3-4bb2-4f0a-a052-c3e21aa251f2 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:08.683526 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1024/2016] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:06:08 2022] PUT /identity/v3/projects/a1885278ac6d428291ed1b1924b5cd13/users/2a5da8f9f8664c0a910fb3318e0c0fcc/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:06:08.684717 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e013c-aae0-4463-b091-b284e05a1b49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:08.686350 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e013c-aae0-4463-b091-b284e05a1b49 service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:08.699495 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6500ec8-92f6-4236-ae62-ff4c2eea7de2 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:08.699690 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6500ec8-92f6-4236-ae62-ff4c2eea7de2 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:08.700513 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6500ec8-92f6-4236-ae62-ff4c2eea7de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:08.714998 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 993/2017] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:06:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 03:06:08.732078 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-a6500ec8-92f6-4236-ae62-ff4c2eea7de2 None None] MFA Rules not processed for user `2a5da8f9f8664c0a910fb3318e0c0fcc`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:06:08.733526 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-a6500ec8-92f6-4236-ae62-ff4c2eea7de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:08.875751 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1025/2018] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:06:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:06:08.891791 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e013c-aae0-4463-b091-b284e05a1b49 service cinder] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:08.897592 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-7e0e013c-aae0-4463-b091-b284e05a1b49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:08.910134 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e013c-aae0-4463-b091-b284e05a1b49 service cinder] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:08.963593 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ccb18-d902-41fd-afe1-5c44470ef4fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:08.964275 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ccb18-d902-41fd-afe1-5c44470ef4fb service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:08.964921 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ccb18-d902-41fd-afe1-5c44470ef4fb service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:08.964921 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ccb18-d902-41fd-afe1-5c44470ef4fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:08.974310 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ccb18-d902-41fd-afe1-5c44470ef4fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:08.976091 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ccb18-d902-41fd-afe1-5c44470ef4fb service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:08.986307 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 994/2019] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:06:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:06:11.887828 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6500ec8-92f6-4236-ae62-ff4c2eea7de2 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:11.985644 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6500ec8-92f6-4236-ae62-ff4c2eea7de2 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:11.991201 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762fb61d-c9c2-4864-9e34-692b79e13785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:11.992300 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762fb61d-c9c2-4864-9e34-692b79e13785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:11.992722 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762fb61d-c9c2-4864-9e34-692b79e13785 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:11.993281 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762fb61d-c9c2-4864-9e34-692b79e13785 admin admin] PATH_INFO: `/v3/users/2a5da8f9f8664c0a910fb3318e0c0fcc` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:11.994736 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762fb61d-c9c2-4864-9e34-692b79e13785 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a5da8f9f8664c0a910fb3318e0c0fcc)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:11.996774 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762fb61d-c9c2-4864-9e34-692b79e13785 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:12.052397 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-762fb61d-c9c2-4864-9e34-692b79e13785 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a5da8f9f8664c0a910fb3318e0c0fcc'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:12.068504 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-762fb61d-c9c2-4864-9e34-692b79e13785 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a5da8f9f8664c0a910fb3318e0c0fcc'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:12.069265 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-762fb61d-c9c2-4864-9e34-692b79e13785 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a5da8f9f8664c0a910fb3318e0c0fcc'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:12.069879 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-762fb61d-c9c2-4864-9e34-692b79e13785 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a5da8f9f8664c0a910fb3318e0c0fcc'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:12.085193 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-762fb61d-c9c2-4864-9e34-692b79e13785 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a5da8f9f8664c0a910fb3318e0c0fcc'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:12.101723 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1026/2020] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:06:11 2022] DELETE /identity/v3/users/2a5da8f9f8664c0a910fb3318e0c0fcc => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:06:12.106160 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81142a5-0511-46df-b768-3076c39e9d54 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:12.106678 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81142a5-0511-46df-b768-3076c39e9d54 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:12.106678 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81142a5-0511-46df-b768-3076c39e9d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:12.132898 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-e81142a5-0511-46df-b768-3076c39e9d54 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:06:12.134274 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-e81142a5-0511-46df-b768-3076c39e9d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:12.221463 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 995/2021] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:06:12.229907 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762fb61d-c9c2-4864-9e34-692b79e13785 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:12.231455 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-762fb61d-c9c2-4864-9e34-692b79e13785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:12.316033 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762fb61d-c9c2-4864-9e34-692b79e13785 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:12.320312 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1db70-0a68-416c-8591-9c7a5dc82164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:12.320981 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1db70-0a68-416c-8591-9c7a5dc82164 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:12.321259 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1db70-0a68-416c-8591-9c7a5dc82164 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:12.321529 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1db70-0a68-416c-8591-9c7a5dc82164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:12.341269 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1db70-0a68-416c-8591-9c7a5dc82164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:12.342983 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1db70-0a68-416c-8591-9c7a5dc82164 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:12.359141 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1027/2022] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:06:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:06:12.498621 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81142a5-0511-46df-b768-3076c39e9d54 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:12.500162 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-e81142a5-0511-46df-b768-3076c39e9d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:12.513777 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81142a5-0511-46df-b768-3076c39e9d54 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:12.555927 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6bbf1-d1b5-45b7-b0d4-a3ca930f6d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:12.556844 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6bbf1-d1b5-45b7-b0d4-a3ca930f6d56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:12.557121 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6bbf1-d1b5-45b7-b0d4-a3ca930f6d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:12.560223 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6bbf1-d1b5-45b7-b0d4-a3ca930f6d56 admin admin] PATH_INFO: `/v3/users/313a67a43444456fbe8c80d2ee35d2ba` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:12.562684 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6bbf1-d1b5-45b7-b0d4-a3ca930f6d56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=313a67a43444456fbe8c80d2ee35d2ba)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:12.580605 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6bbf1-d1b5-45b7-b0d4-a3ca930f6d56 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:12.670826 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-5ff6bbf1-d1b5-45b7-b0d4-a3ca930f6d56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '313a67a43444456fbe8c80d2ee35d2ba'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:12.672193 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-5ff6bbf1-d1b5-45b7-b0d4-a3ca930f6d56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '313a67a43444456fbe8c80d2ee35d2ba'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:12.690020 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-5ff6bbf1-d1b5-45b7-b0d4-a3ca930f6d56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '313a67a43444456fbe8c80d2ee35d2ba'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:12.696240 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-5ff6bbf1-d1b5-45b7-b0d4-a3ca930f6d56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '313a67a43444456fbe8c80d2ee35d2ba'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:12.698778 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1db70-0a68-416c-8591-9c7a5dc82164 service neutron] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:12.700951 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-dcc1db70-0a68-416c-8591-9c7a5dc82164 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:12.707383 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-5ff6bbf1-d1b5-45b7-b0d4-a3ca930f6d56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '313a67a43444456fbe8c80d2ee35d2ba'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:12.730584 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 996/2023] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:06:12 2022] DELETE /identity/v3/users/313a67a43444456fbe8c80d2ee35d2ba => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:06:12.735640 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c04a88-3daa-4da1-882f-e10c2877bb56 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:12.736159 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c04a88-3daa-4da1-882f-e10c2877bb56 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:12.736440 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c04a88-3daa-4da1-882f-e10c2877bb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:12.765798 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-62c04a88-3daa-4da1-882f-e10c2877bb56 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:06:12.768053 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-62c04a88-3daa-4da1-882f-e10c2877bb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:12.781197 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1db70-0a68-416c-8591-9c7a5dc82164 service neutron] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:12.848269 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e05220-62a0-4f0d-b477-9dd9cd5346b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:12.850459 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e05220-62a0-4f0d-b477-9dd9cd5346b6 service cinder] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:12.851362 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e05220-62a0-4f0d-b477-9dd9cd5346b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:12.852206 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e05220-62a0-4f0d-b477-9dd9cd5346b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:12.855702 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-b0e05220-62a0-4f0d-b477-9dd9cd5346b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:12.886171 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 997/2024] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:06:12.887203 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c04a88-3daa-4da1-882f-e10c2877bb56 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:12.889307 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-62c04a88-3daa-4da1-882f-e10c2877bb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:12.903276 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c04a88-3daa-4da1-882f-e10c2877bb56 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:12.913881 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14e0ad-0b27-4200-8f1c-6434345f86bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:12.916801 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14e0ad-0b27-4200-8f1c-6434345f86bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:12.917110 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14e0ad-0b27-4200-8f1c-6434345f86bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:12.917381 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14e0ad-0b27-4200-8f1c-6434345f86bf admin admin] PATH_INFO: `/v3/projects/a1885278ac6d428291ed1b1924b5cd13` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:12.918677 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14e0ad-0b27-4200-8f1c-6434345f86bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1885278ac6d428291ed1b1924b5cd13)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:12.921071 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14e0ad-0b27-4200-8f1c-6434345f86bf admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:12.959526 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e05220-62a0-4f0d-b477-9dd9cd5346b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:12.961590 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e05220-62a0-4f0d-b477-9dd9cd5346b6 service cinder] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:12.973647 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1028/2025] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:06:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 03:06:12.974317 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e05220-62a0-4f0d-b477-9dd9cd5346b6 service cinder] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:12.976726 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-b0e05220-62a0-4f0d-b477-9dd9cd5346b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:12.977142 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-9c14e0ad-0b27-4200-8f1c-6434345f86bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1885278ac6d428291ed1b1924b5cd13', 'request_id': 'req-9c14e0ad-0b27-4200-8f1c-6434345f86bf'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:12.991438 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-9c14e0ad-0b27-4200-8f1c-6434345f86bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1885278ac6d428291ed1b1924b5cd13', 'request_id': 'req-9c14e0ad-0b27-4200-8f1c-6434345f86bf'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:13.003665 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-9c14e0ad-0b27-4200-8f1c-6434345f86bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1885278ac6d428291ed1b1924b5cd13', 'request_id': 'req-9c14e0ad-0b27-4200-8f1c-6434345f86bf'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:13.020168 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-9c14e0ad-0b27-4200-8f1c-6434345f86bf admin admin] The token cache is being invalidate because project a1885278ac6d428291ed1b1924b5cd13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:06:13.020358 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-9c14e0ad-0b27-4200-8f1c-6434345f86bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:13.021035 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-9c14e0ad-0b27-4200-8f1c-6434345f86bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:13.022725 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 998/2026] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:06:12 2022] DELETE /identity/v3/projects/a1885278ac6d428291ed1b1924b5cd13 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:06:13.043248 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e05220-62a0-4f0d-b477-9dd9cd5346b6 service cinder] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:13.117305 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35d63a-c6df-4383-949f-9c5faf7d0327 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:13.117995 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35d63a-c6df-4383-949f-9c5faf7d0327 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:13.118273 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35d63a-c6df-4383-949f-9c5faf7d0327 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:13.118566 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35d63a-c6df-4383-949f-9c5faf7d0327 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:13.121606 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-ba35d63a-c6df-4383-949f-9c5faf7d0327 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:13.236888 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba35d63a-c6df-4383-949f-9c5faf7d0327 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:13.241371 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba35d63a-c6df-4383-949f-9c5faf7d0327 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:13.254006 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1029/2027] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:06:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:06:13.870676 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14e0ad-0b27-4200-8f1c-6434345f86bf admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:13.872190 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-9c14e0ad-0b27-4200-8f1c-6434345f86bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:13.895700 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14e0ad-0b27-4200-8f1c-6434345f86bf admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:13.901780 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f4700-ddee-49a1-b894-016c1abd4fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:13.903033 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f4700-ddee-49a1-b894-016c1abd4fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:13.903555 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f4700-ddee-49a1-b894-016c1abd4fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:13.904215 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f4700-ddee-49a1-b894-016c1abd4fc1 admin admin] PATH_INFO: `/v3/projects/a134a9769e154bdfadfd0f324beab10e` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:13.906120 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f4700-ddee-49a1-b894-016c1abd4fc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a134a9769e154bdfadfd0f324beab10e)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:13.908704 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f4700-ddee-49a1-b894-016c1abd4fc1 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:13.971936 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-475f4700-ddee-49a1-b894-016c1abd4fc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a134a9769e154bdfadfd0f324beab10e', 'request_id': 'req-475f4700-ddee-49a1-b894-016c1abd4fc1'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:13.991749 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-475f4700-ddee-49a1-b894-016c1abd4fc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a134a9769e154bdfadfd0f324beab10e', 'request_id': 'req-475f4700-ddee-49a1-b894-016c1abd4fc1'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:14.009027 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-475f4700-ddee-49a1-b894-016c1abd4fc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a134a9769e154bdfadfd0f324beab10e', 'request_id': 'req-475f4700-ddee-49a1-b894-016c1abd4fc1'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:14.033343 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-475f4700-ddee-49a1-b894-016c1abd4fc1 admin admin] The token cache is being invalidate because project a134a9769e154bdfadfd0f324beab10e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:06:14.034136 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-475f4700-ddee-49a1-b894-016c1abd4fc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:14.034867 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-475f4700-ddee-49a1-b894-016c1abd4fc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:14.037167 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 999/2028] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:06:13 2022] DELETE /identity/v3/projects/a134a9769e154bdfadfd0f324beab10e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:06:14.245925 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35d63a-c6df-4383-949f-9c5faf7d0327 service neutron] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:14.247476 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-ba35d63a-c6df-4383-949f-9c5faf7d0327 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:14.260374 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35d63a-c6df-4383-949f-9c5faf7d0327 service neutron] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:14.315400 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d452c2-3c1e-46cd-8486-da25154ad443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:14.316346 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d452c2-3c1e-46cd-8486-da25154ad443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:14.316687 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d452c2-3c1e-46cd-8486-da25154ad443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:14.317018 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d452c2-3c1e-46cd-8486-da25154ad443 admin admin] PATH_INFO: `/v3/users/42d4c3f4a3d548bda06b450a63074b04` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:14.318320 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d452c2-3c1e-46cd-8486-da25154ad443 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42d4c3f4a3d548bda06b450a63074b04)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:14.320345 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d452c2-3c1e-46cd-8486-da25154ad443 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:14.379929 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-b7d452c2-3c1e-46cd-8486-da25154ad443 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42d4c3f4a3d548bda06b450a63074b04'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:14.398764 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-b7d452c2-3c1e-46cd-8486-da25154ad443 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42d4c3f4a3d548bda06b450a63074b04'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:14.399881 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-b7d452c2-3c1e-46cd-8486-da25154ad443 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42d4c3f4a3d548bda06b450a63074b04'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:14.400816 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-b7d452c2-3c1e-46cd-8486-da25154ad443 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42d4c3f4a3d548bda06b450a63074b04'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:14.414298 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-b7d452c2-3c1e-46cd-8486-da25154ad443 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42d4c3f4a3d548bda06b450a63074b04'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:14.428496 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1030/2029] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:06:14 2022] DELETE /identity/v3/users/42d4c3f4a3d548bda06b450a63074b04 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:06:14.615279 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f4700-ddee-49a1-b894-016c1abd4fc1 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:14.617065 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-475f4700-ddee-49a1-b894-016c1abd4fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:14.633724 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f4700-ddee-49a1-b894-016c1abd4fc1 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:14.706540 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c14feb-136f-40ca-ba91-c20f7badf4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:14.707899 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c14feb-136f-40ca-ba91-c20f7badf4a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:14.708285 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c14feb-136f-40ca-ba91-c20f7badf4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:14.708600 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c14feb-136f-40ca-ba91-c20f7badf4a0 admin admin] PATH_INFO: `/v3/projects/82496cc7388048ccb95596e852280502` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:14.710061 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c14feb-136f-40ca-ba91-c20f7badf4a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82496cc7388048ccb95596e852280502)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:14.712770 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c14feb-136f-40ca-ba91-c20f7badf4a0 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:14.764983 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-e2c14feb-136f-40ca-ba91-c20f7badf4a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82496cc7388048ccb95596e852280502', 'request_id': 'req-e2c14feb-136f-40ca-ba91-c20f7badf4a0'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:14.776541 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-e2c14feb-136f-40ca-ba91-c20f7badf4a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82496cc7388048ccb95596e852280502', 'request_id': 'req-e2c14feb-136f-40ca-ba91-c20f7badf4a0'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:14.786564 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-e2c14feb-136f-40ca-ba91-c20f7badf4a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82496cc7388048ccb95596e852280502', 'request_id': 'req-e2c14feb-136f-40ca-ba91-c20f7badf4a0'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:14.800166 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-e2c14feb-136f-40ca-ba91-c20f7badf4a0 admin admin] The token cache is being invalidate because project 82496cc7388048ccb95596e852280502 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:06:14.800471 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-e2c14feb-136f-40ca-ba91-c20f7badf4a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:14.801201 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-e2c14feb-136f-40ca-ba91-c20f7badf4a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:14.802949 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1000/2030] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:06:14 2022] DELETE /identity/v3/projects/82496cc7388048ccb95596e852280502 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:06:14.808083 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a71f2-9d8a-45e4-b71b-3e50073f52e1 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:14.808371 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a71f2-9d8a-45e4-b71b-3e50073f52e1 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:14.808648 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a71f2-9d8a-45e4-b71b-3e50073f52e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:14.828634 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-6e1a71f2-9d8a-45e4-b71b-3e50073f52e1 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:06:14.829812 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-6e1a71f2-9d8a-45e4-b71b-3e50073f52e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:14.892316 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1031/2031] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:06:14.900968 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110aab7-f4e1-4757-901e-5ede282dd20e None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:14.901490 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110aab7-f4e1-4757-901e-5ede282dd20e None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:14.901638 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110aab7-f4e1-4757-901e-5ede282dd20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:14.921069 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-c110aab7-f4e1-4757-901e-5ede282dd20e None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:06:14.922396 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-c110aab7-f4e1-4757-901e-5ede282dd20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:14.932322 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1001/2032] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:06:14.936956 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a71f2-9d8a-45e4-b71b-3e50073f52e1 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:14.946637 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a71f2-9d8a-45e4-b71b-3e50073f52e1 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:14.952357 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56c5d3-b36f-4837-bf09-7d5db32197e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:14.953375 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56c5d3-b36f-4837-bf09-7d5db32197e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:14.953659 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56c5d3-b36f-4837-bf09-7d5db32197e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:14.953953 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56c5d3-b36f-4837-bf09-7d5db32197e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:14.954740 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f56c5d3-b36f-4837-bf09-7d5db32197e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:06:14.955083 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f56c5d3-b36f-4837-bf09-7d5db32197e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:14.956809 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f56c5d3-b36f-4837-bf09-7d5db32197e8 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:14.970855 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1032/2033] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:06:14.975563 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110aab7-f4e1-4757-901e-5ede282dd20e None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:14.985357 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110aab7-f4e1-4757-901e-5ede282dd20e None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:14.990641 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dbf9b-bfa9-47d5-be14-253bc1530e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:14.991317 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dbf9b-bfa9-47d5-be14-253bc1530e0c admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:14.991598 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dbf9b-bfa9-47d5-be14-253bc1530e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:14.991923 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dbf9b-bfa9-47d5-be14-253bc1530e0c admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:14.992608 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429dbf9b-bfa9-47d5-be14-253bc1530e0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:14.994533 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429dbf9b-bfa9-47d5-be14-253bc1530e0c admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:15.029691 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1002/2034] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:06:14 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:06:15.036614 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56c5d3-b36f-4837-bf09-7d5db32197e8 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:15.049736 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56c5d3-b36f-4837-bf09-7d5db32197e8 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:15.109254 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a7916-eb10-4cfc-a54c-6c84379303c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:15.109947 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a7916-eb10-4cfc-a54c-6c84379303c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:15.110240 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a7916-eb10-4cfc-a54c-6c84379303c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:15.110503 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a7916-eb10-4cfc-a54c-6c84379303c5 admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:15.111198 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a7916-eb10-4cfc-a54c-6c84379303c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:15.113192 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a7916-eb10-4cfc-a54c-6c84379303c5 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:15.134498 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1033/2035] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:06:15 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:06:15.138766 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dbf9b-bfa9-47d5-be14-253bc1530e0c admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:15.149729 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dbf9b-bfa9-47d5-be14-253bc1530e0c admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:15.155059 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cead815-5def-49ea-8d7a-022f10fc346c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:15.155745 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cead815-5def-49ea-8d7a-022f10fc346c admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:15.156048 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cead815-5def-49ea-8d7a-022f10fc346c admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:15.156324 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cead815-5def-49ea-8d7a-022f10fc346c admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:15.157061 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cead815-5def-49ea-8d7a-022f10fc346c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:15.158669 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cead815-5def-49ea-8d7a-022f10fc346c admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:15.169959 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1003/2036] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:06:15.174430 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a7916-eb10-4cfc-a54c-6c84379303c5 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:15.185855 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a7916-eb10-4cfc-a54c-6c84379303c5 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:15.190797 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446c39e-5bef-47d8-9092-d0e7cfca4596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:15.191454 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446c39e-5bef-47d8-9092-d0e7cfca4596 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:15.191742 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446c39e-5bef-47d8-9092-d0e7cfca4596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:15.192020 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446c39e-5bef-47d8-9092-d0e7cfca4596 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:15.192750 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446c39e-5bef-47d8-9092-d0e7cfca4596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:15.194362 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446c39e-5bef-47d8-9092-d0e7cfca4596 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:15.206205 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1034/2037] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:06:15.211353 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cead815-5def-49ea-8d7a-022f10fc346c admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:15.222286 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cead815-5def-49ea-8d7a-022f10fc346c admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:15.227121 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb23f9-39b0-4aa1-9861-eb332b6c51f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:15.228040 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb23f9-39b0-4aa1-9861-eb332b6c51f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:15.228315 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb23f9-39b0-4aa1-9861-eb332b6c51f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:15.228583 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb23f9-39b0-4aa1-9861-eb332b6c51f0 admin admin] PATH_INFO: `/v3/projects/0c39feef79894752b1b00d9e452c37f3/users/2eeeb2c3e48947a69391cce7a4663df6/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:15.243223 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb23f9-39b0-4aa1-9861-eb332b6c51f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c39feef79894752b1b00d9e452c37f3, user_id=2eeeb2c3e48947a69391cce7a4663df6, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:15.245941 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb23f9-39b0-4aa1-9861-eb332b6c51f0 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:15.260470 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1004/2038] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:06:15 2022] PUT /identity/v3/projects/0c39feef79894752b1b00d9e452c37f3/users/2eeeb2c3e48947a69391cce7a4663df6/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:06:15.270750 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459366ef-abfa-45e1-8523-c2f56b15fad2 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:15.271250 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459366ef-abfa-45e1-8523-c2f56b15fad2 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:15.271404 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459366ef-abfa-45e1-8523-c2f56b15fad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:15.298267 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-459366ef-abfa-45e1-8523-c2f56b15fad2 None None] MFA Rules not processed for user `2eeeb2c3e48947a69391cce7a4663df6`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:06:15.299465 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-459366ef-abfa-45e1-8523-c2f56b15fad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:15.362558 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1035/2039] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:06:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:06:15.367187 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb23f9-39b0-4aa1-9861-eb332b6c51f0 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:15.429857 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb23f9-39b0-4aa1-9861-eb332b6c51f0 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:15.434637 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d14ef9-3775-423d-a1f2-f1dd3dcc0462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:15.435288 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d14ef9-3775-423d-a1f2-f1dd3dcc0462 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:15.435565 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d14ef9-3775-423d-a1f2-f1dd3dcc0462 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:15.435854 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d14ef9-3775-423d-a1f2-f1dd3dcc0462 admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:15.436541 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d14ef9-3775-423d-a1f2-f1dd3dcc0462 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:15.438715 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d14ef9-3775-423d-a1f2-f1dd3dcc0462 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:15.468464 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1005/2040] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:06:15 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:06:15.474148 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459366ef-abfa-45e1-8523-c2f56b15fad2 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:15.490539 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459366ef-abfa-45e1-8523-c2f56b15fad2 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:15.553607 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558c778-ea07-4360-a0f6-511484d3a9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:15.554277 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558c778-ea07-4360-a0f6-511484d3a9d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:15.554552 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558c778-ea07-4360-a0f6-511484d3a9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:15.554825 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558c778-ea07-4360-a0f6-511484d3a9d5 admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:15.555505 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2558c778-ea07-4360-a0f6-511484d3a9d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:15.557476 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2558c778-ea07-4360-a0f6-511484d3a9d5 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:15.581662 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1036/2041] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:06:15 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:06:15.585871 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d14ef9-3775-423d-a1f2-f1dd3dcc0462 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:15.596811 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d14ef9-3775-423d-a1f2-f1dd3dcc0462 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:15.602022 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a188f83-4e82-4b7d-9737-2c74b3c84939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:15.602696 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a188f83-4e82-4b7d-9737-2c74b3c84939 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:15.602971 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a188f83-4e82-4b7d-9737-2c74b3c84939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:15.603258 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a188f83-4e82-4b7d-9737-2c74b3c84939 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:15.603998 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a188f83-4e82-4b7d-9737-2c74b3c84939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:15.605612 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a188f83-4e82-4b7d-9737-2c74b3c84939 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:15.616776 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1006/2042] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:06:15.620893 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558c778-ea07-4360-a0f6-511484d3a9d5 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:15.631379 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558c778-ea07-4360-a0f6-511484d3a9d5 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:15.637396 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ee9cb-1fff-429e-93ac-d386dbb35da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:15.638055 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ee9cb-1fff-429e-93ac-d386dbb35da5 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:15.638331 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ee9cb-1fff-429e-93ac-d386dbb35da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:15.638601 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ee9cb-1fff-429e-93ac-d386dbb35da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:15.639331 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ee9cb-1fff-429e-93ac-d386dbb35da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:15.641012 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ee9cb-1fff-429e-93ac-d386dbb35da5 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:15.651040 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1037/2043] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:06:15.655217 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a188f83-4e82-4b7d-9737-2c74b3c84939 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:15.665433 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a188f83-4e82-4b7d-9737-2c74b3c84939 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:15.671066 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216e134-aaa0-419e-b936-74b6ba0f891e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:15.672162 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216e134-aaa0-419e-b936-74b6ba0f891e admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:15.672439 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216e134-aaa0-419e-b936-74b6ba0f891e admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:15.672712 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216e134-aaa0-419e-b936-74b6ba0f891e admin admin] PATH_INFO: `/v3/projects/644c2533736c40a4830202239cb208a1/users/9370f4098eb24113894b2e1a1987ad8f/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:15.687628 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e216e134-aaa0-419e-b936-74b6ba0f891e admin admin] RBAC: Authorizing `identity:create_grant(project_id=644c2533736c40a4830202239cb208a1, user_id=9370f4098eb24113894b2e1a1987ad8f, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:15.690327 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e216e134-aaa0-419e-b936-74b6ba0f891e admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:15.708394 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1007/2044] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:06:15 2022] PUT /identity/v3/projects/644c2533736c40a4830202239cb208a1/users/9370f4098eb24113894b2e1a1987ad8f/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:06:15.720184 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8faa5d6-79c8-4bfb-a24b-d4c1fa2a6c3e None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:15.720482 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8faa5d6-79c8-4bfb-a24b-d4c1fa2a6c3e None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:15.720740 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8faa5d6-79c8-4bfb-a24b-d4c1fa2a6c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:15.747495 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-e8faa5d6-79c8-4bfb-a24b-d4c1fa2a6c3e None None] MFA Rules not processed for user `9370f4098eb24113894b2e1a1987ad8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:06:15.748729 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-e8faa5d6-79c8-4bfb-a24b-d4c1fa2a6c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:15.819417 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1038/2045] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:06:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:06:15.823974 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216e134-aaa0-419e-b936-74b6ba0f891e admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:15.883669 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216e134-aaa0-419e-b936-74b6ba0f891e admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:15.888758 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4061ce6-7c4b-4d23-9046-2b7a75f4d7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:15.889421 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4061ce6-7c4b-4d23-9046-2b7a75f4d7ae admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:15.889695 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4061ce6-7c4b-4d23-9046-2b7a75f4d7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:15.890023 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4061ce6-7c4b-4d23-9046-2b7a75f4d7ae admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:15.890805 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4061ce6-7c4b-4d23-9046-2b7a75f4d7ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:15.892770 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4061ce6-7c4b-4d23-9046-2b7a75f4d7ae admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:15.919899 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1008/2046] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:06:15 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 03:06:15.924241 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8faa5d6-79c8-4bfb-a24b-d4c1fa2a6c3e None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:15.934689 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8faa5d6-79c8-4bfb-a24b-d4c1fa2a6c3e None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:15.990026 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215c481-ffb7-4174-a210-d4644293c024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:15.990705 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215c481-ffb7-4174-a210-d4644293c024 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:15.990983 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215c481-ffb7-4174-a210-d4644293c024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:15.991394 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215c481-ffb7-4174-a210-d4644293c024 admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:15.992115 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215c481-ffb7-4174-a210-d4644293c024 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:15.994108 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215c481-ffb7-4174-a210-d4644293c024 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:16.015330 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1039/2047] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:06:15 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 03:06:16.019756 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4061ce6-7c4b-4d23-9046-2b7a75f4d7ae admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:16.030417 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4061ce6-7c4b-4d23-9046-2b7a75f4d7ae admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:16.035716 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd214ef-8703-4040-b45b-0450a746002f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:16.036421 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd214ef-8703-4040-b45b-0450a746002f admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:16.036698 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd214ef-8703-4040-b45b-0450a746002f admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:16.036970 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd214ef-8703-4040-b45b-0450a746002f admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:16.037710 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd214ef-8703-4040-b45b-0450a746002f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:16.039336 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd214ef-8703-4040-b45b-0450a746002f admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:16.049971 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1009/2048] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:06:16.054304 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215c481-ffb7-4174-a210-d4644293c024 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:16.064845 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215c481-ffb7-4174-a210-d4644293c024 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:16.070385 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888bdffd-42ad-4128-a6ac-a45b7dc977be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:16.071258 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bdffd-42ad-4128-a6ac-a45b7dc977be admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:16.071533 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bdffd-42ad-4128-a6ac-a45b7dc977be admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:16.071834 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bdffd-42ad-4128-a6ac-a45b7dc977be admin admin] PATH_INFO: `/v3/projects/d71ee31104d24ebe883a9d4fc462ff51/users/ec4e3c3203054aa49012cdf3b7512de3/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:16.086747 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888bdffd-42ad-4128-a6ac-a45b7dc977be admin admin] RBAC: Authorizing `identity:create_grant(project_id=d71ee31104d24ebe883a9d4fc462ff51, user_id=ec4e3c3203054aa49012cdf3b7512de3, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:16.089428 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888bdffd-42ad-4128-a6ac-a45b7dc977be admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:16.103764 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1040/2049] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:06:16 2022] PUT /identity/v3/projects/d71ee31104d24ebe883a9d4fc462ff51/users/ec4e3c3203054aa49012cdf3b7512de3/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:06:16.107782 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd214ef-8703-4040-b45b-0450a746002f admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:16.121383 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd214ef-8703-4040-b45b-0450a746002f admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:16.181047 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a51c3-8517-4483-92e6-807ba0bb951a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:16.181601 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a51c3-8517-4483-92e6-807ba0bb951a admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:16.181872 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a51c3-8517-4483-92e6-807ba0bb951a admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:16.182140 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a51c3-8517-4483-92e6-807ba0bb951a admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:16.182883 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a51c3-8517-4483-92e6-807ba0bb951a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:16.184503 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a51c3-8517-4483-92e6-807ba0bb951a admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:16.196359 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1010/2050] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:06:16.202278 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888bdffd-42ad-4128-a6ac-a45b7dc977be admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:16.213070 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888bdffd-42ad-4128-a6ac-a45b7dc977be admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:16.218073 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3b9bc-0bbd-48f0-9f9c-6b956276f6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:16.219155 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3b9bc-0bbd-48f0-9f9c-6b956276f6bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:16.219423 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3b9bc-0bbd-48f0-9f9c-6b956276f6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:16.219688 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3b9bc-0bbd-48f0-9f9c-6b956276f6bc admin admin] PATH_INFO: `/v3/projects/d71ee31104d24ebe883a9d4fc462ff51/users/ec4e3c3203054aa49012cdf3b7512de3/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:16.221731 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe3b9bc-0bbd-48f0-9f9c-6b956276f6bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d71ee31104d24ebe883a9d4fc462ff51, user_id=ec4e3c3203054aa49012cdf3b7512de3, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:16.224405 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe3b9bc-0bbd-48f0-9f9c-6b956276f6bc admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:16.234606 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1041/2051] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:06:16 2022] PUT /identity/v3/projects/d71ee31104d24ebe883a9d4fc462ff51/users/ec4e3c3203054aa49012cdf3b7512de3/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:06:16.244871 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600db80-0fc8-4979-a2ae-fd8d515db2a4 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:16.245153 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600db80-0fc8-4979-a2ae-fd8d515db2a4 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:16.245450 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600db80-0fc8-4979-a2ae-fd8d515db2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:16.273535 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-b600db80-0fc8-4979-a2ae-fd8d515db2a4 None None] MFA Rules not processed for user `ec4e3c3203054aa49012cdf3b7512de3`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:06:16.274787 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-b600db80-0fc8-4979-a2ae-fd8d515db2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:16.345936 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1011/2052] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:06:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:06:16.356864 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3b9bc-0bbd-48f0-9f9c-6b956276f6bc admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:16.358938 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-efe3b9bc-0bbd-48f0-9f9c-6b956276f6bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:16.428355 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3b9bc-0bbd-48f0-9f9c-6b956276f6bc admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:16.432493 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a8e4b-a53c-4fe9-9ffa-515cbd53c887 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:16.433180 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a8e4b-a53c-4fe9-9ffa-515cbd53c887 service cinder] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:16.433544 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a8e4b-a53c-4fe9-9ffa-515cbd53c887 service cinder] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:16.433902 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a8e4b-a53c-4fe9-9ffa-515cbd53c887 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:16.444169 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a8e4b-a53c-4fe9-9ffa-515cbd53c887 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:16.445865 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a8e4b-a53c-4fe9-9ffa-515cbd53c887 service cinder] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:16.458173 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1042/2053] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:06:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:06:16.938125 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600db80-0fc8-4979-a2ae-fd8d515db2a4 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:16.948104 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600db80-0fc8-4979-a2ae-fd8d515db2a4 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:16.952030 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54bc92a-bbaf-46ef-8254-91ccba31b140 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:16.952689 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54bc92a-bbaf-46ef-8254-91ccba31b140 service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:16.952955 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54bc92a-bbaf-46ef-8254-91ccba31b140 service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:16.953216 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54bc92a-bbaf-46ef-8254-91ccba31b140 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:17.011389 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54bc92a-bbaf-46ef-8254-91ccba31b140 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:17.013414 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54bc92a-bbaf-46ef-8254-91ccba31b140 service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:17.024819 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1012/2054] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:06:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:06:17.989291 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a8e4b-a53c-4fe9-9ffa-515cbd53c887 service cinder] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:17.990932 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-987a8e4b-a53c-4fe9-9ffa-515cbd53c887 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:18.065427 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a8e4b-a53c-4fe9-9ffa-515cbd53c887 service cinder] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:18.073582 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c9bc3-21f0-491d-9f81-c15035720712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:18.074799 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c9bc3-21f0-491d-9f81-c15035720712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:18.075445 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c9bc3-21f0-491d-9f81-c15035720712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:18.075800 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c9bc3-21f0-491d-9f81-c15035720712 admin admin] PATH_INFO: `/v3/users/e0d44f3311b146508cafaa4cb8b8dec3` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:18.077716 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c9bc3-21f0-491d-9f81-c15035720712 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0d44f3311b146508cafaa4cb8b8dec3)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:18.079619 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c9bc3-21f0-491d-9f81-c15035720712 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:18.129743 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-3a6c9bc3-21f0-491d-9f81-c15035720712 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0d44f3311b146508cafaa4cb8b8dec3'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:18.136835 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-3a6c9bc3-21f0-491d-9f81-c15035720712 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0d44f3311b146508cafaa4cb8b8dec3'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:18.137549 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-3a6c9bc3-21f0-491d-9f81-c15035720712 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0d44f3311b146508cafaa4cb8b8dec3'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:18.138213 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-3a6c9bc3-21f0-491d-9f81-c15035720712 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0d44f3311b146508cafaa4cb8b8dec3'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:18.150606 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-3a6c9bc3-21f0-491d-9f81-c15035720712 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0d44f3311b146508cafaa4cb8b8dec3'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:18.164739 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1043/2055] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:06:17 2022] DELETE /identity/v3/users/e0d44f3311b146508cafaa4cb8b8dec3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:06:18.169575 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a10329-fb47-45b5-9ba6-061685105ce6 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:18.170060 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a10329-fb47-45b5-9ba6-061685105ce6 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:18.170157 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a10329-fb47-45b5-9ba6-061685105ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:18.188954 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-b9a10329-fb47-45b5-9ba6-061685105ce6 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:06:18.190165 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-b9a10329-fb47-45b5-9ba6-061685105ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:18.260726 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1013/2056] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:06:18.271348 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c9bc3-21f0-491d-9f81-c15035720712 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:18.273549 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-3a6c9bc3-21f0-491d-9f81-c15035720712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:18.336212 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c9bc3-21f0-491d-9f81-c15035720712 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:18.341369 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bc21f-7ba1-44c1-9048-c04c7fe1c85b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:18.342051 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bc21f-7ba1-44c1-9048-c04c7fe1c85b service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:18.342319 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bc21f-7ba1-44c1-9048-c04c7fe1c85b service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:18.342579 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bc21f-7ba1-44c1-9048-c04c7fe1c85b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:18.352675 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310bc21f-7ba1-44c1-9048-c04c7fe1c85b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:18.354097 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310bc21f-7ba1-44c1-9048-c04c7fe1c85b service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:18.364211 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1044/2057] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:06:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:06:18.649119 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a10329-fb47-45b5-9ba6-061685105ce6 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:18.650704 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-b9a10329-fb47-45b5-9ba6-061685105ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:18.663171 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a10329-fb47-45b5-9ba6-061685105ce6 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:18.668552 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95c2f8-c664-4a6e-b457-79c77a112753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:18.669478 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95c2f8-c664-4a6e-b457-79c77a112753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:18.669755 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95c2f8-c664-4a6e-b457-79c77a112753 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:18.669988 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95c2f8-c664-4a6e-b457-79c77a112753 admin admin] PATH_INFO: `/v3/projects/2f720e218b9a4428b65c5528a54188da` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:18.671267 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95c2f8-c664-4a6e-b457-79c77a112753 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f720e218b9a4428b65c5528a54188da)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:18.673254 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95c2f8-c664-4a6e-b457-79c77a112753 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:18.721029 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-2a95c2f8-c664-4a6e-b457-79c77a112753 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f720e218b9a4428b65c5528a54188da', 'request_id': 'req-2a95c2f8-c664-4a6e-b457-79c77a112753'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:18.729577 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-2a95c2f8-c664-4a6e-b457-79c77a112753 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f720e218b9a4428b65c5528a54188da', 'request_id': 'req-2a95c2f8-c664-4a6e-b457-79c77a112753'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:18.736334 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-2a95c2f8-c664-4a6e-b457-79c77a112753 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f720e218b9a4428b65c5528a54188da', 'request_id': 'req-2a95c2f8-c664-4a6e-b457-79c77a112753'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:18.746965 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-2a95c2f8-c664-4a6e-b457-79c77a112753 admin admin] The token cache is being invalidate because project 2f720e218b9a4428b65c5528a54188da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:06:18.747244 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-2a95c2f8-c664-4a6e-b457-79c77a112753 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:18.747889 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-2a95c2f8-c664-4a6e-b457-79c77a112753 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:18.749690 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1014/2058] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:06:18 2022] DELETE /identity/v3/projects/2f720e218b9a4428b65c5528a54188da => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:06:18.754144 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bc21f-7ba1-44c1-9048-c04c7fe1c85b service neutron] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:18.765294 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bc21f-7ba1-44c1-9048-c04c7fe1c85b service neutron] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:18.822907 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559c301-e7f5-482a-9527-465469b1f65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:18.823791 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559c301-e7f5-482a-9527-465469b1f65f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:18.824075 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559c301-e7f5-482a-9527-465469b1f65f admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:18.824339 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559c301-e7f5-482a-9527-465469b1f65f admin admin] PATH_INFO: `/v3/users/6be63ebf4cd44424b1ae7c1104b2c603` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:18.825826 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559c301-e7f5-482a-9527-465469b1f65f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6be63ebf4cd44424b1ae7c1104b2c603)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:18.827840 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559c301-e7f5-482a-9527-465469b1f65f admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:18.873004 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-e559c301-e7f5-482a-9527-465469b1f65f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6be63ebf4cd44424b1ae7c1104b2c603'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:18.879904 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-e559c301-e7f5-482a-9527-465469b1f65f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6be63ebf4cd44424b1ae7c1104b2c603'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:18.880654 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-e559c301-e7f5-482a-9527-465469b1f65f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6be63ebf4cd44424b1ae7c1104b2c603'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:18.881358 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-e559c301-e7f5-482a-9527-465469b1f65f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6be63ebf4cd44424b1ae7c1104b2c603'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:18.894154 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-e559c301-e7f5-482a-9527-465469b1f65f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6be63ebf4cd44424b1ae7c1104b2c603'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:18.907827 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1045/2059] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:06:18 2022] DELETE /identity/v3/users/6be63ebf4cd44424b1ae7c1104b2c603 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:06:19.394936 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95c2f8-c664-4a6e-b457-79c77a112753 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:19.396443 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-2a95c2f8-c664-4a6e-b457-79c77a112753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:19.410094 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95c2f8-c664-4a6e-b457-79c77a112753 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:19.477558 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47ce51-4aaf-4a67-aeb4-5fa48ef2fd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:19.478415 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47ce51-4aaf-4a67-aeb4-5fa48ef2fd0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:19.478684 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47ce51-4aaf-4a67-aeb4-5fa48ef2fd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:19.478955 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47ce51-4aaf-4a67-aeb4-5fa48ef2fd0e admin admin] PATH_INFO: `/v3/projects/39f71ab94e294d548f316a63868c05b7` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:19.480220 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47ce51-4aaf-4a67-aeb4-5fa48ef2fd0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=39f71ab94e294d548f316a63868c05b7)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:19.482156 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47ce51-4aaf-4a67-aeb4-5fa48ef2fd0e admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:19.542127 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-ef47ce51-4aaf-4a67-aeb4-5fa48ef2fd0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39f71ab94e294d548f316a63868c05b7', 'request_id': 'req-ef47ce51-4aaf-4a67-aeb4-5fa48ef2fd0e'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:19.552063 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-ef47ce51-4aaf-4a67-aeb4-5fa48ef2fd0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39f71ab94e294d548f316a63868c05b7', 'request_id': 'req-ef47ce51-4aaf-4a67-aeb4-5fa48ef2fd0e'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:19.558420 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-ef47ce51-4aaf-4a67-aeb4-5fa48ef2fd0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39f71ab94e294d548f316a63868c05b7', 'request_id': 'req-ef47ce51-4aaf-4a67-aeb4-5fa48ef2fd0e'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:19.569139 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-ef47ce51-4aaf-4a67-aeb4-5fa48ef2fd0e admin admin] The token cache is being invalidate because project 39f71ab94e294d548f316a63868c05b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:06:19.569359 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-ef47ce51-4aaf-4a67-aeb4-5fa48ef2fd0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:19.570027 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-ef47ce51-4aaf-4a67-aeb4-5fa48ef2fd0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:19.571622 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1015/2060] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:06:19 2022] DELETE /identity/v3/projects/39f71ab94e294d548f316a63868c05b7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:06:19.578228 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91c7a8-fdf8-4857-a6f8-d4685bb6c3b1 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:19.578724 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91c7a8-fdf8-4857-a6f8-d4685bb6c3b1 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:19.578724 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91c7a8-fdf8-4857-a6f8-d4685bb6c3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:19.599234 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-9d91c7a8-fdf8-4857-a6f8-d4685bb6c3b1 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:06:19.600770 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-9d91c7a8-fdf8-4857-a6f8-d4685bb6c3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:19.660439 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1046/2061] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:06:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:06:19.669230 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c57715-4204-4aaf-9671-1a435c6466ce None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:19.669484 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c57715-4204-4aaf-9671-1a435c6466ce None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:19.669782 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c57715-4204-4aaf-9671-1a435c6466ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:19.689492 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-c6c57715-4204-4aaf-9671-1a435c6466ce None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:06:19.690928 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-c6c57715-4204-4aaf-9671-1a435c6466ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:19.699313 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1016/2062] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:06:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:06:19.705223 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91c7a8-fdf8-4857-a6f8-d4685bb6c3b1 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:19.715070 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91c7a8-fdf8-4857-a6f8-d4685bb6c3b1 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:19.720526 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16cfe0a-b7eb-4166-8bff-21d20c322fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:19.721206 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cfe0a-b7eb-4166-8bff-21d20c322fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:19.721468 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cfe0a-b7eb-4166-8bff-21d20c322fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:19.721733 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cfe0a-b7eb-4166-8bff-21d20c322fc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:19.722488 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16cfe0a-b7eb-4166-8bff-21d20c322fc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:06:19.722795 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16cfe0a-b7eb-4166-8bff-21d20c322fc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:19.724442 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16cfe0a-b7eb-4166-8bff-21d20c322fc1 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:19.736573 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1047/2063] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:06:19.741590 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c57715-4204-4aaf-9671-1a435c6466ce None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:19.751514 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c57715-4204-4aaf-9671-1a435c6466ce None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:19.757173 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17919d-a7d6-4305-8bcb-93de67de22b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:19.757823 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17919d-a7d6-4305-8bcb-93de67de22b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:19.758101 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17919d-a7d6-4305-8bcb-93de67de22b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:19.758370 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17919d-a7d6-4305-8bcb-93de67de22b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:19.759060 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17919d-a7d6-4305-8bcb-93de67de22b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:19.761773 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17919d-a7d6-4305-8bcb-93de67de22b3 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:19.790311 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1017/2064] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:06:19 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:06:19.794583 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16cfe0a-b7eb-4166-8bff-21d20c322fc1 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:19.805940 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16cfe0a-b7eb-4166-8bff-21d20c322fc1 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:19.864202 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1ceda-87ba-4912-a72d-cbb7395ce742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:19.864901 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1ceda-87ba-4912-a72d-cbb7395ce742 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:19.865171 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1ceda-87ba-4912-a72d-cbb7395ce742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:19.865431 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1ceda-87ba-4912-a72d-cbb7395ce742 admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:19.866120 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be1ceda-87ba-4912-a72d-cbb7395ce742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:19.868048 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be1ceda-87ba-4912-a72d-cbb7395ce742 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:19.888659 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1048/2065] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:06:19 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:06:19.893034 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17919d-a7d6-4305-8bcb-93de67de22b3 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:19.904526 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17919d-a7d6-4305-8bcb-93de67de22b3 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:19.909365 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b732f-84e6-48bd-9abc-9cb37ac11dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:19.910029 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b732f-84e6-48bd-9abc-9cb37ac11dfb admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:19.910305 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b732f-84e6-48bd-9abc-9cb37ac11dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:19.910576 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b732f-84e6-48bd-9abc-9cb37ac11dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:19.911299 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7b732f-84e6-48bd-9abc-9cb37ac11dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:19.912966 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7b732f-84e6-48bd-9abc-9cb37ac11dfb admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:19.926226 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1018/2066] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:06:19.927509 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1ceda-87ba-4912-a72d-cbb7395ce742 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:19.938435 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1ceda-87ba-4912-a72d-cbb7395ce742 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:19.943580 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ff261-2f8a-4511-afae-2f77215e5975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:19.944282 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ff261-2f8a-4511-afae-2f77215e5975 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:19.944553 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ff261-2f8a-4511-afae-2f77215e5975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:19.944812 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ff261-2f8a-4511-afae-2f77215e5975 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:19.945537 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ff261-2f8a-4511-afae-2f77215e5975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:19.947122 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ff261-2f8a-4511-afae-2f77215e5975 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:19.957788 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1049/2067] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:06:19.962096 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b732f-84e6-48bd-9abc-9cb37ac11dfb admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:19.973029 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b732f-84e6-48bd-9abc-9cb37ac11dfb admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:19.978213 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623dd10-5a53-4d77-90e4-87f246d9ca23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:19.979104 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623dd10-5a53-4d77-90e4-87f246d9ca23 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:19.979501 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623dd10-5a53-4d77-90e4-87f246d9ca23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:19.979804 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623dd10-5a53-4d77-90e4-87f246d9ca23 admin admin] PATH_INFO: `/v3/projects/778adf14caa840f999c3f959d80cffa6/users/aa388f037bbb471fb19d222e98db586e/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:19.994388 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623dd10-5a53-4d77-90e4-87f246d9ca23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=778adf14caa840f999c3f959d80cffa6, user_id=aa388f037bbb471fb19d222e98db586e, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:19.997112 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623dd10-5a53-4d77-90e4-87f246d9ca23 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:20.011664 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1019/2068] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:06:19 2022] PUT /identity/v3/projects/778adf14caa840f999c3f959d80cffa6/users/aa388f037bbb471fb19d222e98db586e/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:06:20.023797 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88968c56-6014-419f-90a5-0ed579cd77cf None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:20.024059 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88968c56-6014-419f-90a5-0ed579cd77cf None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:20.024325 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88968c56-6014-419f-90a5-0ed579cd77cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:20.051773 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-88968c56-6014-419f-90a5-0ed579cd77cf None None] MFA Rules not processed for user `aa388f037bbb471fb19d222e98db586e`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:06:20.052993 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-88968c56-6014-419f-90a5-0ed579cd77cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:20.115167 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1050/2069] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:06:20 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:06:20.127336 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623dd10-5a53-4d77-90e4-87f246d9ca23 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:20.129275 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-1623dd10-5a53-4d77-90e4-87f246d9ca23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:20.187611 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623dd10-5a53-4d77-90e4-87f246d9ca23 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:20.191416 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7990efc-4f7c-470b-b385-4f470d83a7eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:20.192093 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7990efc-4f7c-470b-b385-4f470d83a7eb service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:20.192358 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7990efc-4f7c-470b-b385-4f470d83a7eb service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:20.192644 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7990efc-4f7c-470b-b385-4f470d83a7eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:20.201217 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7990efc-4f7c-470b-b385-4f470d83a7eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:20.202714 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7990efc-4f7c-470b-b385-4f470d83a7eb service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:20.213869 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1020/2070] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:06:20 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:06:21.039329 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88968c56-6014-419f-90a5-0ed579cd77cf None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:21.049068 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88968c56-6014-419f-90a5-0ed579cd77cf None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:21.052937 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3c230-4a6b-4230-9377-26c64211be3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:21.053573 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3c230-4a6b-4230-9377-26c64211be3d service cinder] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:21.053844 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3c230-4a6b-4230-9377-26c64211be3d service cinder] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:21.054113 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3c230-4a6b-4230-9377-26c64211be3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:21.056030 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-a5c3c230-4a6b-4230-9377-26c64211be3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:21.119562 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3c230-4a6b-4230-9377-26c64211be3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:21.121074 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3c230-4a6b-4230-9377-26c64211be3d service cinder] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:21.130541 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1051/2071] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:06:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:06:23.170021 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7990efc-4f7c-470b-b385-4f470d83a7eb service cinder] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:23.171568 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-b7990efc-4f7c-470b-b385-4f470d83a7eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:23.237583 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7990efc-4f7c-470b-b385-4f470d83a7eb service cinder] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:23.242428 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838edc5-c5a4-41ab-b837-a4917b52d9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:23.243319 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838edc5-c5a4-41ab-b837-a4917b52d9a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:23.243581 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838edc5-c5a4-41ab-b837-a4917b52d9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:23.243884 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838edc5-c5a4-41ab-b837-a4917b52d9a3 admin admin] PATH_INFO: `/v3/users/2eeeb2c3e48947a69391cce7a4663df6` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:23.245110 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838edc5-c5a4-41ab-b837-a4917b52d9a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eeeb2c3e48947a69391cce7a4663df6)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:23.247040 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838edc5-c5a4-41ab-b837-a4917b52d9a3 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:23.293786 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-7838edc5-c5a4-41ab-b837-a4917b52d9a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eeeb2c3e48947a69391cce7a4663df6'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:23.294454 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-7838edc5-c5a4-41ab-b837-a4917b52d9a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eeeb2c3e48947a69391cce7a4663df6'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:23.305802 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-7838edc5-c5a4-41ab-b837-a4917b52d9a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eeeb2c3e48947a69391cce7a4663df6'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:23.306434 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-7838edc5-c5a4-41ab-b837-a4917b52d9a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eeeb2c3e48947a69391cce7a4663df6'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:23.313361 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-7838edc5-c5a4-41ab-b837-a4917b52d9a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eeeb2c3e48947a69391cce7a4663df6'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:23.329040 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1021/2072] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:06:23 2022] DELETE /identity/v3/users/2eeeb2c3e48947a69391cce7a4663df6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:06:23.333772 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032930a4-d598-4072-b6c6-4c2df904627c None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:23.334251 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032930a4-d598-4072-b6c6-4c2df904627c None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:23.334379 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032930a4-d598-4072-b6c6-4c2df904627c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:23.353062 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-032930a4-d598-4072-b6c6-4c2df904627c None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:06:23.354235 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-032930a4-d598-4072-b6c6-4c2df904627c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:23.422087 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1052/2073] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:06:23.432802 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838edc5-c5a4-41ab-b837-a4917b52d9a3 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:23.434255 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-7838edc5-c5a4-41ab-b837-a4917b52d9a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:23.493624 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838edc5-c5a4-41ab-b837-a4917b52d9a3 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:23.497314 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccdce16-afd5-4cab-b1cf-b63c7b14aae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:23.497964 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdce16-afd5-4cab-b1cf-b63c7b14aae1 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:23.498260 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdce16-afd5-4cab-b1cf-b63c7b14aae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:23.498495 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdce16-afd5-4cab-b1cf-b63c7b14aae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:23.508431 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccdce16-afd5-4cab-b1cf-b63c7b14aae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:23.509919 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccdce16-afd5-4cab-b1cf-b63c7b14aae1 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:23.519701 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1022/2074] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:06:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:06:23.788912 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032930a4-d598-4072-b6c6-4c2df904627c None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:23.790339 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-032930a4-d598-4072-b6c6-4c2df904627c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:23.803968 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032930a4-d598-4072-b6c6-4c2df904627c None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:23.809348 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a58f3-7b18-4a1e-bf01-49ceb000f2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:23.810232 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a58f3-7b18-4a1e-bf01-49ceb000f2fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:23.810507 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a58f3-7b18-4a1e-bf01-49ceb000f2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:23.810778 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a58f3-7b18-4a1e-bf01-49ceb000f2fc admin admin] PATH_INFO: `/v3/projects/0c39feef79894752b1b00d9e452c37f3` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:23.812114 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a58f3-7b18-4a1e-bf01-49ceb000f2fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c39feef79894752b1b00d9e452c37f3)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:23.814024 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a58f3-7b18-4a1e-bf01-49ceb000f2fc admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:23.865111 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-731a58f3-7b18-4a1e-bf01-49ceb000f2fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c39feef79894752b1b00d9e452c37f3', 'request_id': 'req-731a58f3-7b18-4a1e-bf01-49ceb000f2fc'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:23.874520 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-731a58f3-7b18-4a1e-bf01-49ceb000f2fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c39feef79894752b1b00d9e452c37f3', 'request_id': 'req-731a58f3-7b18-4a1e-bf01-49ceb000f2fc'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:23.880877 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-731a58f3-7b18-4a1e-bf01-49ceb000f2fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c39feef79894752b1b00d9e452c37f3', 'request_id': 'req-731a58f3-7b18-4a1e-bf01-49ceb000f2fc'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:23.892112 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-731a58f3-7b18-4a1e-bf01-49ceb000f2fc admin admin] The token cache is being invalidate because project 0c39feef79894752b1b00d9e452c37f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:06:23.892391 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-731a58f3-7b18-4a1e-bf01-49ceb000f2fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:23.893071 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-731a58f3-7b18-4a1e-bf01-49ceb000f2fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:23.894747 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1053/2075] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:06:23 2022] DELETE /identity/v3/projects/0c39feef79894752b1b00d9e452c37f3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:06:23.898776 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccdce16-afd5-4cab-b1cf-b63c7b14aae1 service neutron] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:23.908560 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccdce16-afd5-4cab-b1cf-b63c7b14aae1 service neutron] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:23.964532 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05cc3f-1381-44b9-a98b-76b2a711ca13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:23.965396 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05cc3f-1381-44b9-a98b-76b2a711ca13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:23.965673 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05cc3f-1381-44b9-a98b-76b2a711ca13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:23.965932 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05cc3f-1381-44b9-a98b-76b2a711ca13 admin admin] PATH_INFO: `/v3/users/9370f4098eb24113894b2e1a1987ad8f` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:23.967116 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05cc3f-1381-44b9-a98b-76b2a711ca13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9370f4098eb24113894b2e1a1987ad8f)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:23.969450 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05cc3f-1381-44b9-a98b-76b2a711ca13 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:24.018436 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-6f05cc3f-1381-44b9-a98b-76b2a711ca13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9370f4098eb24113894b2e1a1987ad8f'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:24.019099 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-6f05cc3f-1381-44b9-a98b-76b2a711ca13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9370f4098eb24113894b2e1a1987ad8f'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:24.030054 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-6f05cc3f-1381-44b9-a98b-76b2a711ca13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9370f4098eb24113894b2e1a1987ad8f'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:24.030834 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-6f05cc3f-1381-44b9-a98b-76b2a711ca13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9370f4098eb24113894b2e1a1987ad8f'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:24.037244 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-6f05cc3f-1381-44b9-a98b-76b2a711ca13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9370f4098eb24113894b2e1a1987ad8f'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:24.051985 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1023/2076] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:06:23 2022] DELETE /identity/v3/users/9370f4098eb24113894b2e1a1987ad8f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:06:24.328187 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a58f3-7b18-4a1e-bf01-49ceb000f2fc admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:24.329818 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-731a58f3-7b18-4a1e-bf01-49ceb000f2fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:24.349759 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a58f3-7b18-4a1e-bf01-49ceb000f2fc admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:24.413340 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a20df-5b3f-4dc8-93a1-567ff39aac5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:24.414127 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a20df-5b3f-4dc8-93a1-567ff39aac5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:24.414430 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a20df-5b3f-4dc8-93a1-567ff39aac5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:24.414695 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a20df-5b3f-4dc8-93a1-567ff39aac5d admin admin] PATH_INFO: `/v3/projects/644c2533736c40a4830202239cb208a1` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:24.415886 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a20df-5b3f-4dc8-93a1-567ff39aac5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=644c2533736c40a4830202239cb208a1)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:24.417789 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a20df-5b3f-4dc8-93a1-567ff39aac5d admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:24.466514 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-263a20df-5b3f-4dc8-93a1-567ff39aac5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '644c2533736c40a4830202239cb208a1', 'request_id': 'req-263a20df-5b3f-4dc8-93a1-567ff39aac5d'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:24.476314 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-263a20df-5b3f-4dc8-93a1-567ff39aac5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '644c2533736c40a4830202239cb208a1', 'request_id': 'req-263a20df-5b3f-4dc8-93a1-567ff39aac5d'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:24.483175 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-263a20df-5b3f-4dc8-93a1-567ff39aac5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '644c2533736c40a4830202239cb208a1', 'request_id': 'req-263a20df-5b3f-4dc8-93a1-567ff39aac5d'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:24.493979 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-263a20df-5b3f-4dc8-93a1-567ff39aac5d admin admin] The token cache is being invalidate because project 644c2533736c40a4830202239cb208a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:06:24.494261 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-263a20df-5b3f-4dc8-93a1-567ff39aac5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:24.494892 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-263a20df-5b3f-4dc8-93a1-567ff39aac5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:24.496523 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1054/2077] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:06:24 2022] DELETE /identity/v3/projects/644c2533736c40a4830202239cb208a1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:06:24.501076 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05cc3f-1381-44b9-a98b-76b2a711ca13 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:24.502572 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-6f05cc3f-1381-44b9-a98b-76b2a711ca13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:24.515778 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05cc3f-1381-44b9-a98b-76b2a711ca13 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:24.573640 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8b1a0-4213-4690-bd31-70ddbbc042f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:24.574521 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8b1a0-4213-4690-bd31-70ddbbc042f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:24.574795 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8b1a0-4213-4690-bd31-70ddbbc042f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:24.575059 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8b1a0-4213-4690-bd31-70ddbbc042f0 admin admin] PATH_INFO: `/v3/users/ec4e3c3203054aa49012cdf3b7512de3` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:24.576690 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8b1a0-4213-4690-bd31-70ddbbc042f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec4e3c3203054aa49012cdf3b7512de3)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:24.579625 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8b1a0-4213-4690-bd31-70ddbbc042f0 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:24.629355 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-ecd8b1a0-4213-4690-bd31-70ddbbc042f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec4e3c3203054aa49012cdf3b7512de3'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:24.629990 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-ecd8b1a0-4213-4690-bd31-70ddbbc042f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec4e3c3203054aa49012cdf3b7512de3'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:24.641924 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-ecd8b1a0-4213-4690-bd31-70ddbbc042f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec4e3c3203054aa49012cdf3b7512de3'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:24.642615 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-ecd8b1a0-4213-4690-bd31-70ddbbc042f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec4e3c3203054aa49012cdf3b7512de3'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:24.649290 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-ecd8b1a0-4213-4690-bd31-70ddbbc042f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec4e3c3203054aa49012cdf3b7512de3'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:24.662552 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1024/2078] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:06:24 2022] DELETE /identity/v3/users/ec4e3c3203054aa49012cdf3b7512de3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:06:24.930086 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a20df-5b3f-4dc8-93a1-567ff39aac5d admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:24.931571 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-263a20df-5b3f-4dc8-93a1-567ff39aac5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:24.944316 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a20df-5b3f-4dc8-93a1-567ff39aac5d admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:25.001301 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4e978-0bd4-4f35-b30a-4583717eeba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:25.002167 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4e978-0bd4-4f35-b30a-4583717eeba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:25.002448 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4e978-0bd4-4f35-b30a-4583717eeba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:25.002718 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4e978-0bd4-4f35-b30a-4583717eeba3 admin admin] PATH_INFO: `/v3/projects/d71ee31104d24ebe883a9d4fc462ff51` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:25.003959 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4e978-0bd4-4f35-b30a-4583717eeba3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d71ee31104d24ebe883a9d4fc462ff51)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:25.005873 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4e978-0bd4-4f35-b30a-4583717eeba3 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:25.052741 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a7f4e978-0bd4-4f35-b30a-4583717eeba3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd71ee31104d24ebe883a9d4fc462ff51', 'request_id': 'req-a7f4e978-0bd4-4f35-b30a-4583717eeba3'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:25.060578 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a7f4e978-0bd4-4f35-b30a-4583717eeba3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd71ee31104d24ebe883a9d4fc462ff51', 'request_id': 'req-a7f4e978-0bd4-4f35-b30a-4583717eeba3'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:25.066813 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a7f4e978-0bd4-4f35-b30a-4583717eeba3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd71ee31104d24ebe883a9d4fc462ff51', 'request_id': 'req-a7f4e978-0bd4-4f35-b30a-4583717eeba3'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:25.077997 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a7f4e978-0bd4-4f35-b30a-4583717eeba3 admin admin] The token cache is being invalidate because project d71ee31104d24ebe883a9d4fc462ff51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:06:25.078273 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a7f4e978-0bd4-4f35-b30a-4583717eeba3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:25.078997 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a7f4e978-0bd4-4f35-b30a-4583717eeba3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:25.080821 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1055/2079] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:06:24 2022] DELETE /identity/v3/projects/d71ee31104d24ebe883a9d4fc462ff51 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:06:25.089061 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a6909-5dc4-4991-a535-86445b4420ac None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:25.089513 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a6909-5dc4-4991-a535-86445b4420ac None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:25.089805 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a6909-5dc4-4991-a535-86445b4420ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:25.109254 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-216a6909-5dc4-4991-a535-86445b4420ac None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:06:25.110458 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-216a6909-5dc4-4991-a535-86445b4420ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:25.168626 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1025/2080] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:06:25.179028 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e7d20-92a7-413f-b84f-ef42aea7e1c7 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:25.179209 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e7d20-92a7-413f-b84f-ef42aea7e1c7 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:25.179455 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e7d20-92a7-413f-b84f-ef42aea7e1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:25.199340 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-108e7d20-92a7-413f-b84f-ef42aea7e1c7 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:06:25.200914 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-108e7d20-92a7-413f-b84f-ef42aea7e1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:25.210817 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1056/2081] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:06:25.215153 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a6909-5dc4-4991-a535-86445b4420ac None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:25.225622 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a6909-5dc4-4991-a535-86445b4420ac None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:25.230984 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27277b91-58a8-4f10-bbcb-438854b573c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:25.231630 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27277b91-58a8-4f10-bbcb-438854b573c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:25.231940 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27277b91-58a8-4f10-bbcb-438854b573c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:25.232204 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27277b91-58a8-4f10-bbcb-438854b573c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:25.232913 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27277b91-58a8-4f10-bbcb-438854b573c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:06:25.233212 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27277b91-58a8-4f10-bbcb-438854b573c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:25.235143 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27277b91-58a8-4f10-bbcb-438854b573c4 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:25.246648 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1026/2082] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:06:25.251130 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e7d20-92a7-413f-b84f-ef42aea7e1c7 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:25.261119 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e7d20-92a7-413f-b84f-ef42aea7e1c7 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:25.267498 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13124b25-1181-4161-b190-c4c77afb2738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:25.268176 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13124b25-1181-4161-b190-c4c77afb2738 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:25.268444 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13124b25-1181-4161-b190-c4c77afb2738 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:25.268705 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13124b25-1181-4161-b190-c4c77afb2738 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:25.269377 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13124b25-1181-4161-b190-c4c77afb2738 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:25.271258 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13124b25-1181-4161-b190-c4c77afb2738 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:25.302129 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1057/2083] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:06:25 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:06:25.306531 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27277b91-58a8-4f10-bbcb-438854b573c4 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:25.319180 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27277b91-58a8-4f10-bbcb-438854b573c4 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:25.381105 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7f9c8-09c6-407b-b700-0f5a147c6690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:25.381762 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7f9c8-09c6-407b-b700-0f5a147c6690 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:25.382033 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7f9c8-09c6-407b-b700-0f5a147c6690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:25.382295 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7f9c8-09c6-407b-b700-0f5a147c6690 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:25.382969 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a7f9c8-09c6-407b-b700-0f5a147c6690 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:25.384944 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a7f9c8-09c6-407b-b700-0f5a147c6690 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:25.407951 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1027/2084] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:06:25 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:06:25.411238 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13124b25-1181-4161-b190-c4c77afb2738 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:25.421565 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13124b25-1181-4161-b190-c4c77afb2738 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:25.426314 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450c40c-2880-496e-bace-78723d3310b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:25.426969 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450c40c-2880-496e-bace-78723d3310b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:25.427244 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450c40c-2880-496e-bace-78723d3310b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:25.427513 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450c40c-2880-496e-bace-78723d3310b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:25.428278 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2450c40c-2880-496e-bace-78723d3310b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:25.429949 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2450c40c-2880-496e-bace-78723d3310b9 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:25.440664 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1058/2085] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:06:25.444842 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7f9c8-09c6-407b-b700-0f5a147c6690 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:25.455420 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7f9c8-09c6-407b-b700-0f5a147c6690 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:25.460724 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e04fad-ff3b-4824-a0e8-110d678f4637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:25.461383 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e04fad-ff3b-4824-a0e8-110d678f4637 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:25.461667 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e04fad-ff3b-4824-a0e8-110d678f4637 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:25.461955 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e04fad-ff3b-4824-a0e8-110d678f4637 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:25.462664 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e04fad-ff3b-4824-a0e8-110d678f4637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:25.464310 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e04fad-ff3b-4824-a0e8-110d678f4637 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:25.474592 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1028/2086] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:06:25.478852 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450c40c-2880-496e-bace-78723d3310b9 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:25.490190 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450c40c-2880-496e-bace-78723d3310b9 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:25.498263 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914fbad-c3db-4902-9fb9-9cd175ec00b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:25.499917 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914fbad-c3db-4902-9fb9-9cd175ec00b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:25.500335 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914fbad-c3db-4902-9fb9-9cd175ec00b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:25.500756 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914fbad-c3db-4902-9fb9-9cd175ec00b7 admin admin] PATH_INFO: `/v3/projects/e8ee3b5dbdc94c939ed4354e43e3f682/users/d119531800bf4b35896f65f7c674ad8d/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:25.516365 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d914fbad-c3db-4902-9fb9-9cd175ec00b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8ee3b5dbdc94c939ed4354e43e3f682, user_id=d119531800bf4b35896f65f7c674ad8d, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:25.519464 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d914fbad-c3db-4902-9fb9-9cd175ec00b7 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:25.535963 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1059/2087] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:06:25 2022] PUT /identity/v3/projects/e8ee3b5dbdc94c939ed4354e43e3f682/users/d119531800bf4b35896f65f7c674ad8d/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:06:25.547754 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3a7fc-82bb-4215-b66a-dc8c719d8bd4 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:25.548263 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3a7fc-82bb-4215-b66a-dc8c719d8bd4 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:25.548431 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3a7fc-82bb-4215-b66a-dc8c719d8bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:25.574517 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-d9b3a7fc-82bb-4215-b66a-dc8c719d8bd4 None None] MFA Rules not processed for user `d119531800bf4b35896f65f7c674ad8d`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:06:25.576267 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-d9b3a7fc-82bb-4215-b66a-dc8c719d8bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:25.653929 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1029/2088] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:06:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:06:25.670933 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914fbad-c3db-4902-9fb9-9cd175ec00b7 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:25.672758 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-d914fbad-c3db-4902-9fb9-9cd175ec00b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:25.729924 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914fbad-c3db-4902-9fb9-9cd175ec00b7 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:25.733778 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2452e-501a-484f-91a7-c1178f828d3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:25.734415 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2452e-501a-484f-91a7-c1178f828d3d service cinder] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:25.734692 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2452e-501a-484f-91a7-c1178f828d3d service cinder] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:25.734934 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2452e-501a-484f-91a7-c1178f828d3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:25.743114 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd2452e-501a-484f-91a7-c1178f828d3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:25.744564 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd2452e-501a-484f-91a7-c1178f828d3d service cinder] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:25.753415 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1060/2089] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:06:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:06:49.684274 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3a7fc-82bb-4215-b66a-dc8c719d8bd4 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:49.793665 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3a7fc-82bb-4215-b66a-dc8c719d8bd4 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:49.799254 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449cb3ef-639a-4ff8-84f9-00410a6a6c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:49.800428 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449cb3ef-639a-4ff8-84f9-00410a6a6c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:49.800717 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449cb3ef-639a-4ff8-84f9-00410a6a6c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:49.801012 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449cb3ef-639a-4ff8-84f9-00410a6a6c76 admin admin] PATH_INFO: `/v3/users/d119531800bf4b35896f65f7c674ad8d` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:49.802505 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449cb3ef-639a-4ff8-84f9-00410a6a6c76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d119531800bf4b35896f65f7c674ad8d)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:49.805067 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449cb3ef-639a-4ff8-84f9-00410a6a6c76 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:49.855148 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-449cb3ef-639a-4ff8-84f9-00410a6a6c76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd119531800bf4b35896f65f7c674ad8d'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:49.855743 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-449cb3ef-639a-4ff8-84f9-00410a6a6c76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd119531800bf4b35896f65f7c674ad8d'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:49.867676 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-449cb3ef-639a-4ff8-84f9-00410a6a6c76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd119531800bf4b35896f65f7c674ad8d'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:49.868408 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-449cb3ef-639a-4ff8-84f9-00410a6a6c76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd119531800bf4b35896f65f7c674ad8d'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:49.877830 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-449cb3ef-639a-4ff8-84f9-00410a6a6c76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd119531800bf4b35896f65f7c674ad8d'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:49.898930 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1030/2090] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:06:49 2022] DELETE /identity/v3/users/d119531800bf4b35896f65f7c674ad8d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:06:49.903694 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad307ccc-15c9-4c8f-a9b3-7586c041b084 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:49.904245 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad307ccc-15c9-4c8f-a9b3-7586c041b084 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:49.904245 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad307ccc-15c9-4c8f-a9b3-7586c041b084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:49.953159 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-ad307ccc-15c9-4c8f-a9b3-7586c041b084 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:06:49.954386 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-ad307ccc-15c9-4c8f-a9b3-7586c041b084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:50.015296 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1061/2091] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:06:50.027306 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449cb3ef-639a-4ff8-84f9-00410a6a6c76 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:50.028994 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-449cb3ef-639a-4ff8-84f9-00410a6a6c76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:50.126930 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449cb3ef-639a-4ff8-84f9-00410a6a6c76 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:50.132187 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd0cff-1db6-4ea2-a1af-224a41144c38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:50.132418 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd0cff-1db6-4ea2-a1af-224a41144c38 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:50.132570 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd0cff-1db6-4ea2-a1af-224a41144c38 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:50.132846 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd0cff-1db6-4ea2-a1af-224a41144c38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:50.142539 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd0cff-1db6-4ea2-a1af-224a41144c38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:50.144020 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd0cff-1db6-4ea2-a1af-224a41144c38 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:50.154278 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1031/2092] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:06:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:06:50.432810 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad307ccc-15c9-4c8f-a9b3-7586c041b084 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:50.434444 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-ad307ccc-15c9-4c8f-a9b3-7586c041b084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:50.446969 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad307ccc-15c9-4c8f-a9b3-7586c041b084 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:50.453089 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47823702-b0f1-4a54-bbb8-b1e09e0f8aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:50.453964 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47823702-b0f1-4a54-bbb8-b1e09e0f8aeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:50.454260 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47823702-b0f1-4a54-bbb8-b1e09e0f8aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:50.454528 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47823702-b0f1-4a54-bbb8-b1e09e0f8aeb admin admin] PATH_INFO: `/v3/projects/e8ee3b5dbdc94c939ed4354e43e3f682` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:50.455826 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47823702-b0f1-4a54-bbb8-b1e09e0f8aeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8ee3b5dbdc94c939ed4354e43e3f682)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:50.457739 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47823702-b0f1-4a54-bbb8-b1e09e0f8aeb admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:50.508023 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-47823702-b0f1-4a54-bbb8-b1e09e0f8aeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8ee3b5dbdc94c939ed4354e43e3f682', 'request_id': 'req-47823702-b0f1-4a54-bbb8-b1e09e0f8aeb'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:50.517539 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-47823702-b0f1-4a54-bbb8-b1e09e0f8aeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8ee3b5dbdc94c939ed4354e43e3f682', 'request_id': 'req-47823702-b0f1-4a54-bbb8-b1e09e0f8aeb'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:50.524716 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-47823702-b0f1-4a54-bbb8-b1e09e0f8aeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8ee3b5dbdc94c939ed4354e43e3f682', 'request_id': 'req-47823702-b0f1-4a54-bbb8-b1e09e0f8aeb'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:50.535691 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-47823702-b0f1-4a54-bbb8-b1e09e0f8aeb admin admin] The token cache is being invalidate because project e8ee3b5dbdc94c939ed4354e43e3f682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:06:50.536020 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-47823702-b0f1-4a54-bbb8-b1e09e0f8aeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:50.536678 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-47823702-b0f1-4a54-bbb8-b1e09e0f8aeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:06:50.538254 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1062/2093] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:06:50 2022] DELETE /identity/v3/projects/e8ee3b5dbdc94c939ed4354e43e3f682 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:06:50.544851 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653d12f-1c8f-4e88-b3d2-f3ee1107bc9a None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:50.545211 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653d12f-1c8f-4e88-b3d2-f3ee1107bc9a None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:50.545577 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653d12f-1c8f-4e88-b3d2-f3ee1107bc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:50.594118 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-e653d12f-1c8f-4e88-b3d2-f3ee1107bc9a None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:06:50.595329 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-e653d12f-1c8f-4e88-b3d2-f3ee1107bc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:50.657616 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1032/2094] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:06:50.665919 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a76190-35f0-4356-8add-723335e6136d None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:50.666205 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a76190-35f0-4356-8add-723335e6136d None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:50.666476 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a76190-35f0-4356-8add-723335e6136d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:50.685410 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-93a76190-35f0-4356-8add-723335e6136d None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:06:50.686630 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-93a76190-35f0-4356-8add-723335e6136d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:50.695168 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1063/2095] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:06:50.699793 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653d12f-1c8f-4e88-b3d2-f3ee1107bc9a None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:50.710843 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653d12f-1c8f-4e88-b3d2-f3ee1107bc9a None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:50.716538 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a1349-7ad0-4520-b706-63ee9a417262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:50.717189 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a1349-7ad0-4520-b706-63ee9a417262 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:50.717459 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a1349-7ad0-4520-b706-63ee9a417262 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:50.717719 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a1349-7ad0-4520-b706-63ee9a417262 admin admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:50.718432 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a1349-7ad0-4520-b706-63ee9a417262 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:06:50.718728 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a1349-7ad0-4520-b706-63ee9a417262 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:50.720363 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a1349-7ad0-4520-b706-63ee9a417262 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:50.732753 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1033/2096] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:06:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:06:50.737291 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a76190-35f0-4356-8add-723335e6136d None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:50.747123 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a76190-35f0-4356-8add-723335e6136d None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:50.752287 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fbb63-28fc-4694-ab85-1a54a21ded80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:50.752925 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fbb63-28fc-4694-ab85-1a54a21ded80 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:50.753627 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fbb63-28fc-4694-ab85-1a54a21ded80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:50.753627 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fbb63-28fc-4694-ab85-1a54a21ded80 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:50.754172 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fbb63-28fc-4694-ab85-1a54a21ded80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:50.756089 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fbb63-28fc-4694-ab85-1a54a21ded80 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:50.783523 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1064/2097] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:06:50 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:06:50.789808 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a1349-7ad0-4520-b706-63ee9a417262 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:50.800130 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a1349-7ad0-4520-b706-63ee9a417262 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:50.858785 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775443f3-9455-4dc9-bfb7-71cb8aa4dba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:50.859469 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775443f3-9455-4dc9-bfb7-71cb8aa4dba6 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:50.859757 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775443f3-9455-4dc9-bfb7-71cb8aa4dba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:50.860028 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775443f3-9455-4dc9-bfb7-71cb8aa4dba6 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:50.860721 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775443f3-9455-4dc9-bfb7-71cb8aa4dba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:50.862667 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775443f3-9455-4dc9-bfb7-71cb8aa4dba6 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:50.886030 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1034/2098] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:06:50 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:06:50.890750 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fbb63-28fc-4694-ab85-1a54a21ded80 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:50.903964 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fbb63-28fc-4694-ab85-1a54a21ded80 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:50.909145 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511343d-f993-4f72-8b0b-5b363f44d866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:50.909722 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511343d-f993-4f72-8b0b-5b363f44d866 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:50.909998 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511343d-f993-4f72-8b0b-5b363f44d866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:50.910269 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511343d-f993-4f72-8b0b-5b363f44d866 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:50.911000 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511343d-f993-4f72-8b0b-5b363f44d866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:50.912662 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511343d-f993-4f72-8b0b-5b363f44d866 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:50.925805 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1065/2099] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:06:50.930697 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775443f3-9455-4dc9-bfb7-71cb8aa4dba6 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:50.943975 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775443f3-9455-4dc9-bfb7-71cb8aa4dba6 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:50.950830 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00295326-00ef-417d-95b4-2125e1c02032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:50.951537 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00295326-00ef-417d-95b4-2125e1c02032 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:50.951835 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00295326-00ef-417d-95b4-2125e1c02032 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:50.952102 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00295326-00ef-417d-95b4-2125e1c02032 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:50.952818 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00295326-00ef-417d-95b4-2125e1c02032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:50.954421 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00295326-00ef-417d-95b4-2125e1c02032 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:50.965413 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1035/2100] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:06:50.972174 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511343d-f993-4f72-8b0b-5b363f44d866 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:50.985788 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511343d-f993-4f72-8b0b-5b363f44d866 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:50.992871 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439e78b-e9cf-45a3-85fb-197435c895b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:50.994180 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439e78b-e9cf-45a3-85fb-197435c895b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:50.994453 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439e78b-e9cf-45a3-85fb-197435c895b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:50.994718 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439e78b-e9cf-45a3-85fb-197435c895b5 admin admin] PATH_INFO: `/v3/projects/d753aa9bc3fb4030b74948494f14f77a/users/44082556cc37483cb43f01a9a3f05973/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:51.014455 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439e78b-e9cf-45a3-85fb-197435c895b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d753aa9bc3fb4030b74948494f14f77a, user_id=44082556cc37483cb43f01a9a3f05973, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:51.017163 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439e78b-e9cf-45a3-85fb-197435c895b5 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:51.032488 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1066/2101] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:06:50 2022] PUT /identity/v3/projects/d753aa9bc3fb4030b74948494f14f77a/users/44082556cc37483cb43f01a9a3f05973/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:06:51.043886 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5541e3-bfb5-44ed-9e3a-b8a5a8771b31 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:51.044165 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5541e3-bfb5-44ed-9e3a-b8a5a8771b31 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:51.044431 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5541e3-bfb5-44ed-9e3a-b8a5a8771b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:51.072972 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-ad5541e3-bfb5-44ed-9e3a-b8a5a8771b31 None None] MFA Rules not processed for user `44082556cc37483cb43f01a9a3f05973`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:06:51.074209 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-ad5541e3-bfb5-44ed-9e3a-b8a5a8771b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:51.146803 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1036/2102] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:06:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:06:51.158098 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439e78b-e9cf-45a3-85fb-197435c895b5 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:06:51.160250 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-1439e78b-e9cf-45a3-85fb-197435c895b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:06:51.219126 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439e78b-e9cf-45a3-85fb-197435c895b5 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:06:51.222760 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ea882-b537-4df5-84be-2575bd886f5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:06:51.223450 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ea882-b537-4df5-84be-2575bd886f5b service cinder] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:06:51.223691 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ea882-b537-4df5-84be-2575bd886f5b service cinder] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:06:51.224007 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ea882-b537-4df5-84be-2575bd886f5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:06:51.233163 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ea882-b537-4df5-84be-2575bd886f5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:06:51.234589 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ea882-b537-4df5-84be-2575bd886f5b service cinder] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:06:51.243667 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1067/2103] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:06:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:07:10.638731 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5541e3-bfb5-44ed-9e3a-b8a5a8771b31 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:10.711447 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5541e3-bfb5-44ed-9e3a-b8a5a8771b31 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:10.716250 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20bfd11-22d4-4643-98a5-124314289f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:10.717159 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20bfd11-22d4-4643-98a5-124314289f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:10.717427 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20bfd11-22d4-4643-98a5-124314289f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:10.717698 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20bfd11-22d4-4643-98a5-124314289f94 admin admin] PATH_INFO: `/v3/users/44082556cc37483cb43f01a9a3f05973` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:10.718910 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20bfd11-22d4-4643-98a5-124314289f94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44082556cc37483cb43f01a9a3f05973)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:10.720889 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20bfd11-22d4-4643-98a5-124314289f94 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:10.770128 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-b20bfd11-22d4-4643-98a5-124314289f94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44082556cc37483cb43f01a9a3f05973'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:10.770777 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-b20bfd11-22d4-4643-98a5-124314289f94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44082556cc37483cb43f01a9a3f05973'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:10.782814 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-b20bfd11-22d4-4643-98a5-124314289f94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44082556cc37483cb43f01a9a3f05973'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:10.783500 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-b20bfd11-22d4-4643-98a5-124314289f94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44082556cc37483cb43f01a9a3f05973'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:10.790384 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-b20bfd11-22d4-4643-98a5-124314289f94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44082556cc37483cb43f01a9a3f05973'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:10.804512 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1037/2104] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:07:10 2022] DELETE /identity/v3/users/44082556cc37483cb43f01a9a3f05973 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:07:10.809101 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc187cf4-7280-4dfa-bd07-e911b0edd3c0 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:10.809590 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc187cf4-7280-4dfa-bd07-e911b0edd3c0 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:10.809682 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc187cf4-7280-4dfa-bd07-e911b0edd3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:10.827950 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-cc187cf4-7280-4dfa-bd07-e911b0edd3c0 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:07:10.829121 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-cc187cf4-7280-4dfa-bd07-e911b0edd3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:10.896888 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1068/2105] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:07:10.905790 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20bfd11-22d4-4643-98a5-124314289f94 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:10.907409 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-b20bfd11-22d4-4643-98a5-124314289f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:10.967704 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20bfd11-22d4-4643-98a5-124314289f94 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:10.972014 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b1ead-6569-4a7c-83bf-31de0637ee5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:10.972665 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b1ead-6569-4a7c-83bf-31de0637ee5a service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:10.972942 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b1ead-6569-4a7c-83bf-31de0637ee5a service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:10.973208 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b1ead-6569-4a7c-83bf-31de0637ee5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:10.983406 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b1ead-6569-4a7c-83bf-31de0637ee5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:10.984897 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b1ead-6569-4a7c-83bf-31de0637ee5a service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:10.994911 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1038/2106] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:07:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:07:11.304860 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc187cf4-7280-4dfa-bd07-e911b0edd3c0 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:11.307097 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-cc187cf4-7280-4dfa-bd07-e911b0edd3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:11.325065 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc187cf4-7280-4dfa-bd07-e911b0edd3c0 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:11.330955 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26982aa1-3f17-4681-862a-6042fc5e85c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:11.332216 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26982aa1-3f17-4681-862a-6042fc5e85c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:11.332777 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26982aa1-3f17-4681-862a-6042fc5e85c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:11.333111 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26982aa1-3f17-4681-862a-6042fc5e85c5 admin admin] PATH_INFO: `/v3/projects/d753aa9bc3fb4030b74948494f14f77a` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:11.334636 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26982aa1-3f17-4681-862a-6042fc5e85c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d753aa9bc3fb4030b74948494f14f77a)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:11.336928 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26982aa1-3f17-4681-862a-6042fc5e85c5 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:11.386869 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-26982aa1-3f17-4681-862a-6042fc5e85c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd753aa9bc3fb4030b74948494f14f77a', 'request_id': 'req-26982aa1-3f17-4681-862a-6042fc5e85c5'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:11.394993 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-26982aa1-3f17-4681-862a-6042fc5e85c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd753aa9bc3fb4030b74948494f14f77a', 'request_id': 'req-26982aa1-3f17-4681-862a-6042fc5e85c5'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:11.401313 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-26982aa1-3f17-4681-862a-6042fc5e85c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd753aa9bc3fb4030b74948494f14f77a', 'request_id': 'req-26982aa1-3f17-4681-862a-6042fc5e85c5'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:11.411947 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-26982aa1-3f17-4681-862a-6042fc5e85c5 admin admin] The token cache is being invalidate because project d753aa9bc3fb4030b74948494f14f77a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:07:11.412230 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-26982aa1-3f17-4681-862a-6042fc5e85c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:11.412897 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-26982aa1-3f17-4681-862a-6042fc5e85c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:11.414561 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1069/2107] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:07:11 2022] DELETE /identity/v3/projects/d753aa9bc3fb4030b74948494f14f77a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:07:12.229417 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b1ead-6569-4a7c-83bf-31de0637ee5a service neutron] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:12.230994 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-0e4b1ead-6569-4a7c-83bf-31de0637ee5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:12.244011 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b1ead-6569-4a7c-83bf-31de0637ee5a service neutron] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:12.299902 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479b53b-7199-4bb5-9d84-e533eadda1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:12.300771 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479b53b-7199-4bb5-9d84-e533eadda1a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:12.301050 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479b53b-7199-4bb5-9d84-e533eadda1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:12.301318 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479b53b-7199-4bb5-9d84-e533eadda1a7 admin admin] PATH_INFO: `/v3/users/aa388f037bbb471fb19d222e98db586e` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:12.302514 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479b53b-7199-4bb5-9d84-e533eadda1a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa388f037bbb471fb19d222e98db586e)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:12.304499 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479b53b-7199-4bb5-9d84-e533eadda1a7 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:12.360091 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-d479b53b-7199-4bb5-9d84-e533eadda1a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa388f037bbb471fb19d222e98db586e'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:12.361839 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-d479b53b-7199-4bb5-9d84-e533eadda1a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa388f037bbb471fb19d222e98db586e'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:12.380083 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-d479b53b-7199-4bb5-9d84-e533eadda1a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa388f037bbb471fb19d222e98db586e'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:12.380847 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-d479b53b-7199-4bb5-9d84-e533eadda1a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa388f037bbb471fb19d222e98db586e'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:12.388444 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-d479b53b-7199-4bb5-9d84-e533eadda1a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa388f037bbb471fb19d222e98db586e'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:12.402724 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1039/2108] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:07:12 2022] DELETE /identity/v3/users/aa388f037bbb471fb19d222e98db586e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:07:12.407320 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861808f6-c689-4e6c-98d6-9a640483d68c None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:12.407853 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861808f6-c689-4e6c-98d6-9a640483d68c None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:12.407945 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861808f6-c689-4e6c-98d6-9a640483d68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:12.426151 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-861808f6-c689-4e6c-98d6-9a640483d68c None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:07:12.427636 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-861808f6-c689-4e6c-98d6-9a640483d68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:12.486555 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1070/2109] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:07:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:07:12.496705 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479b53b-7199-4bb5-9d84-e533eadda1a7 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:12.498250 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-d479b53b-7199-4bb5-9d84-e533eadda1a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:12.555667 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479b53b-7199-4bb5-9d84-e533eadda1a7 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:12.559624 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25830624-791b-4a68-8c8e-6f1d059374aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:12.560288 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25830624-791b-4a68-8c8e-6f1d059374aa service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:12.560559 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25830624-791b-4a68-8c8e-6f1d059374aa service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:12.560822 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25830624-791b-4a68-8c8e-6f1d059374aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:12.570011 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25830624-791b-4a68-8c8e-6f1d059374aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:12.571471 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25830624-791b-4a68-8c8e-6f1d059374aa service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:12.581525 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1040/2110] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:07:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:07:12.867804 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861808f6-c689-4e6c-98d6-9a640483d68c None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:12.869300 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-861808f6-c689-4e6c-98d6-9a640483d68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:12.881671 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861808f6-c689-4e6c-98d6-9a640483d68c None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:12.887468 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817d4a4-b9da-4233-9d30-3bb5127f7094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:12.888587 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817d4a4-b9da-4233-9d30-3bb5127f7094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:12.888868 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817d4a4-b9da-4233-9d30-3bb5127f7094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:12.889118 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817d4a4-b9da-4233-9d30-3bb5127f7094 admin admin] PATH_INFO: `/v3/projects/778adf14caa840f999c3f959d80cffa6` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:12.890449 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817d4a4-b9da-4233-9d30-3bb5127f7094 admin admin] RBAC: Authorizing `identity:delete_project(project_id=778adf14caa840f999c3f959d80cffa6)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:12.892585 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817d4a4-b9da-4233-9d30-3bb5127f7094 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:12.942474 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-7817d4a4-b9da-4233-9d30-3bb5127f7094 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '778adf14caa840f999c3f959d80cffa6', 'request_id': 'req-7817d4a4-b9da-4233-9d30-3bb5127f7094'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:12.952171 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-7817d4a4-b9da-4233-9d30-3bb5127f7094 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '778adf14caa840f999c3f959d80cffa6', 'request_id': 'req-7817d4a4-b9da-4233-9d30-3bb5127f7094'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:12.958872 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-7817d4a4-b9da-4233-9d30-3bb5127f7094 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '778adf14caa840f999c3f959d80cffa6', 'request_id': 'req-7817d4a4-b9da-4233-9d30-3bb5127f7094'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:12.968996 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-7817d4a4-b9da-4233-9d30-3bb5127f7094 admin admin] The token cache is being invalidate because project 778adf14caa840f999c3f959d80cffa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:07:12.969272 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-7817d4a4-b9da-4233-9d30-3bb5127f7094 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:12.969931 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-7817d4a4-b9da-4233-9d30-3bb5127f7094 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:12.971523 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1071/2111] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:07:12 2022] DELETE /identity/v3/projects/778adf14caa840f999c3f959d80cffa6 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:07:12.976973 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a2894-fd3a-4d19-a2a9-05492807c0d6 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:12.977162 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a2894-fd3a-4d19-a2a9-05492807c0d6 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:12.977439 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a2894-fd3a-4d19-a2a9-05492807c0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:12.995466 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-f12a2894-fd3a-4d19-a2a9-05492807c0d6 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:07:12.996688 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-f12a2894-fd3a-4d19-a2a9-05492807c0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:13.063600 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1041/2112] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:07:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:07:13.072130 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171ee5e-1b27-4bda-b39d-fcc57dbabee2 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:13.072418 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171ee5e-1b27-4bda-b39d-fcc57dbabee2 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:13.072657 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171ee5e-1b27-4bda-b39d-fcc57dbabee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:13.094552 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-c171ee5e-1b27-4bda-b39d-fcc57dbabee2 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:07:13.095988 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-c171ee5e-1b27-4bda-b39d-fcc57dbabee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:13.105734 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1072/2113] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:07:13.119673 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a2894-fd3a-4d19-a2a9-05492807c0d6 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:13.131429 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a2894-fd3a-4d19-a2a9-05492807c0d6 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:13.138266 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef177fb-797f-4002-b39f-a812decf4ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:13.138266 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef177fb-797f-4002-b39f-a812decf4ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:13.138266 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef177fb-797f-4002-b39f-a812decf4ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:13.138694 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef177fb-797f-4002-b39f-a812decf4ed5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:13.139428 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef177fb-797f-4002-b39f-a812decf4ed5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:07:13.139752 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef177fb-797f-4002-b39f-a812decf4ed5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:13.141437 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef177fb-797f-4002-b39f-a812decf4ed5 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:13.153859 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1042/2114] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 03:07:13.158689 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171ee5e-1b27-4bda-b39d-fcc57dbabee2 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:13.168897 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171ee5e-1b27-4bda-b39d-fcc57dbabee2 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:13.174432 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0947d-5d23-4c8b-b685-45c9945bd453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:13.175131 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0947d-5d23-4c8b-b685-45c9945bd453 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:13.175404 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0947d-5d23-4c8b-b685-45c9945bd453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:13.175676 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0947d-5d23-4c8b-b685-45c9945bd453 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:13.176719 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0947d-5d23-4c8b-b685-45c9945bd453 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:13.178767 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0947d-5d23-4c8b-b685-45c9945bd453 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:13.209733 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1073/2115] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:07:13 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 03:07:13.211170 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef177fb-797f-4002-b39f-a812decf4ed5 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:13.229980 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef177fb-797f-4002-b39f-a812decf4ed5 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:13.286149 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b785d7-ea1e-4c8e-b069-1e65eef5d633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:13.286916 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b785d7-ea1e-4c8e-b069-1e65eef5d633 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:13.287256 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b785d7-ea1e-4c8e-b069-1e65eef5d633 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:13.287591 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b785d7-ea1e-4c8e-b069-1e65eef5d633 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:13.288380 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b785d7-ea1e-4c8e-b069-1e65eef5d633 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:13.290293 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b785d7-ea1e-4c8e-b069-1e65eef5d633 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:13.314500 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1043/2116] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:07:13 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:07:13.316050 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0947d-5d23-4c8b-b685-45c9945bd453 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:13.327423 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0947d-5d23-4c8b-b685-45c9945bd453 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:13.333295 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d79fba-7f27-4be3-9061-7f0480dc63d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:13.334035 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d79fba-7f27-4be3-9061-7f0480dc63d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:13.334324 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d79fba-7f27-4be3-9061-7f0480dc63d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:13.334577 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d79fba-7f27-4be3-9061-7f0480dc63d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:13.335303 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d79fba-7f27-4be3-9061-7f0480dc63d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:13.336958 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d79fba-7f27-4be3-9061-7f0480dc63d9 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:13.348686 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1074/2117] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:07:13.352826 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b785d7-ea1e-4c8e-b069-1e65eef5d633 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:13.363130 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b785d7-ea1e-4c8e-b069-1e65eef5d633 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:13.367937 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe03fe-7506-40ee-ada2-262cd475846f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:13.368600 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe03fe-7506-40ee-ada2-262cd475846f admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:13.368878 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe03fe-7506-40ee-ada2-262cd475846f admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:13.369145 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe03fe-7506-40ee-ada2-262cd475846f admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:13.369864 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe03fe-7506-40ee-ada2-262cd475846f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:13.371459 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe03fe-7506-40ee-ada2-262cd475846f admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:13.383124 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1044/2118] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:07:13.387387 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d79fba-7f27-4be3-9061-7f0480dc63d9 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:13.397524 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d79fba-7f27-4be3-9061-7f0480dc63d9 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:13.402084 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557011a-963c-4f47-9789-d83eaa50ad8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:13.403008 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557011a-963c-4f47-9789-d83eaa50ad8c admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:13.403290 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557011a-963c-4f47-9789-d83eaa50ad8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:13.403545 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557011a-963c-4f47-9789-d83eaa50ad8c admin admin] PATH_INFO: `/v3/projects/e64394d941474609a234d3c3f0b133de/users/59f4af823e3b43308f293d440750d0fd/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:13.423948 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557011a-963c-4f47-9789-d83eaa50ad8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e64394d941474609a234d3c3f0b133de, user_id=59f4af823e3b43308f293d440750d0fd, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:13.426676 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557011a-963c-4f47-9789-d83eaa50ad8c admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:13.442166 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1075/2119] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:07:13 2022] PUT /identity/v3/projects/e64394d941474609a234d3c3f0b133de/users/59f4af823e3b43308f293d440750d0fd/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:07:13.453557 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877442d5-8f3d-4bf5-90a3-780190744a9e None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:13.453841 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877442d5-8f3d-4bf5-90a3-780190744a9e None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:13.454114 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877442d5-8f3d-4bf5-90a3-780190744a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:13.483635 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-877442d5-8f3d-4bf5-90a3-780190744a9e None None] MFA Rules not processed for user `59f4af823e3b43308f293d440750d0fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:07:13.484868 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-877442d5-8f3d-4bf5-90a3-780190744a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:13.555861 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1045/2120] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:07:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:07:13.569169 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557011a-963c-4f47-9789-d83eaa50ad8c admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:13.571990 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-2557011a-963c-4f47-9789-d83eaa50ad8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:13.652799 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557011a-963c-4f47-9789-d83eaa50ad8c admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:13.656707 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526eec5-7a6f-44e4-9f31-097e94d17f3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:13.657368 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526eec5-7a6f-44e4-9f31-097e94d17f3c service cinder] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:13.657648 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526eec5-7a6f-44e4-9f31-097e94d17f3c service cinder] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:13.657900 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526eec5-7a6f-44e4-9f31-097e94d17f3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:13.667021 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526eec5-7a6f-44e4-9f31-097e94d17f3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:13.668482 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526eec5-7a6f-44e4-9f31-097e94d17f3c service cinder] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:13.677429 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1076/2121] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:07:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:07:13.703001 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877442d5-8f3d-4bf5-90a3-780190744a9e None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:13.766580 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877442d5-8f3d-4bf5-90a3-780190744a9e None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:13.772390 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a7b56-fdb9-46cd-b394-a37cf96163fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:13.773265 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a7b56-fdb9-46cd-b394-a37cf96163fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:13.773547 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a7b56-fdb9-46cd-b394-a37cf96163fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:13.773818 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a7b56-fdb9-46cd-b394-a37cf96163fa admin admin] PATH_INFO: `/v3/users/59f4af823e3b43308f293d440750d0fd` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:13.775099 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a7b56-fdb9-46cd-b394-a37cf96163fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=59f4af823e3b43308f293d440750d0fd)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:13.777106 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a7b56-fdb9-46cd-b394-a37cf96163fa admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:13.833655 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-b61a7b56-fdb9-46cd-b394-a37cf96163fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59f4af823e3b43308f293d440750d0fd'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:13.835009 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-b61a7b56-fdb9-46cd-b394-a37cf96163fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59f4af823e3b43308f293d440750d0fd'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:13.853274 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-b61a7b56-fdb9-46cd-b394-a37cf96163fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59f4af823e3b43308f293d440750d0fd'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:13.854065 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-b61a7b56-fdb9-46cd-b394-a37cf96163fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59f4af823e3b43308f293d440750d0fd'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:13.861654 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-b61a7b56-fdb9-46cd-b394-a37cf96163fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59f4af823e3b43308f293d440750d0fd'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:13.875179 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1046/2122] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:07:13 2022] DELETE /identity/v3/users/59f4af823e3b43308f293d440750d0fd => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:07:13.879918 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a0e46-900f-40e8-9382-8f53ef7171f3 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:13.880245 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a0e46-900f-40e8-9382-8f53ef7171f3 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:13.880514 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a0e46-900f-40e8-9382-8f53ef7171f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:13.898686 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-762a0e46-900f-40e8-9382-8f53ef7171f3 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:07:13.899971 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-762a0e46-900f-40e8-9382-8f53ef7171f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:13.966910 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1077/2123] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:07:13.978308 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a7b56-fdb9-46cd-b394-a37cf96163fa admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:13.979766 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-b61a7b56-fdb9-46cd-b394-a37cf96163fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:14.035969 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a7b56-fdb9-46cd-b394-a37cf96163fa admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:14.040070 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a2e97-5086-4dd6-841d-55eebe731653 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:14.040703 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a2e97-5086-4dd6-841d-55eebe731653 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:14.040974 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a2e97-5086-4dd6-841d-55eebe731653 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:14.041239 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a2e97-5086-4dd6-841d-55eebe731653 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:14.050470 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193a2e97-5086-4dd6-841d-55eebe731653 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:14.052129 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193a2e97-5086-4dd6-841d-55eebe731653 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:14.061909 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1047/2124] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:07:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:07:14.338372 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a0e46-900f-40e8-9382-8f53ef7171f3 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:14.340350 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-762a0e46-900f-40e8-9382-8f53ef7171f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:14.359553 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a0e46-900f-40e8-9382-8f53ef7171f3 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:14.372142 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4f76c-5dc2-44c5-82b0-779e8151dd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:14.373048 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4f76c-5dc2-44c5-82b0-779e8151dd9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:14.374040 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4f76c-5dc2-44c5-82b0-779e8151dd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:14.374320 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4f76c-5dc2-44c5-82b0-779e8151dd9d admin admin] PATH_INFO: `/v3/projects/e64394d941474609a234d3c3f0b133de` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:14.375701 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4f76c-5dc2-44c5-82b0-779e8151dd9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e64394d941474609a234d3c3f0b133de)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:14.377692 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4f76c-5dc2-44c5-82b0-779e8151dd9d admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:14.424402 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-67e4f76c-5dc2-44c5-82b0-779e8151dd9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e64394d941474609a234d3c3f0b133de', 'request_id': 'req-67e4f76c-5dc2-44c5-82b0-779e8151dd9d'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:14.431954 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-67e4f76c-5dc2-44c5-82b0-779e8151dd9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e64394d941474609a234d3c3f0b133de', 'request_id': 'req-67e4f76c-5dc2-44c5-82b0-779e8151dd9d'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:14.438378 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-67e4f76c-5dc2-44c5-82b0-779e8151dd9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e64394d941474609a234d3c3f0b133de', 'request_id': 'req-67e4f76c-5dc2-44c5-82b0-779e8151dd9d'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:14.448298 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-67e4f76c-5dc2-44c5-82b0-779e8151dd9d admin admin] The token cache is being invalidate because project e64394d941474609a234d3c3f0b133de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:07:14.448573 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-67e4f76c-5dc2-44c5-82b0-779e8151dd9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:14.449173 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-67e4f76c-5dc2-44c5-82b0-779e8151dd9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:14.451077 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1078/2125] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:07:14 2022] DELETE /identity/v3/projects/e64394d941474609a234d3c3f0b133de => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:07:14.456199 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353645e-a862-4edb-ade1-804f67e21280 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:14.456646 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353645e-a862-4edb-ade1-804f67e21280 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:14.456885 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353645e-a862-4edb-ade1-804f67e21280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:14.476480 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-7353645e-a862-4edb-ade1-804f67e21280 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:07:14.477894 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-7353645e-a862-4edb-ade1-804f67e21280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:14.543865 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1048/2126] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:07:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:07:14.552756 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c863f7-d2c7-4942-a655-2c2e3e38cd40 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:14.553040 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c863f7-d2c7-4942-a655-2c2e3e38cd40 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:14.553310 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c863f7-d2c7-4942-a655-2c2e3e38cd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:14.572840 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-67c863f7-d2c7-4942-a655-2c2e3e38cd40 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:07:14.574015 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-67c863f7-d2c7-4942-a655-2c2e3e38cd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:14.582445 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1079/2127] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:07:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:07:14.586927 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353645e-a862-4edb-ade1-804f67e21280 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:14.600847 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353645e-a862-4edb-ade1-804f67e21280 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:14.606381 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5199fe-2e44-4308-9010-5d9a470a6fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:14.607121 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5199fe-2e44-4308-9010-5d9a470a6fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:14.607462 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5199fe-2e44-4308-9010-5d9a470a6fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:14.607826 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5199fe-2e44-4308-9010-5d9a470a6fc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:14.608645 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5199fe-2e44-4308-9010-5d9a470a6fc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:07:14.609009 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5199fe-2e44-4308-9010-5d9a470a6fc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:14.610762 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5199fe-2e44-4308-9010-5d9a470a6fc0 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:14.627385 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1049/2128] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:07:14.628434 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c863f7-d2c7-4942-a655-2c2e3e38cd40 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:14.638099 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c863f7-d2c7-4942-a655-2c2e3e38cd40 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:14.643932 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e1626-344f-43ce-a611-16c5b3a54b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:14.644623 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e1626-344f-43ce-a611-16c5b3a54b64 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:14.645000 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e1626-344f-43ce-a611-16c5b3a54b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:14.645352 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e1626-344f-43ce-a611-16c5b3a54b64 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:14.646103 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e1626-344f-43ce-a611-16c5b3a54b64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:14.648777 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e1626-344f-43ce-a611-16c5b3a54b64 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:14.676191 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1080/2129] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:07:14 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:07:14.681337 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5199fe-2e44-4308-9010-5d9a470a6fc0 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:14.692938 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5199fe-2e44-4308-9010-5d9a470a6fc0 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:14.753008 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394b09d-e705-4643-adb7-03f266d1cc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:14.753657 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394b09d-e705-4643-adb7-03f266d1cc00 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:14.753995 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394b09d-e705-4643-adb7-03f266d1cc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:14.754297 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394b09d-e705-4643-adb7-03f266d1cc00 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:14.755853 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394b09d-e705-4643-adb7-03f266d1cc00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:14.757927 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394b09d-e705-4643-adb7-03f266d1cc00 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:14.783694 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1050/2130] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:07:14 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:07:14.788384 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e1626-344f-43ce-a611-16c5b3a54b64 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:14.799257 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e1626-344f-43ce-a611-16c5b3a54b64 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:14.804279 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8942828-8e10-4524-b814-164afe094e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:14.804940 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8942828-8e10-4524-b814-164afe094e49 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:14.805213 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8942828-8e10-4524-b814-164afe094e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:14.805478 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8942828-8e10-4524-b814-164afe094e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:14.806254 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8942828-8e10-4524-b814-164afe094e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:14.807874 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8942828-8e10-4524-b814-164afe094e49 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:14.819713 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1081/2131] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:07:14.824029 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394b09d-e705-4643-adb7-03f266d1cc00 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:14.835852 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394b09d-e705-4643-adb7-03f266d1cc00 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:14.841018 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf5bb2-94cb-4193-8f25-12d90c3a3ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:14.841691 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf5bb2-94cb-4193-8f25-12d90c3a3ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:14.841965 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf5bb2-94cb-4193-8f25-12d90c3a3ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:14.842243 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf5bb2-94cb-4193-8f25-12d90c3a3ef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:14.842951 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf5bb2-94cb-4193-8f25-12d90c3a3ef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:14.844652 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf5bb2-94cb-4193-8f25-12d90c3a3ef3 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:14.859086 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1051/2132] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:07:14.860367 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8942828-8e10-4524-b814-164afe094e49 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:14.871244 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8942828-8e10-4524-b814-164afe094e49 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:14.875940 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9975fd-7398-4a5c-8224-f7ed8319aa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:14.876845 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9975fd-7398-4a5c-8224-f7ed8319aa91 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:14.877116 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9975fd-7398-4a5c-8224-f7ed8319aa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:14.877408 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9975fd-7398-4a5c-8224-f7ed8319aa91 admin admin] PATH_INFO: `/v3/projects/6edbc11af57f4865b07f6db8942428ad/users/eab04f2ff5304a68bfa526c6b349ede1/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:14.893645 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9975fd-7398-4a5c-8224-f7ed8319aa91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6edbc11af57f4865b07f6db8942428ad, user_id=eab04f2ff5304a68bfa526c6b349ede1, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:14.896211 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9975fd-7398-4a5c-8224-f7ed8319aa91 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:14.910387 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1082/2133] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:07:14 2022] PUT /identity/v3/projects/6edbc11af57f4865b07f6db8942428ad/users/eab04f2ff5304a68bfa526c6b349ede1/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:07:14.921554 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb9bd4-d6fe-4474-b921-c5a4b9d40911 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:14.921836 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb9bd4-d6fe-4474-b921-c5a4b9d40911 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:14.922109 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb9bd4-d6fe-4474-b921-c5a4b9d40911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:14.968646 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-bceb9bd4-d6fe-4474-b921-c5a4b9d40911 None None] MFA Rules not processed for user `eab04f2ff5304a68bfa526c6b349ede1`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:07:14.970530 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-bceb9bd4-d6fe-4474-b921-c5a4b9d40911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:15.039605 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1052/2134] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:07:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:07:15.051782 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9975fd-7398-4a5c-8224-f7ed8319aa91 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:15.053749 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-4b9975fd-7398-4a5c-8224-f7ed8319aa91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:15.130877 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9975fd-7398-4a5c-8224-f7ed8319aa91 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:15.135443 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14828cf-8e7a-45a5-b3ae-ad9ad9ac3c0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:15.136223 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14828cf-8e7a-45a5-b3ae-ad9ad9ac3c0d service cinder] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:15.136592 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14828cf-8e7a-45a5-b3ae-ad9ad9ac3c0d service cinder] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:15.136956 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14828cf-8e7a-45a5-b3ae-ad9ad9ac3c0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:15.146633 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14828cf-8e7a-45a5-b3ae-ad9ad9ac3c0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:15.147533 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14828cf-8e7a-45a5-b3ae-ad9ad9ac3c0d service cinder] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:15.157071 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1083/2135] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:07:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:07:16.152064 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78678fe-d7ab-41f7-9e20-910fabcbe53b None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:16.152582 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78678fe-d7ab-41f7-9e20-910fabcbe53b None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:16.152582 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78678fe-d7ab-41f7-9e20-910fabcbe53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:16.171132 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-f78678fe-d7ab-41f7-9e20-910fabcbe53b None None] MFA Rules not processed for user `4ded28c2ffe345ccbefde50585023857`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:07:16.172505 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-f78678fe-d7ab-41f7-9e20-910fabcbe53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:16.234904 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1053/2136] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:07:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:07:16.529304 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82e906-e488-4907-b0c3-6fe96c200f05 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:16.530013 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82e906-e488-4907-b0c3-6fe96c200f05 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:16.530013 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82e906-e488-4907-b0c3-6fe96c200f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:16.547076 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-2b82e906-e488-4907-b0c3-6fe96c200f05 None None] MFA Rules not processed for user `eab04f2ff5304a68bfa526c6b349ede1`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:07:16.548479 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-2b82e906-e488-4907-b0c3-6fe96c200f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:16.555581 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1084/2137] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:07:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:07:16.869046 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb5988-cccc-4b52-81ec-722902437028 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:16.869395 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb5988-cccc-4b52-81ec-722902437028 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:16.869732 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb5988-cccc-4b52-81ec-722902437028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:16.889086 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-23eb5988-cccc-4b52-81ec-722902437028 None None] MFA Rules not processed for user `c22f5695481341419674da058685a2d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:07:16.890564 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-23eb5988-cccc-4b52-81ec-722902437028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:16.958675 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1054/2138] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:07:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:07:33.137187 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dccafd-a00e-4e00-9c56-6feb40504597 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:33.137676 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dccafd-a00e-4e00-9c56-6feb40504597 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:33.137781 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dccafd-a00e-4e00-9c56-6feb40504597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:33.214475 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-39dccafd-a00e-4e00-9c56-6feb40504597 None None] MFA Rules not processed for user `83115653901749f6ade6638593fb54e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:07:33.215991 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-39dccafd-a00e-4e00-9c56-6feb40504597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:33.296855 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1085/2139] 10.222.0.32 () {58 vars in 1009 bytes} [Tue Apr 12 03:07:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:07:33.360775 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb5988-cccc-4b52-81ec-722902437028 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:33.362583 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-23eb5988-cccc-4b52-81ec-722902437028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:33.458692 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb5988-cccc-4b52-81ec-722902437028 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:33.463543 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04766a-7b19-450d-baa6-22789ee65a63 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e8d78f92f12405fb746ddeb2579bd2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:33.464289 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04766a-7b19-450d-baa6-22789ee65a63 service swift] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:33.464502 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04766a-7b19-450d-baa6-22789ee65a63 service swift] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:33.464764 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04766a-7b19-450d-baa6-22789ee65a63 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:33.473698 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04766a-7b19-450d-baa6-22789ee65a63 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:33.475584 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04766a-7b19-450d-baa6-22789ee65a63 service swift] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:33.488141 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1055/2140] 10.222.0.32 () {60 vars in 1384 bytes} [Tue Apr 12 03:07:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 03:07:37.345293 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d558fd0-85de-47e8-8ee8-6ceba5ce7ec5 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:37.346513 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d558fd0-85de-47e8-8ee8-6ceba5ce7ec5 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:37.346793 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d558fd0-85de-47e8-8ee8-6ceba5ce7ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:37.368777 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-6d558fd0-85de-47e8-8ee8-6ceba5ce7ec5 None None] MFA Rules not processed for user `83115653901749f6ade6638593fb54e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:07:37.370148 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-6d558fd0-85de-47e8-8ee8-6ceba5ce7ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:37.377641 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1086/2141] 10.222.0.32 () {58 vars in 1009 bytes} [Tue Apr 12 03:07:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:07:37.392954 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04766a-7b19-450d-baa6-22789ee65a63 service swift] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:37.405074 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04766a-7b19-450d-baa6-22789ee65a63 service swift] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:37.414314 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794520ee-c83d-4a33-bd56-e6e3445f50af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e8d78f92f12405fb746ddeb2579bd2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:37.415089 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794520ee-c83d-4a33-bd56-e6e3445f50af service swift] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:37.415457 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794520ee-c83d-4a33-bd56-e6e3445f50af service swift] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:37.415863 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794520ee-c83d-4a33-bd56-e6e3445f50af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:37.427483 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794520ee-c83d-4a33-bd56-e6e3445f50af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:37.429314 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794520ee-c83d-4a33-bd56-e6e3445f50af service swift] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:37.443628 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1056/2142] 10.222.0.32 () {60 vars in 1384 bytes} [Tue Apr 12 03:07:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 12 03:07:38.305617 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fb76c-b25a-4f31-9ea7-d7b3d2bd719a None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:38.306137 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fb76c-b25a-4f31-9ea7-d7b3d2bd719a None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:38.306596 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fb76c-b25a-4f31-9ea7-d7b3d2bd719a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:38.337665 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-554fb76c-b25a-4f31-9ea7-d7b3d2bd719a None None] MFA Rules not processed for user `83115653901749f6ade6638593fb54e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:07:38.339117 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-554fb76c-b25a-4f31-9ea7-d7b3d2bd719a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:38.346369 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1087/2143] 10.222.0.32 () {58 vars in 967 bytes} [Tue Apr 12 03:07:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:07:38.363631 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794520ee-c83d-4a33-bd56-e6e3445f50af service swift] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:38.382298 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794520ee-c83d-4a33-bd56-e6e3445f50af service swift] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:38.387804 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e465e5f-1ca7-4b50-9cbb-af17d4e01f19 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e8d78f92f12405fb746ddeb2579bd2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:38.389032 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e465e5f-1ca7-4b50-9cbb-af17d4e01f19 service swift] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:38.389621 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e465e5f-1ca7-4b50-9cbb-af17d4e01f19 service swift] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:38.390023 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e465e5f-1ca7-4b50-9cbb-af17d4e01f19 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:38.401075 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e465e5f-1ca7-4b50-9cbb-af17d4e01f19 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:38.403501 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e465e5f-1ca7-4b50-9cbb-af17d4e01f19 service swift] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:38.415108 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1057/2144] 10.222.0.32 () {60 vars in 1384 bytes} [Tue Apr 12 03:07:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 03:07:38.715928 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a199d29-dffe-4bc6-b27e-63a4388d7b3b None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:38.716301 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a199d29-dffe-4bc6-b27e-63a4388d7b3b None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:38.716576 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a199d29-dffe-4bc6-b27e-63a4388d7b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:38.737353 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-8a199d29-dffe-4bc6-b27e-63a4388d7b3b None None] MFA Rules not processed for user `83115653901749f6ade6638593fb54e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:07:38.741476 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-8a199d29-dffe-4bc6-b27e-63a4388d7b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:38.758093 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1088/2145] 10.222.0.32 () {58 vars in 1009 bytes} [Tue Apr 12 03:07:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:07:38.765018 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e465e5f-1ca7-4b50-9cbb-af17d4e01f19 service swift] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:38.781284 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e465e5f-1ca7-4b50-9cbb-af17d4e01f19 service swift] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:38.787170 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e956f0-9818-4bbf-ab74-00469edfd805 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e8d78f92f12405fb746ddeb2579bd2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:38.788092 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e956f0-9818-4bbf-ab74-00469edfd805 service swift] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:38.788590 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e956f0-9818-4bbf-ab74-00469edfd805 service swift] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:38.789171 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e956f0-9818-4bbf-ab74-00469edfd805 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:38.799443 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e956f0-9818-4bbf-ab74-00469edfd805 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:38.801723 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e956f0-9818-4bbf-ab74-00469edfd805 service swift] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:38.812157 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1058/2146] 10.222.0.32 () {60 vars in 1384 bytes} [Tue Apr 12 03:07:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 03:07:39.405770 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f59ddb-4a68-4ddc-b50e-25b8591bc778 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:39.406552 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f59ddb-4a68-4ddc-b50e-25b8591bc778 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:39.406552 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f59ddb-4a68-4ddc-b50e-25b8591bc778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:39.431380 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-08f59ddb-4a68-4ddc-b50e-25b8591bc778 None None] MFA Rules not processed for user `83115653901749f6ade6638593fb54e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:07:39.432625 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-08f59ddb-4a68-4ddc-b50e-25b8591bc778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:39.451338 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1089/2147] 10.222.0.32 () {58 vars in 967 bytes} [Tue Apr 12 03:07:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:07:39.457396 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e956f0-9818-4bbf-ab74-00469edfd805 service swift] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:39.469112 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e956f0-9818-4bbf-ab74-00469edfd805 service swift] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:39.476820 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda4b82-41c8-4319-a157-ad9ca5d42eaa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e8d78f92f12405fb746ddeb2579bd2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:39.477874 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda4b82-41c8-4319-a157-ad9ca5d42eaa service swift] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:39.478149 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda4b82-41c8-4319-a157-ad9ca5d42eaa service swift] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:39.478618 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda4b82-41c8-4319-a157-ad9ca5d42eaa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:39.488760 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda4b82-41c8-4319-a157-ad9ca5d42eaa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:39.491092 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda4b82-41c8-4319-a157-ad9ca5d42eaa service swift] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:39.500757 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1059/2148] 10.222.0.32 () {60 vars in 1384 bytes} [Tue Apr 12 03:07:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 03:07:42.093448 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f59ddb-4a68-4ddc-b50e-25b8591bc778 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:42.170229 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f59ddb-4a68-4ddc-b50e-25b8591bc778 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:42.177986 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55a510-10be-4017-9258-5aff334cea61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:42.179091 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55a510-10be-4017-9258-5aff334cea61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:42.179543 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55a510-10be-4017-9258-5aff334cea61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:42.179837 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55a510-10be-4017-9258-5aff334cea61 admin admin] PATH_INFO: `/v3/users/eab04f2ff5304a68bfa526c6b349ede1` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:42.181011 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e55a510-10be-4017-9258-5aff334cea61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eab04f2ff5304a68bfa526c6b349ede1)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:42.183193 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e55a510-10be-4017-9258-5aff334cea61 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:42.242776 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-6e55a510-10be-4017-9258-5aff334cea61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eab04f2ff5304a68bfa526c6b349ede1'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:42.249738 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-6e55a510-10be-4017-9258-5aff334cea61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eab04f2ff5304a68bfa526c6b349ede1'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:42.250456 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-6e55a510-10be-4017-9258-5aff334cea61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eab04f2ff5304a68bfa526c6b349ede1'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:42.251045 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-6e55a510-10be-4017-9258-5aff334cea61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eab04f2ff5304a68bfa526c6b349ede1'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:42.262570 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-6e55a510-10be-4017-9258-5aff334cea61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eab04f2ff5304a68bfa526c6b349ede1'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:42.281122 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1090/2149] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:07:42 2022] DELETE /identity/v3/users/eab04f2ff5304a68bfa526c6b349ede1 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:07:42.285943 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36627ed-8523-4ae7-a833-af3bf9309007 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:42.289831 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36627ed-8523-4ae7-a833-af3bf9309007 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:42.290178 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36627ed-8523-4ae7-a833-af3bf9309007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:42.308786 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-b36627ed-8523-4ae7-a833-af3bf9309007 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:07:42.309987 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-b36627ed-8523-4ae7-a833-af3bf9309007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:42.376082 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1060/2150] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:07:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:07:42.393882 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55a510-10be-4017-9258-5aff334cea61 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:42.395402 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-6e55a510-10be-4017-9258-5aff334cea61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:42.504664 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55a510-10be-4017-9258-5aff334cea61 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:42.515278 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da5df9-6b62-4b6c-8b61-6174ecc72cc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:42.515988 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da5df9-6b62-4b6c-8b61-6174ecc72cc6 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:42.516263 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da5df9-6b62-4b6c-8b61-6174ecc72cc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:42.521447 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da5df9-6b62-4b6c-8b61-6174ecc72cc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:42.533098 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da5df9-6b62-4b6c-8b61-6174ecc72cc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:42.533589 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da5df9-6b62-4b6c-8b61-6174ecc72cc6 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:42.550050 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1091/2151] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:07:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:07:42.767319 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36627ed-8523-4ae7-a833-af3bf9309007 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:42.769346 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-b36627ed-8523-4ae7-a833-af3bf9309007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:42.791954 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36627ed-8523-4ae7-a833-af3bf9309007 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:42.796788 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ee7ac-eaf2-4dfa-b20f-2aa44cef4972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:42.797692 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ee7ac-eaf2-4dfa-b20f-2aa44cef4972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:42.798029 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ee7ac-eaf2-4dfa-b20f-2aa44cef4972 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:42.798520 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ee7ac-eaf2-4dfa-b20f-2aa44cef4972 admin admin] PATH_INFO: `/v3/projects/6edbc11af57f4865b07f6db8942428ad` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:42.799552 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ee7ac-eaf2-4dfa-b20f-2aa44cef4972 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6edbc11af57f4865b07f6db8942428ad)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:42.801613 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ee7ac-eaf2-4dfa-b20f-2aa44cef4972 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:42.856670 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-434ee7ac-eaf2-4dfa-b20f-2aa44cef4972 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6edbc11af57f4865b07f6db8942428ad', 'request_id': 'req-434ee7ac-eaf2-4dfa-b20f-2aa44cef4972'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:42.865809 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-434ee7ac-eaf2-4dfa-b20f-2aa44cef4972 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6edbc11af57f4865b07f6db8942428ad', 'request_id': 'req-434ee7ac-eaf2-4dfa-b20f-2aa44cef4972'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:42.873152 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-434ee7ac-eaf2-4dfa-b20f-2aa44cef4972 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6edbc11af57f4865b07f6db8942428ad', 'request_id': 'req-434ee7ac-eaf2-4dfa-b20f-2aa44cef4972'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:42.886079 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-434ee7ac-eaf2-4dfa-b20f-2aa44cef4972 admin admin] The token cache is being invalidate because project 6edbc11af57f4865b07f6db8942428ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:07:42.886451 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-434ee7ac-eaf2-4dfa-b20f-2aa44cef4972 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:42.887191 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-434ee7ac-eaf2-4dfa-b20f-2aa44cef4972 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:07:42.888846 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1061/2152] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:07:42 2022] DELETE /identity/v3/projects/6edbc11af57f4865b07f6db8942428ad => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:07:42.893999 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225dfe0-0219-428a-8fea-26a6e93cc360 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:42.894619 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225dfe0-0219-428a-8fea-26a6e93cc360 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:42.894901 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225dfe0-0219-428a-8fea-26a6e93cc360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:42.913715 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-b225dfe0-0219-428a-8fea-26a6e93cc360 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:07:42.914948 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-b225dfe0-0219-428a-8fea-26a6e93cc360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:42.987773 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1092/2153] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:07:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:07:42.993392 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787bef0f-9136-4dea-a9a9-52ca6e4476ff None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:42.993675 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787bef0f-9136-4dea-a9a9-52ca6e4476ff None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:42.993959 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787bef0f-9136-4dea-a9a9-52ca6e4476ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:43.013775 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-787bef0f-9136-4dea-a9a9-52ca6e4476ff None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:07:43.014974 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-787bef0f-9136-4dea-a9a9-52ca6e4476ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:43.023485 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1062/2154] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:07:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:07:43.027792 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225dfe0-0219-428a-8fea-26a6e93cc360 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:43.039928 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225dfe0-0219-428a-8fea-26a6e93cc360 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:43.044682 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495d584-dbb9-4a2d-a77d-3121ce690f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:43.046001 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495d584-dbb9-4a2d-a77d-3121ce690f7c admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:43.046278 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495d584-dbb9-4a2d-a77d-3121ce690f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:43.046552 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495d584-dbb9-4a2d-a77d-3121ce690f7c admin admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:43.048054 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2495d584-dbb9-4a2d-a77d-3121ce690f7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:07:43.048361 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2495d584-dbb9-4a2d-a77d-3121ce690f7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:43.050682 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2495d584-dbb9-4a2d-a77d-3121ce690f7c admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:43.064527 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1093/2155] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:07:43.068892 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787bef0f-9136-4dea-a9a9-52ca6e4476ff None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:43.081345 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787bef0f-9136-4dea-a9a9-52ca6e4476ff None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:43.086610 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcba04-2289-4450-ba35-974682d239dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:43.089068 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcba04-2289-4450-ba35-974682d239dc admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:43.089068 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcba04-2289-4450-ba35-974682d239dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:43.089068 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcba04-2289-4450-ba35-974682d239dc admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:43.089068 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fcba04-2289-4450-ba35-974682d239dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:43.090986 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fcba04-2289-4450-ba35-974682d239dc admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:43.127241 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1063/2156] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:07:43 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 03:07:43.131701 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495d584-dbb9-4a2d-a77d-3121ce690f7c admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:43.143710 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495d584-dbb9-4a2d-a77d-3121ce690f7c admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:43.221662 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a03533-5346-4364-baa6-c85849fff1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:43.223284 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a03533-5346-4364-baa6-c85849fff1b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:43.223708 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a03533-5346-4364-baa6-c85849fff1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:43.224035 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a03533-5346-4364-baa6-c85849fff1b4 admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:43.224809 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a03533-5346-4364-baa6-c85849fff1b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:43.226907 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a03533-5346-4364-baa6-c85849fff1b4 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:43.250201 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1094/2157] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:07:43 2022] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 03:07:43.254013 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcba04-2289-4450-ba35-974682d239dc admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:43.264575 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcba04-2289-4450-ba35-974682d239dc admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:43.269412 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56631bec-adcf-4dd9-8886-f3af64baf6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:43.270152 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56631bec-adcf-4dd9-8886-f3af64baf6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:43.270587 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56631bec-adcf-4dd9-8886-f3af64baf6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:43.270914 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56631bec-adcf-4dd9-8886-f3af64baf6e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:43.271776 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56631bec-adcf-4dd9-8886-f3af64baf6e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:43.273672 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56631bec-adcf-4dd9-8886-f3af64baf6e7 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:43.285815 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1064/2158] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:07:43.289806 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a03533-5346-4364-baa6-c85849fff1b4 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:43.300059 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a03533-5346-4364-baa6-c85849fff1b4 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:43.306891 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06205cf-6b00-451a-ba01-af8eb42516b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:43.307564 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06205cf-6b00-451a-ba01-af8eb42516b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:43.307884 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06205cf-6b00-451a-ba01-af8eb42516b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:43.308158 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06205cf-6b00-451a-ba01-af8eb42516b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:43.308882 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06205cf-6b00-451a-ba01-af8eb42516b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:43.310513 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06205cf-6b00-451a-ba01-af8eb42516b6 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:43.322821 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1095/2159] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:07:43.327004 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56631bec-adcf-4dd9-8886-f3af64baf6e7 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:43.338052 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56631bec-adcf-4dd9-8886-f3af64baf6e7 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:43.342939 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb194e-8716-4a73-b30d-679fb6c6e749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:43.343954 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb194e-8716-4a73-b30d-679fb6c6e749 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:43.344292 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb194e-8716-4a73-b30d-679fb6c6e749 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:43.344625 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb194e-8716-4a73-b30d-679fb6c6e749 admin admin] PATH_INFO: `/v3/projects/faa0847777334640bf8854a96c6e7a19/users/157ff7b3ca7b4af69a47cc36b0d1917a/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:43.361754 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb194e-8716-4a73-b30d-679fb6c6e749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faa0847777334640bf8854a96c6e7a19, user_id=157ff7b3ca7b4af69a47cc36b0d1917a, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:43.366786 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb194e-8716-4a73-b30d-679fb6c6e749 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:43.386256 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1065/2160] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:07:43 2022] PUT /identity/v3/projects/faa0847777334640bf8854a96c6e7a19/users/157ff7b3ca7b4af69a47cc36b0d1917a/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:07:43.392079 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f803950-9a26-4760-9fdd-bff862ce196e None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:43.392079 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f803950-9a26-4760-9fdd-bff862ce196e None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:43.392079 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f803950-9a26-4760-9fdd-bff862ce196e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:43.411423 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-0f803950-9a26-4760-9fdd-bff862ce196e None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:07:43.412782 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-0f803950-9a26-4760-9fdd-bff862ce196e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:43.472869 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1096/2161] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:07:43.482777 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb194e-8716-4a73-b30d-679fb6c6e749 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:43.484540 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-e8eb194e-8716-4a73-b30d-679fb6c6e749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:43.543288 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb194e-8716-4a73-b30d-679fb6c6e749 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:43.547548 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ec7f0-5e8a-4887-afd0-f110f1ad6b4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:43.548359 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ec7f0-5e8a-4887-afd0-f110f1ad6b4a service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:43.548676 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ec7f0-5e8a-4887-afd0-f110f1ad6b4a service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:43.549027 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ec7f0-5e8a-4887-afd0-f110f1ad6b4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:43.559257 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03ec7f0-5e8a-4887-afd0-f110f1ad6b4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:43.560720 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03ec7f0-5e8a-4887-afd0-f110f1ad6b4a service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:43.570483 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1066/2162] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:07:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:07:48.415461 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcc85c-1b46-4b80-a4b1-4be7aff3c531 None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:48.416371 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcc85c-1b46-4b80-a4b1-4be7aff3c531 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:48.417350 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcc85c-1b46-4b80-a4b1-4be7aff3c531 None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:48.419850 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1097/2163] 10.222.0.32 () {54 vars in 921 bytes} [Tue Apr 12 03:07:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 03:07:48.426400 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febaef2f-505d-4fa4-acb3-5eabf144ead8 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:48.427023 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febaef2f-505d-4fa4-acb3-5eabf144ead8 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:48.427023 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febaef2f-505d-4fa4-acb3-5eabf144ead8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:48.496369 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-febaef2f-505d-4fa4-acb3-5eabf144ead8 None None] MFA Rules not processed for user `43ee5cb310fd4538910e40ea7082708c`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:07:48.497972 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-febaef2f-505d-4fa4-acb3-5eabf144ead8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:48.666222 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1067/2164] 10.222.0.32 () {58 vars in 1018 bytes} [Tue Apr 12 03:07:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:07:48.689300 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fcc85c-1b46-4b80-a4b1-4be7aff3c531 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:48.691093 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-c8fcc85c-1b46-4b80-a4b1-4be7aff3c531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:48.721368 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3267da-6f66-441e-886e-0b31f24e377c None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:48.721639 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3267da-6f66-441e-886e-0b31f24e377c None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:48.722077 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3267da-6f66-441e-886e-0b31f24e377c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:48.753216 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-0b3267da-6f66-441e-886e-0b31f24e377c None None] MFA Rules not processed for user `157ff7b3ca7b4af69a47cc36b0d1917a`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:07:48.754557 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-0b3267da-6f66-441e-886e-0b31f24e377c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:48.834777 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1068/2165] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:07:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:07:48.836233 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3267da-6f66-441e-886e-0b31f24e377c None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:48.848701 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3267da-6f66-441e-886e-0b31f24e377c None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:48.853665 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a70e1-d8b6-45ca-88c7-b6dc0d45d838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:48.854500 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a70e1-d8b6-45ca-88c7-b6dc0d45d838 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:48.854777 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a70e1-d8b6-45ca-88c7-b6dc0d45d838 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:48.855141 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a70e1-d8b6-45ca-88c7-b6dc0d45d838 admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:48.856116 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a70e1-d8b6-45ca-88c7-b6dc0d45d838 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:48.858572 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a70e1-d8b6-45ca-88c7-b6dc0d45d838 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:48.889045 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1069/2166] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:07:48 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:07:48.892889 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a70e1-d8b6-45ca-88c7-b6dc0d45d838 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:48.940526 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fcc85c-1b46-4b80-a4b1-4be7aff3c531 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:48.959018 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a70e1-d8b6-45ca-88c7-b6dc0d45d838 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:48.964518 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42968580-2bae-43c6-847e-6446d3ae1a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:48.965331 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42968580-2bae-43c6-847e-6446d3ae1a2f admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:48.965700 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42968580-2bae-43c6-847e-6446d3ae1a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:48.966061 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42968580-2bae-43c6-847e-6446d3ae1a2f admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:48.966832 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42968580-2bae-43c6-847e-6446d3ae1a2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:48.969149 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42968580-2bae-43c6-847e-6446d3ae1a2f admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:48.993295 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1070/2167] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:07:48 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 03:07:48.996825 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537153e-412f-4bd1-a246-82c6d32de176 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a6cffa8af470388d4b063c3c49849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:48.997354 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42968580-2bae-43c6-847e-6446d3ae1a2f admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:48.997495 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537153e-412f-4bd1-a246-82c6d32de176 service glance] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:48.997767 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537153e-412f-4bd1-a246-82c6d32de176 service glance] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:48.998039 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537153e-412f-4bd1-a246-82c6d32de176 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:49.018886 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42968580-2bae-43c6-847e-6446d3ae1a2f admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:49.025438 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbedfa-a4f9-42a6-94d9-73200fe518b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:49.026214 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbedfa-a4f9-42a6-94d9-73200fe518b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:49.026557 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbedfa-a4f9-42a6-94d9-73200fe518b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:49.026896 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbedfa-a4f9-42a6-94d9-73200fe518b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:49.028149 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabbedfa-a4f9-42a6-94d9-73200fe518b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:49.030771 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabbedfa-a4f9-42a6-94d9-73200fe518b7 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:49.047635 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1071/2168] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:07:49.051595 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbedfa-a4f9-42a6-94d9-73200fe518b7 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:49.065793 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbedfa-a4f9-42a6-94d9-73200fe518b7 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:49.072638 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e106a-ed07-4392-a19f-48e3b78a26a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:49.074284 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e106a-ed07-4392-a19f-48e3b78a26a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:49.074731 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e106a-ed07-4392-a19f-48e3b78a26a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:49.075452 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e106a-ed07-4392-a19f-48e3b78a26a5 admin admin] PATH_INFO: `/v3/projects/4290d39f5f214ceaa74062aeea829938/users/f63f3414b5a940678abb60201d8fb9f7/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:49.085274 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537153e-412f-4bd1-a246-82c6d32de176 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:49.086804 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537153e-412f-4bd1-a246-82c6d32de176 service glance] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:49.102408 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e106a-ed07-4392-a19f-48e3b78a26a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4290d39f5f214ceaa74062aeea829938, user_id=f63f3414b5a940678abb60201d8fb9f7, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:49.104620 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1098/2169] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:07:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:07:49.131133 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e106a-ed07-4392-a19f-48e3b78a26a5 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:49.156468 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1072/2170] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:07:49 2022] PUT /identity/v3/projects/4290d39f5f214ceaa74062aeea829938/users/f63f3414b5a940678abb60201d8fb9f7/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:07:49.160879 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537153e-412f-4bd1-a246-82c6d32de176 service glance] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:49.179124 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537153e-412f-4bd1-a246-82c6d32de176 service glance] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:49.209295 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548f3a5-71b9-4a63-93e0-74bd42b7b593 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:49.209644 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548f3a5-71b9-4a63-93e0-74bd42b7b593 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:49.209859 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548f3a5-71b9-4a63-93e0-74bd42b7b593 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:49.211391 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1073/2171] 10.222.0.32 () {54 vars in 921 bytes} [Tue Apr 12 03:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 03:07:49.222949 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5e123-7dd9-443e-9002-2b40d03496ad None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:49.223625 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5e123-7dd9-443e-9002-2b40d03496ad None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:49.223900 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5e123-7dd9-443e-9002-2b40d03496ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:49.247709 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-e6a5e123-7dd9-443e-9002-2b40d03496ad None None] MFA Rules not processed for user `8f516943aec14608b5c9d343418a2677`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:07:49.249121 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-e6a5e123-7dd9-443e-9002-2b40d03496ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:49.267161 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b247b3-cde9-478e-8e76-fac8fea49d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:49.268200 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b247b3-cde9-478e-8e76-fac8fea49d3a admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:49.268649 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b247b3-cde9-478e-8e76-fac8fea49d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:49.269063 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b247b3-cde9-478e-8e76-fac8fea49d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:49.269979 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b247b3-cde9-478e-8e76-fac8fea49d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:49.274165 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b247b3-cde9-478e-8e76-fac8fea49d3a admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:49.289201 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1099/2172] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:07:49.290170 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b247b3-cde9-478e-8e76-fac8fea49d3a admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:49.301092 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b247b3-cde9-478e-8e76-fac8fea49d3a admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:49.306708 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176fa48-5c44-4086-978b-2a6e01f6a40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:49.307691 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176fa48-5c44-4086-978b-2a6e01f6a40c admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:49.308067 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176fa48-5c44-4086-978b-2a6e01f6a40c admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:49.308396 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176fa48-5c44-4086-978b-2a6e01f6a40c admin admin] PATH_INFO: `/v3/projects/4290d39f5f214ceaa74062aeea829938/users/f63f3414b5a940678abb60201d8fb9f7/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:49.310376 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1074/2173] 10.222.0.32 () {58 vars in 1018 bytes} [Tue Apr 12 03:07:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:07:49.310609 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176fa48-5c44-4086-978b-2a6e01f6a40c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4290d39f5f214ceaa74062aeea829938, user_id=f63f3414b5a940678abb60201d8fb9f7, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:49.313342 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176fa48-5c44-4086-978b-2a6e01f6a40c admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:49.323016 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5e123-7dd9-443e-9002-2b40d03496ad None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:49.329871 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1100/2174] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:07:49 2022] PUT /identity/v3/projects/4290d39f5f214ceaa74062aeea829938/users/f63f3414b5a940678abb60201d8fb9f7/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:07:49.334370 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5e123-7dd9-443e-9002-2b40d03496ad None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:49.415461 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27154fe-b111-4559-a761-3bf7f78230dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:49.416392 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27154fe-b111-4559-a761-3bf7f78230dc service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:49.416739 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27154fe-b111-4559-a761-3bf7f78230dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:49.417078 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27154fe-b111-4559-a761-3bf7f78230dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:49.428677 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27154fe-b111-4559-a761-3bf7f78230dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:49.431671 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27154fe-b111-4559-a761-3bf7f78230dc service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:49.447356 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1075/2175] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:07:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 03:07:49.575575 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac45a1d-2ca0-459c-8f77-bbff20a790fd None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:49.577023 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac45a1d-2ca0-459c-8f77-bbff20a790fd None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:49.577778 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac45a1d-2ca0-459c-8f77-bbff20a790fd None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:49.580421 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1101/2176] 10.222.0.32 () {54 vars in 921 bytes} [Tue Apr 12 03:07:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 03:07:49.589643 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d9784-1411-455e-a524-ce7e7b85c2a9 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:49.590202 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d9784-1411-455e-a524-ce7e7b85c2a9 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:49.590713 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d9784-1411-455e-a524-ce7e7b85c2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:49.620055 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-d61d9784-1411-455e-a524-ce7e7b85c2a9 None None] MFA Rules not processed for user `43ee5cb310fd4538910e40ea7082708c`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:07:49.621702 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-d61d9784-1411-455e-a524-ce7e7b85c2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:49.757554 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1076/2177] 10.222.0.32 () {58 vars in 1018 bytes} [Tue Apr 12 03:07:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:07:49.794861 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac45a1d-2ca0-459c-8f77-bbff20a790fd None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:49.797196 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-2ac45a1d-2ca0-459c-8f77-bbff20a790fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:49.818224 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac45a1d-2ca0-459c-8f77-bbff20a790fd None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:49.822524 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379eea3e-f6c2-4938-a69a-79334a2014fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:49.823362 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379eea3e-f6c2-4938-a69a-79334a2014fa service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:49.823638 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379eea3e-f6c2-4938-a69a-79334a2014fa service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:49.823947 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379eea3e-f6c2-4938-a69a-79334a2014fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:49.847988 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379eea3e-f6c2-4938-a69a-79334a2014fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:49.850398 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379eea3e-f6c2-4938-a69a-79334a2014fa service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:49.868130 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1102/2178] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:07:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:07:51.152534 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d9784-1411-455e-a524-ce7e7b85c2a9 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:51.154484 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-d61d9784-1411-455e-a524-ce7e7b85c2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:51.360617 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d9784-1411-455e-a524-ce7e7b85c2a9 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:51.366518 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d279e-3aa7-471a-8d6e-593e813da101 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a88ae51543497382d34573afc2bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:51.367299 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d279e-3aa7-471a-8d6e-593e813da101 service placement] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:51.367858 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d279e-3aa7-471a-8d6e-593e813da101 service placement] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:51.368294 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d279e-3aa7-471a-8d6e-593e813da101 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:51.370805 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-ed2d279e-3aa7-471a-8d6e-593e813da101 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:51.384761 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d279e-3aa7-471a-8d6e-593e813da101 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:51.387024 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d279e-3aa7-471a-8d6e-593e813da101 service placement] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:51.399811 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1077/2179] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:07:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:07:54.152777 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f6e59-3937-4402-a1de-069693f7789d None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:54.153299 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f6e59-3937-4402-a1de-069693f7789d None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:54.154448 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f6e59-3937-4402-a1de-069693f7789d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:54.184492 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-b25f6e59-3937-4402-a1de-069693f7789d None None] MFA Rules not processed for user `83115653901749f6ade6638593fb54e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:07:54.185689 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-b25f6e59-3937-4402-a1de-069693f7789d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:54.277535 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1103/2180] 10.222.0.32 () {58 vars in 1009 bytes} [Tue Apr 12 03:07:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:07:54.294583 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d279e-3aa7-471a-8d6e-593e813da101 service placement] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:54.296677 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-ed2d279e-3aa7-471a-8d6e-593e813da101 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:54.374428 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d279e-3aa7-471a-8d6e-593e813da101 service placement] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:54.379566 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae4308-4aea-45f5-bb49-4d7539279b79 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e8d78f92f12405fb746ddeb2579bd2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:54.380519 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae4308-4aea-45f5-bb49-4d7539279b79 service swift] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:54.380940 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae4308-4aea-45f5-bb49-4d7539279b79 service swift] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:54.381350 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae4308-4aea-45f5-bb49-4d7539279b79 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:54.408740 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae4308-4aea-45f5-bb49-4d7539279b79 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:54.410386 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae4308-4aea-45f5-bb49-4d7539279b79 service swift] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:54.419844 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1078/2181] 10.222.0.32 () {60 vars in 1384 bytes} [Tue Apr 12 03:07:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 03:07:54.959616 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f441f-2177-424f-b5cd-26ab63f06032 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:54.960179 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f441f-2177-424f-b5cd-26ab63f06032 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:54.960589 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f441f-2177-424f-b5cd-26ab63f06032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:55.010605 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-b45f441f-2177-424f-b5cd-26ab63f06032 None None] MFA Rules not processed for user `f63f3414b5a940678abb60201d8fb9f7`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:07:55.012230 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-b45f441f-2177-424f-b5cd-26ab63f06032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:55.166167 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1104/2182] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:07:54 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:07:55.178574 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae4308-4aea-45f5-bb49-4d7539279b79 service swift] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:07:55.180015 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-23ae4308-4aea-45f5-bb49-4d7539279b79 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:07:55.200962 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae4308-4aea-45f5-bb49-4d7539279b79 service swift] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:07:55.207414 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8873426-0ce3-4de4-8485-919a2397daf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:07:55.208383 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8873426-0ce3-4de4-8485-919a2397daf3 service nova] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:07:55.208807 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8873426-0ce3-4de4-8485-919a2397daf3 service nova] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:07:55.209243 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8873426-0ce3-4de4-8485-919a2397daf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:07:55.290213 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8873426-0ce3-4de4-8485-919a2397daf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:07:55.292036 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8873426-0ce3-4de4-8485-919a2397daf3 service nova] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:07:55.302473 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1079/2183] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:07:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:08:14.740164 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5f6ee-9181-426e-bc51-d05b515c8179 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:08:14.740821 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5f6ee-9181-426e-bc51-d05b515c8179 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:08:14.740821 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5f6ee-9181-426e-bc51-d05b515c8179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:08:14.757740 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-ade5f6ee-9181-426e-bc51-d05b515c8179 None None] MFA Rules not processed for user `157ff7b3ca7b4af69a47cc36b0d1917a`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:08:14.758931 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-ade5f6ee-9181-426e-bc51-d05b515c8179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:08:14.765920 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1105/2184] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:08:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:08:17.962416 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176521c1-7f43-44bb-907c-d4ab3a7381f8 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:08:17.963034 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176521c1-7f43-44bb-907c-d4ab3a7381f8 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:08:17.963034 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176521c1-7f43-44bb-907c-d4ab3a7381f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:08:17.982154 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-176521c1-7f43-44bb-907c-d4ab3a7381f8 None None] MFA Rules not processed for user `83115653901749f6ade6638593fb54e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:08:17.983468 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-176521c1-7f43-44bb-907c-d4ab3a7381f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:08:17.992164 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1080/2185] 10.222.0.32 () {58 vars in 967 bytes} [Tue Apr 12 03:08:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:08:18.005151 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade5f6ee-9181-426e-bc51-d05b515c8179 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:08:18.017102 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade5f6ee-9181-426e-bc51-d05b515c8179 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:08:18.023095 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353ecdd-a445-43d2-9871-4dd5c995ff92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e8d78f92f12405fb746ddeb2579bd2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:08:18.023853 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353ecdd-a445-43d2-9871-4dd5c995ff92 service swift] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:08:18.024213 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353ecdd-a445-43d2-9871-4dd5c995ff92 service swift] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:08:18.024546 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353ecdd-a445-43d2-9871-4dd5c995ff92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:08:18.033540 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353ecdd-a445-43d2-9871-4dd5c995ff92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:08:18.035206 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353ecdd-a445-43d2-9871-4dd5c995ff92 service swift] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:08:18.044245 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1106/2186] 10.222.0.32 () {60 vars in 1384 bytes} [Tue Apr 12 03:08:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 03:08:36.399031 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176521c1-7f43-44bb-907c-d4ab3a7381f8 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:08:36.413227 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176521c1-7f43-44bb-907c-d4ab3a7381f8 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:08:36.417985 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461b6d9-3bd9-4756-ab1c-4af4fadd62ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:08:36.418810 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461b6d9-3bd9-4756-ab1c-4af4fadd62ee service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:08:36.419328 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461b6d9-3bd9-4756-ab1c-4af4fadd62ee service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:08:36.419744 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461b6d9-3bd9-4756-ab1c-4af4fadd62ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:08:36.431335 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461b6d9-3bd9-4756-ab1c-4af4fadd62ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:08:36.432829 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461b6d9-3bd9-4756-ab1c-4af4fadd62ee service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:08:36.443001 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1081/2187] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:08:36 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:08:40.681352 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40500468-b159-460e-bc6e-8e4e60e17ab7 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:08:40.681870 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40500468-b159-460e-bc6e-8e4e60e17ab7 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:08:40.682101 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40500468-b159-460e-bc6e-8e4e60e17ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:08:40.709530 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-40500468-b159-460e-bc6e-8e4e60e17ab7 None None] MFA Rules not processed for user `4ded28c2ffe345ccbefde50585023857`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:08:40.710729 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-40500468-b159-460e-bc6e-8e4e60e17ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:08:40.781323 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1107/2188] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:08:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:08:50.431043 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800c616-05b1-490a-b472-ce9de9fe79d1 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:08:50.431631 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800c616-05b1-490a-b472-ce9de9fe79d1 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:08:50.431631 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800c616-05b1-490a-b472-ce9de9fe79d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:08:50.449478 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-4800c616-05b1-490a-b472-ce9de9fe79d1 None None] MFA Rules not processed for user `c22f5695481341419674da058685a2d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:08:50.451014 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-4800c616-05b1-490a-b472-ce9de9fe79d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:08:50.509118 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1082/2189] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:08:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:09:08.851754 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafada60-12f8-46b4-ad77-4d3afad62dbf None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:09:08.852303 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafada60-12f8-46b4-ad77-4d3afad62dbf None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:09:08.852303 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafada60-12f8-46b4-ad77-4d3afad62dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:09:08.869436 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-fafada60-12f8-46b4-ad77-4d3afad62dbf None None] MFA Rules not processed for user `569824a5ffb846f1a447f1195bb9c017`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:09:08.870603 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-fafada60-12f8-46b4-ad77-4d3afad62dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:09:08.924007 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1108/2190] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:09:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:09:48.474003 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990403f2-187c-4b3d-a306-74673ca150fa None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:09:48.474548 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990403f2-187c-4b3d-a306-74673ca150fa None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:09:48.474548 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990403f2-187c-4b3d-a306-74673ca150fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:09:48.492757 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-990403f2-187c-4b3d-a306-74673ca150fa None None] MFA Rules not processed for user `d452c4f1c0ac4646ac7869552de56b96`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:09:48.494047 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-990403f2-187c-4b3d-a306-74673ca150fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:09:48.559641 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1083/2191] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:09:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:09:51.843524 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafada60-12f8-46b4-ad77-4d3afad62dbf None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:09:51.845548 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-fafada60-12f8-46b4-ad77-4d3afad62dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:09:51.917172 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafada60-12f8-46b4-ad77-4d3afad62dbf None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:09:51.922445 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f24b18-4596-4325-9bd7-99c81cc92b1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:09:51.923105 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f24b18-4596-4325-9bd7-99c81cc92b1a service cinder] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:09:51.923376 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f24b18-4596-4325-9bd7-99c81cc92b1a service cinder] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:09:51.923634 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f24b18-4596-4325-9bd7-99c81cc92b1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:09:51.927216 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-77f24b18-4596-4325-9bd7-99c81cc92b1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:09:51.943136 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f24b18-4596-4325-9bd7-99c81cc92b1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:09:51.944766 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f24b18-4596-4325-9bd7-99c81cc92b1a service cinder] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:09:51.962594 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1109/2192] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:09:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:09:57.343953 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990403f2-187c-4b3d-a306-74673ca150fa None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:09:57.355210 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990403f2-187c-4b3d-a306-74673ca150fa None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:09:57.359479 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d7f44-aaa3-4657-aa8f-2ad5b21a4d18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:09:57.360172 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d7f44-aaa3-4657-aa8f-2ad5b21a4d18 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:09:57.360453 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d7f44-aaa3-4657-aa8f-2ad5b21a4d18 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:09:57.360720 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d7f44-aaa3-4657-aa8f-2ad5b21a4d18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:09:57.362698 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-3e0d7f44-aaa3-4657-aa8f-2ad5b21a4d18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:09:57.377420 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d7f44-aaa3-4657-aa8f-2ad5b21a4d18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:09:57.378989 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d7f44-aaa3-4657-aa8f-2ad5b21a4d18 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:09:57.389693 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1084/2193] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:09:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:09:59.829447 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f24b18-4596-4325-9bd7-99c81cc92b1a service cinder] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:09:59.830977 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-77f24b18-4596-4325-9bd7-99c81cc92b1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:09:59.845412 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f24b18-4596-4325-9bd7-99c81cc92b1a service cinder] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:09:59.852447 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead51974-e74d-47b0-9b56-20779e259c01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:09:59.853263 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead51974-e74d-47b0-9b56-20779e259c01 service nova] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:09:59.853467 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead51974-e74d-47b0-9b56-20779e259c01 service nova] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:09:59.853827 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead51974-e74d-47b0-9b56-20779e259c01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:09:59.855901 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-ead51974-e74d-47b0-9b56-20779e259c01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:09:59.867035 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead51974-e74d-47b0-9b56-20779e259c01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:09:59.868720 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead51974-e74d-47b0-9b56-20779e259c01 service nova] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:09:59.878690 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1110/2194] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:09:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:09:59.919024 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d7f44-aaa3-4657-aa8f-2ad5b21a4d18 service neutron] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:09:59.929034 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d7f44-aaa3-4657-aa8f-2ad5b21a4d18 service neutron] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:09:59.934044 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97f6db-e248-4296-a795-b622bd51343f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:09:59.934623 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97f6db-e248-4296-a795-b622bd51343f service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:09:59.934895 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97f6db-e248-4296-a795-b622bd51343f service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:09:59.935152 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97f6db-e248-4296-a795-b622bd51343f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:09:59.937104 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-9a97f6db-e248-4296-a795-b622bd51343f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:00.017605 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97f6db-e248-4296-a795-b622bd51343f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:00.019300 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97f6db-e248-4296-a795-b622bd51343f service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:00.048825 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1085/2195] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:09:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 03:10:03.913321 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead51974-e74d-47b0-9b56-20779e259c01 service nova] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:03.914745 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-ead51974-e74d-47b0-9b56-20779e259c01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:03.951592 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead51974-e74d-47b0-9b56-20779e259c01 service nova] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:03.956342 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907204c-89a9-4b8c-ba40-a8fe78616bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:03.957218 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907204c-89a9-4b8c-ba40-a8fe78616bed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:03.957495 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907204c-89a9-4b8c-ba40-a8fe78616bed admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:03.957761 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907204c-89a9-4b8c-ba40-a8fe78616bed admin admin] PATH_INFO: `/v3/users/c22f5695481341419674da058685a2d5` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:03.959005 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7907204c-89a9-4b8c-ba40-a8fe78616bed admin admin] RBAC: Authorizing `identity:delete_user(user_id=c22f5695481341419674da058685a2d5)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:03.961052 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7907204c-89a9-4b8c-ba40-a8fe78616bed admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:04.021114 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-7907204c-89a9-4b8c-ba40-a8fe78616bed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c22f5695481341419674da058685a2d5'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:04.028399 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-7907204c-89a9-4b8c-ba40-a8fe78616bed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c22f5695481341419674da058685a2d5'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:04.029165 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-7907204c-89a9-4b8c-ba40-a8fe78616bed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c22f5695481341419674da058685a2d5'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:04.029747 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-7907204c-89a9-4b8c-ba40-a8fe78616bed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c22f5695481341419674da058685a2d5'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:04.042707 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-7907204c-89a9-4b8c-ba40-a8fe78616bed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c22f5695481341419674da058685a2d5'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:04.064561 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1111/2196] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:10:03 2022] DELETE /identity/v3/users/c22f5695481341419674da058685a2d5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:10:04.244608 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97f6db-e248-4296-a795-b622bd51343f service neutron] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:04.255233 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97f6db-e248-4296-a795-b622bd51343f service neutron] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:04.317446 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bc292-dbd7-46ca-93af-dd7d81d365bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:04.318390 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bc292-dbd7-46ca-93af-dd7d81d365bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:04.318724 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bc292-dbd7-46ca-93af-dd7d81d365bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:04.319065 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bc292-dbd7-46ca-93af-dd7d81d365bb admin admin] PATH_INFO: `/v3/projects/52b2d02e7570468daabac047ad3a7fa5` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:04.320374 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799bc292-dbd7-46ca-93af-dd7d81d365bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=52b2d02e7570468daabac047ad3a7fa5)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:04.321703 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821bc48-a540-45e2-8cf6-87aaa04990b7 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:04.322010 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821bc48-a540-45e2-8cf6-87aaa04990b7 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:04.322280 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821bc48-a540-45e2-8cf6-87aaa04990b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:04.322684 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799bc292-dbd7-46ca-93af-dd7d81d365bb admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:04.340199 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-f821bc48-a540-45e2-8cf6-87aaa04990b7 None None] MFA Rules not processed for user `4ded28c2ffe345ccbefde50585023857`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:10:04.341483 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-f821bc48-a540-45e2-8cf6-87aaa04990b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:04.368745 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-799bc292-dbd7-46ca-93af-dd7d81d365bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52b2d02e7570468daabac047ad3a7fa5', 'request_id': 'req-799bc292-dbd7-46ca-93af-dd7d81d365bb'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:04.379222 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-799bc292-dbd7-46ca-93af-dd7d81d365bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52b2d02e7570468daabac047ad3a7fa5', 'request_id': 'req-799bc292-dbd7-46ca-93af-dd7d81d365bb'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:04.389278 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-799bc292-dbd7-46ca-93af-dd7d81d365bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52b2d02e7570468daabac047ad3a7fa5', 'request_id': 'req-799bc292-dbd7-46ca-93af-dd7d81d365bb'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:04.398529 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1112/2197] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:10:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:10:04.403635 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-799bc292-dbd7-46ca-93af-dd7d81d365bb admin admin] The token cache is being invalidate because project 52b2d02e7570468daabac047ad3a7fa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:10:04.404087 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-799bc292-dbd7-46ca-93af-dd7d81d365bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:04.404739 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-799bc292-dbd7-46ca-93af-dd7d81d365bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:04.406647 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1086/2198] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:10:04 2022] DELETE /identity/v3/projects/52b2d02e7570468daabac047ad3a7fa5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:10:04.411173 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd8fff-7b89-478b-a859-c60ddca2b45a None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:04.411826 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd8fff-7b89-478b-a859-c60ddca2b45a None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:04.411826 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd8fff-7b89-478b-a859-c60ddca2b45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:04.431811 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-b4bd8fff-7b89-478b-a859-c60ddca2b45a None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:10:04.432749 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-b4bd8fff-7b89-478b-a859-c60ddca2b45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:04.496786 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1113/2199] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:10:04.504879 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217785e5-8a81-4efe-a4a3-ebf8a100c2a7 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:04.505158 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217785e5-8a81-4efe-a4a3-ebf8a100c2a7 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:04.505429 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217785e5-8a81-4efe-a4a3-ebf8a100c2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:04.532194 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-217785e5-8a81-4efe-a4a3-ebf8a100c2a7 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:10:04.533224 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-217785e5-8a81-4efe-a4a3-ebf8a100c2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:04.541867 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1087/2200] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:10:04.546121 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd8fff-7b89-478b-a859-c60ddca2b45a None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:04.555432 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd8fff-7b89-478b-a859-c60ddca2b45a None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:04.560047 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9745351-3257-4a23-ac88-6fa6fa4c634b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:04.560695 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9745351-3257-4a23-ac88-6fa6fa4c634b admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:04.560964 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9745351-3257-4a23-ac88-6fa6fa4c634b admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:04.561226 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9745351-3257-4a23-ac88-6fa6fa4c634b admin admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:04.561935 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9745351-3257-4a23-ac88-6fa6fa4c634b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:10:04.562230 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9745351-3257-4a23-ac88-6fa6fa4c634b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:04.563827 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9745351-3257-4a23-ac88-6fa6fa4c634b admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:04.575680 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1114/2201] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 03:10:04.580250 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217785e5-8a81-4efe-a4a3-ebf8a100c2a7 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:04.589808 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217785e5-8a81-4efe-a4a3-ebf8a100c2a7 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:04.595047 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a536221-cb97-4a75-bbda-56771fee291e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:04.595695 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a536221-cb97-4a75-bbda-56771fee291e admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:04.596833 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a536221-cb97-4a75-bbda-56771fee291e admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:04.596833 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a536221-cb97-4a75-bbda-56771fee291e admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:04.597033 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a536221-cb97-4a75-bbda-56771fee291e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:04.598962 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a536221-cb97-4a75-bbda-56771fee291e admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:04.631250 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1088/2202] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:10:04 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:10:04.632099 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9745351-3257-4a23-ac88-6fa6fa4c634b admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:04.642097 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9745351-3257-4a23-ac88-6fa6fa4c634b admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:04.697830 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7375c-cc1d-4b52-973a-b0472bf4d18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:04.698503 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7375c-cc1d-4b52-973a-b0472bf4d18e admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:04.698783 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7375c-cc1d-4b52-973a-b0472bf4d18e admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:04.699125 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7375c-cc1d-4b52-973a-b0472bf4d18e admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:04.699740 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7375c-cc1d-4b52-973a-b0472bf4d18e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:04.701972 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7375c-cc1d-4b52-973a-b0472bf4d18e admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:04.715447 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a536221-cb97-4a75-bbda-56771fee291e admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:04.717634 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-7a536221-cb97-4a75-bbda-56771fee291e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:04.725034 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1115/2203] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:10:04 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 03:10:04.729030 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7375c-cc1d-4b52-973a-b0472bf4d18e admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:04.738330 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7375c-cc1d-4b52-973a-b0472bf4d18e admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:04.743076 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b9a7e-afdf-4662-821a-44dade4f122d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:04.744035 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b9a7e-afdf-4662-821a-44dade4f122d admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:04.744410 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b9a7e-afdf-4662-821a-44dade4f122d admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:04.744680 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b9a7e-afdf-4662-821a-44dade4f122d admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:04.745403 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b9a7e-afdf-4662-821a-44dade4f122d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:04.747024 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b9a7e-afdf-4662-821a-44dade4f122d admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:04.756781 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1116/2204] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:10:04.760856 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b9a7e-afdf-4662-821a-44dade4f122d admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:04.770065 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b9a7e-afdf-4662-821a-44dade4f122d admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:04.774684 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3927bab-e6fa-4efb-94eb-60a90708e1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:04.775161 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3927bab-e6fa-4efb-94eb-60a90708e1ad admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:04.775434 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3927bab-e6fa-4efb-94eb-60a90708e1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:04.775698 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3927bab-e6fa-4efb-94eb-60a90708e1ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:04.776443 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3927bab-e6fa-4efb-94eb-60a90708e1ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:04.777561 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a536221-cb97-4a75-bbda-56771fee291e admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:04.778003 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3927bab-e6fa-4efb-94eb-60a90708e1ad admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:04.781652 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18b8f2-6fcf-4c73-8dba-0a75367ec2fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:04.782357 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18b8f2-6fcf-4c73-8dba-0a75367ec2fe service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:04.782581 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18b8f2-6fcf-4c73-8dba-0a75367ec2fe service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:04.782857 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18b8f2-6fcf-4c73-8dba-0a75367ec2fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:04.784767 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-cc18b8f2-6fcf-4c73-8dba-0a75367ec2fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:04.787552 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1117/2205] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:10:04.791694 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3927bab-e6fa-4efb-94eb-60a90708e1ad admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:04.794994 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18b8f2-6fcf-4c73-8dba-0a75367ec2fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:04.796476 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18b8f2-6fcf-4c73-8dba-0a75367ec2fe service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:04.800964 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3927bab-e6fa-4efb-94eb-60a90708e1ad admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:04.804414 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1089/2206] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:10:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:10:04.805876 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139dc76-13b5-422b-8175-596ed085e0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:04.806909 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139dc76-13b5-422b-8175-596ed085e0b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:04.807183 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139dc76-13b5-422b-8175-596ed085e0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:04.807447 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139dc76-13b5-422b-8175-596ed085e0b2 admin admin] PATH_INFO: `/v3/projects/41e576ef7c634ff5ac1da0d1a11bf18f/users/784dbccfeede4c3bbc68d354b1313b95/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:04.822088 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139dc76-13b5-422b-8175-596ed085e0b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41e576ef7c634ff5ac1da0d1a11bf18f, user_id=784dbccfeede4c3bbc68d354b1313b95, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:04.825591 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139dc76-13b5-422b-8175-596ed085e0b2 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:04.840243 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1118/2207] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:10:04 2022] PUT /identity/v3/projects/41e576ef7c634ff5ac1da0d1a11bf18f/users/784dbccfeede4c3bbc68d354b1313b95/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:10:04.850327 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88a3b3-ec90-48fc-bb74-f548e45ce684 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:04.850611 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88a3b3-ec90-48fc-bb74-f548e45ce684 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:04.850894 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88a3b3-ec90-48fc-bb74-f548e45ce684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:04.879504 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-6c88a3b3-ec90-48fc-bb74-f548e45ce684 None None] MFA Rules not processed for user `784dbccfeede4c3bbc68d354b1313b95`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:10:04.880824 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-6c88a3b3-ec90-48fc-bb74-f548e45ce684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:04.952835 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1090/2208] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:10:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:10:04.957175 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139dc76-13b5-422b-8175-596ed085e0b2 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:05.025219 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139dc76-13b5-422b-8175-596ed085e0b2 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:05.030242 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683720f5-b26f-4141-b4a6-8985f139df8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:05.030741 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683720f5-b26f-4141-b4a6-8985f139df8c admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:05.031012 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683720f5-b26f-4141-b4a6-8985f139df8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:05.031279 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683720f5-b26f-4141-b4a6-8985f139df8c admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:05.031991 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683720f5-b26f-4141-b4a6-8985f139df8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:05.033914 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683720f5-b26f-4141-b4a6-8985f139df8c admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:05.061468 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1119/2209] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:10:04 2022] POST /identity/v3/projects => generated 363 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:10:05.065207 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88a3b3-ec90-48fc-bb74-f548e45ce684 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:05.077571 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88a3b3-ec90-48fc-bb74-f548e45ce684 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:05.132823 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683720f5-b26f-4141-b4a6-8985f139df8c admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:05.134947 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-683720f5-b26f-4141-b4a6-8985f139df8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:05.152501 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e8e4b-d85a-4639-953b-5d1e5bc6ce0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:05.154238 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e8e4b-d85a-4639-953b-5d1e5bc6ce0b admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:05.154612 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e8e4b-d85a-4639-953b-5d1e5bc6ce0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:05.154950 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e8e4b-d85a-4639-953b-5d1e5bc6ce0b admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:05.155748 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e8e4b-d85a-4639-953b-5d1e5bc6ce0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:05.157789 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e8e4b-d85a-4639-953b-5d1e5bc6ce0b admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:05.180136 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1091/2210] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:10:05 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:10:05.184583 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e8e4b-d85a-4639-953b-5d1e5bc6ce0b admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:05.194820 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e8e4b-d85a-4639-953b-5d1e5bc6ce0b admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:05.200450 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1d5ad-ea7e-472e-918f-6c5b844f5433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:05.201081 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1d5ad-ea7e-472e-918f-6c5b844f5433 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:05.201416 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1d5ad-ea7e-472e-918f-6c5b844f5433 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:05.201924 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1d5ad-ea7e-472e-918f-6c5b844f5433 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:05.203446 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1d5ad-ea7e-472e-918f-6c5b844f5433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:05.205347 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1d5ad-ea7e-472e-918f-6c5b844f5433 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:05.216937 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683720f5-b26f-4141-b4a6-8985f139df8c admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:05.217558 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1092/2211] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:10:05.222717 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62bc2b-e3b4-4840-9fb8-dee09c29c22b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a88ae51543497382d34573afc2bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:05.223606 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62bc2b-e3b4-4840-9fb8-dee09c29c22b service placement] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:05.224121 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62bc2b-e3b4-4840-9fb8-dee09c29c22b service placement] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:05.224562 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62bc2b-e3b4-4840-9fb8-dee09c29c22b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:05.226854 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-9d62bc2b-e3b4-4840-9fb8-dee09c29c22b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:05.229634 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1d5ad-ea7e-472e-918f-6c5b844f5433 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:05.239899 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d62bc2b-e3b4-4840-9fb8-dee09c29c22b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:05.241098 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1d5ad-ea7e-472e-918f-6c5b844f5433 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:05.241488 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d62bc2b-e3b4-4840-9fb8-dee09c29c22b service placement] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:05.248576 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79fadf-2ce0-4db6-9474-9afa2cd7d3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:05.249636 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79fadf-2ce0-4db6-9474-9afa2cd7d3cb admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:05.249906 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79fadf-2ce0-4db6-9474-9afa2cd7d3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:05.250262 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79fadf-2ce0-4db6-9474-9afa2cd7d3cb admin admin] PATH_INFO: `/v3/projects/d8585efc89624b72aa5d4029fa6be484/users/ff8ae147c1dd4fbc8889acaa8e4f9cf7/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:05.254069 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1120/2212] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:10:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:10:05.265754 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79fadf-2ce0-4db6-9474-9afa2cd7d3cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8585efc89624b72aa5d4029fa6be484, user_id=ff8ae147c1dd4fbc8889acaa8e4f9cf7, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:05.269689 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79fadf-2ce0-4db6-9474-9afa2cd7d3cb admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:05.288347 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1093/2213] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:10:05 2022] PUT /identity/v3/projects/d8585efc89624b72aa5d4029fa6be484/users/ff8ae147c1dd4fbc8889acaa8e4f9cf7/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:10:05.289780 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62bc2b-e3b4-4840-9fb8-dee09c29c22b service placement] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:05.302871 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62bc2b-e3b4-4840-9fb8-dee09c29c22b service placement] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:05.374336 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310a644-6ca1-4caf-b9fe-18a7769c59d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:05.375018 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310a644-6ca1-4caf-b9fe-18a7769c59d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:05.375295 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310a644-6ca1-4caf-b9fe-18a7769c59d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:05.375557 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310a644-6ca1-4caf-b9fe-18a7769c59d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:05.376390 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310a644-6ca1-4caf-b9fe-18a7769c59d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:05.377962 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310a644-6ca1-4caf-b9fe-18a7769c59d3 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:05.391293 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1121/2214] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:10:05.392816 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79fadf-2ce0-4db6-9474-9afa2cd7d3cb admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:05.404163 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79fadf-2ce0-4db6-9474-9afa2cd7d3cb admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:05.409320 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7583d0d-1e3f-41c4-a135-90abae491f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:05.410205 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7583d0d-1e3f-41c4-a135-90abae491f6c admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:05.410481 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7583d0d-1e3f-41c4-a135-90abae491f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:05.410750 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7583d0d-1e3f-41c4-a135-90abae491f6c admin admin] PATH_INFO: `/v3/projects/d8585efc89624b72aa5d4029fa6be484/users/ff8ae147c1dd4fbc8889acaa8e4f9cf7/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:05.412909 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7583d0d-1e3f-41c4-a135-90abae491f6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8585efc89624b72aa5d4029fa6be484, user_id=ff8ae147c1dd4fbc8889acaa8e4f9cf7, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:05.415842 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7583d0d-1e3f-41c4-a135-90abae491f6c admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:05.428847 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1094/2215] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:10:05 2022] PUT /identity/v3/projects/d8585efc89624b72aa5d4029fa6be484/users/ff8ae147c1dd4fbc8889acaa8e4f9cf7/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:10:05.441640 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e463b-748c-4963-b6a1-224bcb63e683 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:05.441930 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e463b-748c-4963-b6a1-224bcb63e683 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:05.442237 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e463b-748c-4963-b6a1-224bcb63e683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:05.469082 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-e31e463b-748c-4963-b6a1-224bcb63e683 None None] MFA Rules not processed for user `ff8ae147c1dd4fbc8889acaa8e4f9cf7`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:10:05.470300 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-e31e463b-748c-4963-b6a1-224bcb63e683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:05.542386 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1122/2216] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:10:05 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:10:05.554161 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7583d0d-1e3f-41c4-a135-90abae491f6c admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:05.556371 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-e7583d0d-1e3f-41c4-a135-90abae491f6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:05.628675 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7583d0d-1e3f-41c4-a135-90abae491f6c admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:05.633314 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfaeb1-a48c-4e64-8d55-5372f4b3731d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:05.634041 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfaeb1-a48c-4e64-8d55-5372f4b3731d service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:05.634402 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfaeb1-a48c-4e64-8d55-5372f4b3731d service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:05.634881 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfaeb1-a48c-4e64-8d55-5372f4b3731d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:05.645125 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bfaeb1-a48c-4e64-8d55-5372f4b3731d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:05.646587 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bfaeb1-a48c-4e64-8d55-5372f4b3731d service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:05.658802 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1095/2217] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:10:05 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:10:05.744940 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e463b-748c-4963-b6a1-224bcb63e683 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:05.758409 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e463b-748c-4963-b6a1-224bcb63e683 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:05.762691 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2ccd1-5791-4a7c-a67a-0d3ef5656c38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:05.763298 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2ccd1-5791-4a7c-a67a-0d3ef5656c38 service cinder] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:05.763467 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2ccd1-5791-4a7c-a67a-0d3ef5656c38 service cinder] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:05.763758 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2ccd1-5791-4a7c-a67a-0d3ef5656c38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:05.832178 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2ccd1-5791-4a7c-a67a-0d3ef5656c38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:05.837927 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2ccd1-5791-4a7c-a67a-0d3ef5656c38 service cinder] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:05.856043 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1123/2218] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:10:05 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:10:10.206914 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfaeb1-a48c-4e64-8d55-5372f4b3731d service cinder] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:10.209665 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-06bfaeb1-a48c-4e64-8d55-5372f4b3731d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:10.274107 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfaeb1-a48c-4e64-8d55-5372f4b3731d service cinder] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:10.278998 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c215f6f-752c-4d44-b982-91b2e6f6aca9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:10.279650 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c215f6f-752c-4d44-b982-91b2e6f6aca9 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:10.279955 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c215f6f-752c-4d44-b982-91b2e6f6aca9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:10.280218 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c215f6f-752c-4d44-b982-91b2e6f6aca9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:10.282480 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-2c215f6f-752c-4d44-b982-91b2e6f6aca9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:10.292509 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c215f6f-752c-4d44-b982-91b2e6f6aca9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:10.294237 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c215f6f-752c-4d44-b982-91b2e6f6aca9 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:10.302628 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1096/2219] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:10:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:10:14.614263 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2ccd1-5791-4a7c-a67a-0d3ef5656c38 service cinder] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:14.615859 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-acc2ccd1-5791-4a7c-a67a-0d3ef5656c38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:14.688828 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2ccd1-5791-4a7c-a67a-0d3ef5656c38 service cinder] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:14.694415 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3911fbf-5df8-4fd9-891b-bcc0ab58932a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:14.695058 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3911fbf-5df8-4fd9-891b-bcc0ab58932a service nova] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:14.695330 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3911fbf-5df8-4fd9-891b-bcc0ab58932a service nova] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:14.695596 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3911fbf-5df8-4fd9-891b-bcc0ab58932a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:14.697882 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-f3911fbf-5df8-4fd9-891b-bcc0ab58932a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:14.756266 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3911fbf-5df8-4fd9-891b-bcc0ab58932a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:14.757870 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3911fbf-5df8-4fd9-891b-bcc0ab58932a service nova] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:14.766920 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1124/2220] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:10:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:10:15.324351 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c215f6f-752c-4d44-b982-91b2e6f6aca9 service neutron] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:15.392670 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c215f6f-752c-4d44-b982-91b2e6f6aca9 service neutron] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:15.400808 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d28c5-2fa5-412d-9054-4f03249fa21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:15.401668 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d28c5-2fa5-412d-9054-4f03249fa21a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:15.401934 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d28c5-2fa5-412d-9054-4f03249fa21a admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:15.402192 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d28c5-2fa5-412d-9054-4f03249fa21a admin admin] PATH_INFO: `/v3/users/784dbccfeede4c3bbc68d354b1313b95` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:15.403438 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d28c5-2fa5-412d-9054-4f03249fa21a admin admin] RBAC: Authorizing `identity:delete_user(user_id=784dbccfeede4c3bbc68d354b1313b95)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:15.405429 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d28c5-2fa5-412d-9054-4f03249fa21a admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:15.454041 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-dd9d28c5-2fa5-412d-9054-4f03249fa21a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '784dbccfeede4c3bbc68d354b1313b95'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:15.455190 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-dd9d28c5-2fa5-412d-9054-4f03249fa21a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '784dbccfeede4c3bbc68d354b1313b95'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:15.470669 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-dd9d28c5-2fa5-412d-9054-4f03249fa21a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '784dbccfeede4c3bbc68d354b1313b95'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:15.471406 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-dd9d28c5-2fa5-412d-9054-4f03249fa21a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '784dbccfeede4c3bbc68d354b1313b95'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:15.478787 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-dd9d28c5-2fa5-412d-9054-4f03249fa21a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '784dbccfeede4c3bbc68d354b1313b95'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:15.494405 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1097/2221] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:10:15 2022] DELETE /identity/v3/users/784dbccfeede4c3bbc68d354b1313b95 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:10:15.499085 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24ebac-e75a-412d-a628-55f0e2725bbf None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:15.499357 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24ebac-e75a-412d-a628-55f0e2725bbf None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:15.499642 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24ebac-e75a-412d-a628-55f0e2725bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:15.517780 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-6a24ebac-e75a-412d-a628-55f0e2725bbf None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:10:15.518942 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-6a24ebac-e75a-412d-a628-55f0e2725bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:15.578635 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1125/2222] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:10:15.590225 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d28c5-2fa5-412d-9054-4f03249fa21a admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:15.591750 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-dd9d28c5-2fa5-412d-9054-4f03249fa21a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:15.671421 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d28c5-2fa5-412d-9054-4f03249fa21a admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:15.675864 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e42c3c-c9b1-4227-a4f0-b2ec45924679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:15.676493 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e42c3c-c9b1-4227-a4f0-b2ec45924679 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:15.676770 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e42c3c-c9b1-4227-a4f0-b2ec45924679 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:15.677009 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e42c3c-c9b1-4227-a4f0-b2ec45924679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:15.686604 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e42c3c-c9b1-4227-a4f0-b2ec45924679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:15.688113 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e42c3c-c9b1-4227-a4f0-b2ec45924679 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:15.697867 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1098/2223] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:10:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:10:15.746574 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a24ebac-e75a-412d-a628-55f0e2725bbf None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:15.749022 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-6a24ebac-e75a-412d-a628-55f0e2725bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:15.763908 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a24ebac-e75a-412d-a628-55f0e2725bbf None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:15.768860 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eccfced-f048-4478-9b22-550e63a1dd82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:15.769615 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccfced-f048-4478-9b22-550e63a1dd82 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:15.769907 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccfced-f048-4478-9b22-550e63a1dd82 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:15.770163 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccfced-f048-4478-9b22-550e63a1dd82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:15.772497 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-1eccfced-f048-4478-9b22-550e63a1dd82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:15.832593 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eccfced-f048-4478-9b22-550e63a1dd82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:15.834015 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eccfced-f048-4478-9b22-550e63a1dd82 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:15.843427 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1126/2224] 10.222.0.32 () {60 vars in 1396 bytes} [Tue Apr 12 03:10:15 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 03:10:15.988201 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e42c3c-c9b1-4227-a4f0-b2ec45924679 service neutron] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:15.989710 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-c5e42c3c-c9b1-4227-a4f0-b2ec45924679 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:16.003917 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e42c3c-c9b1-4227-a4f0-b2ec45924679 service neutron] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:16.009728 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a5132-2a44-43a1-bf0e-db9c016da8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:16.010609 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a5132-2a44-43a1-bf0e-db9c016da8ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:16.011042 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a5132-2a44-43a1-bf0e-db9c016da8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:16.011327 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a5132-2a44-43a1-bf0e-db9c016da8ed admin admin] PATH_INFO: `/v3/projects/41e576ef7c634ff5ac1da0d1a11bf18f` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:16.013307 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a5132-2a44-43a1-bf0e-db9c016da8ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=41e576ef7c634ff5ac1da0d1a11bf18f)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:16.015409 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a5132-2a44-43a1-bf0e-db9c016da8ed admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:16.066456 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-e67a5132-2a44-43a1-bf0e-db9c016da8ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41e576ef7c634ff5ac1da0d1a11bf18f', 'request_id': 'req-e67a5132-2a44-43a1-bf0e-db9c016da8ed'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:16.075332 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-e67a5132-2a44-43a1-bf0e-db9c016da8ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41e576ef7c634ff5ac1da0d1a11bf18f', 'request_id': 'req-e67a5132-2a44-43a1-bf0e-db9c016da8ed'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:16.082569 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-e67a5132-2a44-43a1-bf0e-db9c016da8ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41e576ef7c634ff5ac1da0d1a11bf18f', 'request_id': 'req-e67a5132-2a44-43a1-bf0e-db9c016da8ed'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:16.097847 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-e67a5132-2a44-43a1-bf0e-db9c016da8ed admin admin] The token cache is being invalidate because project 41e576ef7c634ff5ac1da0d1a11bf18f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:10:16.098165 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-e67a5132-2a44-43a1-bf0e-db9c016da8ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:16.098854 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-e67a5132-2a44-43a1-bf0e-db9c016da8ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:16.100554 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1099/2225] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:10:15 2022] DELETE /identity/v3/projects/41e576ef7c634ff5ac1da0d1a11bf18f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:10:16.105886 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eccfced-f048-4478-9b22-550e63a1dd82 service neutron] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:16.118218 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eccfced-f048-4478-9b22-550e63a1dd82 service neutron] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:16.176915 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d080bb5-90ac-4be0-968a-a10991ff55c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:16.177773 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d080bb5-90ac-4be0-968a-a10991ff55c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:16.178043 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d080bb5-90ac-4be0-968a-a10991ff55c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:16.178306 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d080bb5-90ac-4be0-968a-a10991ff55c7 admin admin] PATH_INFO: `/v3/users/ff8ae147c1dd4fbc8889acaa8e4f9cf7` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:16.179452 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d080bb5-90ac-4be0-968a-a10991ff55c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff8ae147c1dd4fbc8889acaa8e4f9cf7)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:16.181485 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d080bb5-90ac-4be0-968a-a10991ff55c7 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:16.226065 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-8d080bb5-90ac-4be0-968a-a10991ff55c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff8ae147c1dd4fbc8889acaa8e4f9cf7'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:16.232492 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-8d080bb5-90ac-4be0-968a-a10991ff55c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff8ae147c1dd4fbc8889acaa8e4f9cf7'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:16.233173 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-8d080bb5-90ac-4be0-968a-a10991ff55c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff8ae147c1dd4fbc8889acaa8e4f9cf7'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:16.233876 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-8d080bb5-90ac-4be0-968a-a10991ff55c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff8ae147c1dd4fbc8889acaa8e4f9cf7'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:16.246574 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-8d080bb5-90ac-4be0-968a-a10991ff55c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff8ae147c1dd4fbc8889acaa8e4f9cf7'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:16.259496 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1127/2226] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:10:16 2022] DELETE /identity/v3/users/ff8ae147c1dd4fbc8889acaa8e4f9cf7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:10:16.540520 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a5132-2a44-43a1-bf0e-db9c016da8ed admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:16.541964 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-e67a5132-2a44-43a1-bf0e-db9c016da8ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:16.557163 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a5132-2a44-43a1-bf0e-db9c016da8ed admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:16.618378 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4489d7-579b-4a08-b878-e26f1605cff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:16.619223 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4489d7-579b-4a08-b878-e26f1605cff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:16.619492 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4489d7-579b-4a08-b878-e26f1605cff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:16.619774 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4489d7-579b-4a08-b878-e26f1605cff2 admin admin] PATH_INFO: `/v3/projects/d8585efc89624b72aa5d4029fa6be484` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:16.620929 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4489d7-579b-4a08-b878-e26f1605cff2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8585efc89624b72aa5d4029fa6be484)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:16.622832 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4489d7-579b-4a08-b878-e26f1605cff2 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:16.676665 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-ae4489d7-579b-4a08-b878-e26f1605cff2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8585efc89624b72aa5d4029fa6be484', 'request_id': 'req-ae4489d7-579b-4a08-b878-e26f1605cff2'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:16.686447 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-ae4489d7-579b-4a08-b878-e26f1605cff2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8585efc89624b72aa5d4029fa6be484', 'request_id': 'req-ae4489d7-579b-4a08-b878-e26f1605cff2'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:16.692984 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-ae4489d7-579b-4a08-b878-e26f1605cff2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8585efc89624b72aa5d4029fa6be484', 'request_id': 'req-ae4489d7-579b-4a08-b878-e26f1605cff2'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:16.703785 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-ae4489d7-579b-4a08-b878-e26f1605cff2 admin admin] The token cache is being invalidate because project d8585efc89624b72aa5d4029fa6be484 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:10:16.704073 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-ae4489d7-579b-4a08-b878-e26f1605cff2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:16.704724 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-ae4489d7-579b-4a08-b878-e26f1605cff2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:16.706279 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1100/2227] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:10:16 2022] DELETE /identity/v3/projects/d8585efc89624b72aa5d4029fa6be484 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:10:16.711248 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d59b0-b81a-4e74-8883-37cda02c3028 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:16.711523 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d59b0-b81a-4e74-8883-37cda02c3028 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:16.711947 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d59b0-b81a-4e74-8883-37cda02c3028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:16.730196 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-185d59b0-b81a-4e74-8883-37cda02c3028 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:10:16.731282 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-185d59b0-b81a-4e74-8883-37cda02c3028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:16.806657 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1128/2228] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:10:16.814805 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ddf27-1241-4ec0-bae8-047ecbc94fa4 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:16.815110 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ddf27-1241-4ec0-bae8-047ecbc94fa4 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:16.815376 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ddf27-1241-4ec0-bae8-047ecbc94fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:16.836397 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-cb0ddf27-1241-4ec0-bae8-047ecbc94fa4 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:10:16.837707 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-cb0ddf27-1241-4ec0-bae8-047ecbc94fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:16.847143 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1101/2229] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:10:16.851524 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d59b0-b81a-4e74-8883-37cda02c3028 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:16.861663 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d59b0-b81a-4e74-8883-37cda02c3028 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:16.867308 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c784bf7-f4c2-41b9-a523-2fa2329bc336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:16.868065 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c784bf7-f4c2-41b9-a523-2fa2329bc336 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:16.868348 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c784bf7-f4c2-41b9-a523-2fa2329bc336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:16.868614 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c784bf7-f4c2-41b9-a523-2fa2329bc336 admin admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:16.869333 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c784bf7-f4c2-41b9-a523-2fa2329bc336 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:10:16.869633 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c784bf7-f4c2-41b9-a523-2fa2329bc336 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:16.871231 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c784bf7-f4c2-41b9-a523-2fa2329bc336 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:16.882837 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1129/2230] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:10:16.887126 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ddf27-1241-4ec0-bae8-047ecbc94fa4 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:16.896342 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ddf27-1241-4ec0-bae8-047ecbc94fa4 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:16.901897 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4b7fe-6e2c-43a1-8e3c-f2935566f763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:16.902534 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4b7fe-6e2c-43a1-8e3c-f2935566f763 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:16.902806 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4b7fe-6e2c-43a1-8e3c-f2935566f763 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:16.903072 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4b7fe-6e2c-43a1-8e3c-f2935566f763 admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:16.903774 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4b7fe-6e2c-43a1-8e3c-f2935566f763 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:16.905685 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4b7fe-6e2c-43a1-8e3c-f2935566f763 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:16.933001 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1102/2231] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:10:16 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 03:10:16.937174 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c784bf7-f4c2-41b9-a523-2fa2329bc336 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:16.947239 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c784bf7-f4c2-41b9-a523-2fa2329bc336 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:17.003545 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda38747-48b3-4ef7-a49f-7851f09f6e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:17.004160 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda38747-48b3-4ef7-a49f-7851f09f6e87 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:17.004439 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda38747-48b3-4ef7-a49f-7851f09f6e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:17.004705 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda38747-48b3-4ef7-a49f-7851f09f6e87 admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:17.005401 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda38747-48b3-4ef7-a49f-7851f09f6e87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:17.007287 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda38747-48b3-4ef7-a49f-7851f09f6e87 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:17.028936 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1130/2232] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:10:16 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:10:17.033180 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4b7fe-6e2c-43a1-8e3c-f2935566f763 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:17.043946 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4b7fe-6e2c-43a1-8e3c-f2935566f763 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:17.049171 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264efa2e-8d6d-42b9-bcd7-e332776ae90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:17.049836 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264efa2e-8d6d-42b9-bcd7-e332776ae90a admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:17.050108 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264efa2e-8d6d-42b9-bcd7-e332776ae90a admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:17.050373 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264efa2e-8d6d-42b9-bcd7-e332776ae90a admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:17.051081 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264efa2e-8d6d-42b9-bcd7-e332776ae90a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:17.052715 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264efa2e-8d6d-42b9-bcd7-e332776ae90a admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:17.063887 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1103/2233] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:10:17.068107 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda38747-48b3-4ef7-a49f-7851f09f6e87 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:17.078431 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda38747-48b3-4ef7-a49f-7851f09f6e87 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:17.083237 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e17839-29a5-4308-a503-3a0d0076b675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:17.083922 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e17839-29a5-4308-a503-3a0d0076b675 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:17.084193 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e17839-29a5-4308-a503-3a0d0076b675 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:17.084492 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e17839-29a5-4308-a503-3a0d0076b675 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:17.085207 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e17839-29a5-4308-a503-3a0d0076b675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:17.086983 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e17839-29a5-4308-a503-3a0d0076b675 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:17.097273 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1131/2234] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:10:17.101562 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264efa2e-8d6d-42b9-bcd7-e332776ae90a admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:17.112082 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264efa2e-8d6d-42b9-bcd7-e332776ae90a admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:17.117137 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49493e8-bd1e-426e-a7f6-410ca2fdc61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:17.118064 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49493e8-bd1e-426e-a7f6-410ca2fdc61b admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:17.118785 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49493e8-bd1e-426e-a7f6-410ca2fdc61b admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:17.118785 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49493e8-bd1e-426e-a7f6-410ca2fdc61b admin admin] PATH_INFO: `/v3/projects/619c0bc38fd241aa85fac2b8384f796d/users/d5a8ffdc3486477a9b04831852737fcf/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:17.138799 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49493e8-bd1e-426e-a7f6-410ca2fdc61b admin admin] RBAC: Authorizing `identity:create_grant(project_id=619c0bc38fd241aa85fac2b8384f796d, user_id=d5a8ffdc3486477a9b04831852737fcf, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:17.141621 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49493e8-bd1e-426e-a7f6-410ca2fdc61b admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:17.156110 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1104/2235] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:10:17 2022] PUT /identity/v3/projects/619c0bc38fd241aa85fac2b8384f796d/users/d5a8ffdc3486477a9b04831852737fcf/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:10:17.168752 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac4876-816c-4efa-b1a9-e960807a9824 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:17.169674 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac4876-816c-4efa-b1a9-e960807a9824 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:17.169993 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac4876-816c-4efa-b1a9-e960807a9824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:17.198541 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-0fac4876-816c-4efa-b1a9-e960807a9824 None None] MFA Rules not processed for user `d5a8ffdc3486477a9b04831852737fcf`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:10:17.199799 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-0fac4876-816c-4efa-b1a9-e960807a9824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:17.273696 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1132/2236] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:10:17 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:10:17.278535 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49493e8-bd1e-426e-a7f6-410ca2fdc61b admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:17.337256 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49493e8-bd1e-426e-a7f6-410ca2fdc61b admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:17.342065 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9eadf-433d-490f-8216-19b5d1289499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:17.342718 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9eadf-433d-490f-8216-19b5d1289499 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:17.342988 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9eadf-433d-490f-8216-19b5d1289499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:17.343256 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9eadf-433d-490f-8216-19b5d1289499 admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:17.343969 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9eadf-433d-490f-8216-19b5d1289499 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:17.345876 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9eadf-433d-490f-8216-19b5d1289499 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:17.372691 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1105/2237] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:10:17 2022] POST /identity/v3/projects => generated 367 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:10:17.376730 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac4876-816c-4efa-b1a9-e960807a9824 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:17.387770 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac4876-816c-4efa-b1a9-e960807a9824 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:17.447140 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786190a-7de1-491d-9bfb-9e5d7933298c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:17.447869 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786190a-7de1-491d-9bfb-9e5d7933298c admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:17.448151 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786190a-7de1-491d-9bfb-9e5d7933298c admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:17.448445 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786190a-7de1-491d-9bfb-9e5d7933298c admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:17.449147 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5786190a-7de1-491d-9bfb-9e5d7933298c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:17.451364 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5786190a-7de1-491d-9bfb-9e5d7933298c admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:17.471915 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1133/2238] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:10:17 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 03:10:17.475947 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9eadf-433d-490f-8216-19b5d1289499 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:17.486412 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9eadf-433d-490f-8216-19b5d1289499 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:17.491012 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a26ec0-8dce-4fe3-84b6-69e31593d526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:17.491670 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a26ec0-8dce-4fe3-84b6-69e31593d526 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:17.492096 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a26ec0-8dce-4fe3-84b6-69e31593d526 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:17.492369 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a26ec0-8dce-4fe3-84b6-69e31593d526 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:17.493236 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a26ec0-8dce-4fe3-84b6-69e31593d526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:17.494830 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a26ec0-8dce-4fe3-84b6-69e31593d526 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:17.505363 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1106/2239] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:10:17.509798 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786190a-7de1-491d-9bfb-9e5d7933298c admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:17.520376 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786190a-7de1-491d-9bfb-9e5d7933298c admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:17.526567 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba222413-be5e-4315-a320-63329b79f7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:17.527390 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba222413-be5e-4315-a320-63329b79f7a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:17.527663 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba222413-be5e-4315-a320-63329b79f7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:17.527962 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba222413-be5e-4315-a320-63329b79f7a1 admin admin] PATH_INFO: `/v3/projects/587d0a6f04134c58b77282574fbf0272/users/66505a18c8174310b42d74c6951d8530/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:17.543040 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba222413-be5e-4315-a320-63329b79f7a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=587d0a6f04134c58b77282574fbf0272, user_id=66505a18c8174310b42d74c6951d8530, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:17.545865 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba222413-be5e-4315-a320-63329b79f7a1 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:17.559434 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1134/2240] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:10:17 2022] PUT /identity/v3/projects/587d0a6f04134c58b77282574fbf0272/users/66505a18c8174310b42d74c6951d8530/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:10:17.563456 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a26ec0-8dce-4fe3-84b6-69e31593d526 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:17.574149 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a26ec0-8dce-4fe3-84b6-69e31593d526 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:17.632501 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c22c9-b3c6-42fc-ad4a-814664b1029e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:17.633186 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c22c9-b3c6-42fc-ad4a-814664b1029e admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:17.633449 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c22c9-b3c6-42fc-ad4a-814664b1029e admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:17.633715 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c22c9-b3c6-42fc-ad4a-814664b1029e admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:17.634623 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c22c9-b3c6-42fc-ad4a-814664b1029e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:17.636283 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c22c9-b3c6-42fc-ad4a-814664b1029e admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:17.646083 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1107/2241] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:10:17.650413 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba222413-be5e-4315-a320-63329b79f7a1 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:17.660809 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba222413-be5e-4315-a320-63329b79f7a1 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:17.665955 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085bc98-12af-445e-a5eb-ecc34a4333cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:17.666888 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085bc98-12af-445e-a5eb-ecc34a4333cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:17.667164 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085bc98-12af-445e-a5eb-ecc34a4333cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:17.667429 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085bc98-12af-445e-a5eb-ecc34a4333cd admin admin] PATH_INFO: `/v3/projects/587d0a6f04134c58b77282574fbf0272/users/66505a18c8174310b42d74c6951d8530/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:17.669451 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085bc98-12af-445e-a5eb-ecc34a4333cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=587d0a6f04134c58b77282574fbf0272, user_id=66505a18c8174310b42d74c6951d8530, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:17.672149 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085bc98-12af-445e-a5eb-ecc34a4333cd admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:17.682995 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1135/2242] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:10:17 2022] PUT /identity/v3/projects/587d0a6f04134c58b77282574fbf0272/users/66505a18c8174310b42d74c6951d8530/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:10:17.694283 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f432d-d868-41f9-a631-e60d10177425 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:17.694584 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f432d-d868-41f9-a631-e60d10177425 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:17.694852 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f432d-d868-41f9-a631-e60d10177425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:17.722866 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-2c3f432d-d868-41f9-a631-e60d10177425 None None] MFA Rules not processed for user `66505a18c8174310b42d74c6951d8530`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:10:17.724068 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-2c3f432d-d868-41f9-a631-e60d10177425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:17.794278 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1108/2243] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:10:17 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:10:17.805732 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085bc98-12af-445e-a5eb-ecc34a4333cd admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:17.807666 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-3085bc98-12af-445e-a5eb-ecc34a4333cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:17.865902 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085bc98-12af-445e-a5eb-ecc34a4333cd admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:17.869916 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6875e-6177-4e83-97f8-3ead0d14a585 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:17.870556 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6875e-6177-4e83-97f8-3ead0d14a585 service cinder] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:17.870829 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6875e-6177-4e83-97f8-3ead0d14a585 service cinder] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:17.871091 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6875e-6177-4e83-97f8-3ead0d14a585 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:17.880134 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6875e-6177-4e83-97f8-3ead0d14a585 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:17.881561 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6875e-6177-4e83-97f8-3ead0d14a585 service cinder] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:17.891047 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1136/2244] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:10:17 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:10:17.979395 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f432d-d868-41f9-a631-e60d10177425 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:17.988968 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f432d-d868-41f9-a631-e60d10177425 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:17.993072 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fa747-1ac5-4d33-b4ac-d3caff326d5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:17.993760 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fa747-1ac5-4d33-b4ac-d3caff326d5d service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:17.994056 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fa747-1ac5-4d33-b4ac-d3caff326d5d service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:17.994343 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fa747-1ac5-4d33-b4ac-d3caff326d5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:18.052549 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8fa747-1ac5-4d33-b4ac-d3caff326d5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:18.053914 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8fa747-1ac5-4d33-b4ac-d3caff326d5d service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:18.062781 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1109/2245] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:10:17 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:10:22.070993 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db4844-123f-416c-b68d-936c7c5d4bdd None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:22.071489 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db4844-123f-416c-b68d-936c7c5d4bdd None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:22.071715 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db4844-123f-416c-b68d-936c7c5d4bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:22.091327 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-20db4844-123f-416c-b68d-936c7c5d4bdd None None] MFA Rules not processed for user `83115653901749f6ade6638593fb54e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:10:22.092546 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-20db4844-123f-416c-b68d-936c7c5d4bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:22.148446 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1137/2246] 10.222.0.32 () {58 vars in 1009 bytes} [Tue Apr 12 03:10:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:10:22.195877 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fa747-1ac5-4d33-b4ac-d3caff326d5d service cinder] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:22.197578 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-ef8fa747-1ac5-4d33-b4ac-d3caff326d5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:22.268297 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fa747-1ac5-4d33-b4ac-d3caff326d5d service cinder] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:22.273506 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed39bd-2886-4601-80ff-abc9eb2f72df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e8d78f92f12405fb746ddeb2579bd2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:22.274201 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed39bd-2886-4601-80ff-abc9eb2f72df service swift] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:22.274546 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed39bd-2886-4601-80ff-abc9eb2f72df service swift] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:22.274821 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed39bd-2886-4601-80ff-abc9eb2f72df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:22.283156 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed39bd-2886-4601-80ff-abc9eb2f72df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:22.284792 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed39bd-2886-4601-80ff-abc9eb2f72df service swift] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:22.292956 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1110/2247] 10.222.0.32 () {60 vars in 1384 bytes} [Tue Apr 12 03:10:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 03:10:22.879241 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db4844-123f-416c-b68d-936c7c5d4bdd None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:22.957607 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db4844-123f-416c-b68d-936c7c5d4bdd None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:22.963547 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8569a41-cfa9-4634-8cc4-7863e336e0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:22.964464 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8569a41-cfa9-4634-8cc4-7863e336e0c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:22.964741 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8569a41-cfa9-4634-8cc4-7863e336e0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:22.965012 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8569a41-cfa9-4634-8cc4-7863e336e0c3 admin admin] PATH_INFO: `/v3/users/d5a8ffdc3486477a9b04831852737fcf` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:22.966200 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8569a41-cfa9-4634-8cc4-7863e336e0c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5a8ffdc3486477a9b04831852737fcf)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:22.968175 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8569a41-cfa9-4634-8cc4-7863e336e0c3 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:23.025284 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-d8569a41-cfa9-4634-8cc4-7863e336e0c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5a8ffdc3486477a9b04831852737fcf'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:23.033160 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-d8569a41-cfa9-4634-8cc4-7863e336e0c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5a8ffdc3486477a9b04831852737fcf'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:23.034049 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-d8569a41-cfa9-4634-8cc4-7863e336e0c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5a8ffdc3486477a9b04831852737fcf'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:23.034702 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-d8569a41-cfa9-4634-8cc4-7863e336e0c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5a8ffdc3486477a9b04831852737fcf'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:23.047505 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-d8569a41-cfa9-4634-8cc4-7863e336e0c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5a8ffdc3486477a9b04831852737fcf'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:23.062095 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1138/2248] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:10:22 2022] DELETE /identity/v3/users/d5a8ffdc3486477a9b04831852737fcf => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:10:23.066566 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b20616-2db7-4d7f-ab63-0d82065d38f3 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:23.066853 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b20616-2db7-4d7f-ab63-0d82065d38f3 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:23.067130 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b20616-2db7-4d7f-ab63-0d82065d38f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:23.086593 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-69b20616-2db7-4d7f-ab63-0d82065d38f3 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:10:23.087999 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-69b20616-2db7-4d7f-ab63-0d82065d38f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:23.163638 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1111/2249] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:10:23.173842 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8569a41-cfa9-4634-8cc4-7863e336e0c3 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:23.175242 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-d8569a41-cfa9-4634-8cc4-7863e336e0c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:23.247081 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8569a41-cfa9-4634-8cc4-7863e336e0c3 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:23.250549 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9c2c1-daa9-48d9-a902-7b5c0aac6513 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:23.251326 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9c2c1-daa9-48d9-a902-7b5c0aac6513 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:23.251703 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9c2c1-daa9-48d9-a902-7b5c0aac6513 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:23.252126 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9c2c1-daa9-48d9-a902-7b5c0aac6513 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:23.262793 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9c2c1-daa9-48d9-a902-7b5c0aac6513 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:23.264437 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9c2c1-daa9-48d9-a902-7b5c0aac6513 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:23.275119 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1139/2250] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:10:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:10:23.625487 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b20616-2db7-4d7f-ab63-0d82065d38f3 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:23.627331 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-69b20616-2db7-4d7f-ab63-0d82065d38f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:23.647889 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b20616-2db7-4d7f-ab63-0d82065d38f3 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:23.653894 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565904c-4a2c-41ea-8912-2dd8b5bf8869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:23.655332 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565904c-4a2c-41ea-8912-2dd8b5bf8869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:23.655867 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565904c-4a2c-41ea-8912-2dd8b5bf8869 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:23.664299 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565904c-4a2c-41ea-8912-2dd8b5bf8869 admin admin] PATH_INFO: `/v3/projects/619c0bc38fd241aa85fac2b8384f796d` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:23.665991 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565904c-4a2c-41ea-8912-2dd8b5bf8869 admin admin] RBAC: Authorizing `identity:delete_project(project_id=619c0bc38fd241aa85fac2b8384f796d)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:23.668946 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565904c-4a2c-41ea-8912-2dd8b5bf8869 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:23.722804 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-2565904c-4a2c-41ea-8912-2dd8b5bf8869 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '619c0bc38fd241aa85fac2b8384f796d', 'request_id': 'req-2565904c-4a2c-41ea-8912-2dd8b5bf8869'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:23.736226 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-2565904c-4a2c-41ea-8912-2dd8b5bf8869 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '619c0bc38fd241aa85fac2b8384f796d', 'request_id': 'req-2565904c-4a2c-41ea-8912-2dd8b5bf8869'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:23.743284 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-2565904c-4a2c-41ea-8912-2dd8b5bf8869 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '619c0bc38fd241aa85fac2b8384f796d', 'request_id': 'req-2565904c-4a2c-41ea-8912-2dd8b5bf8869'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:23.766877 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-2565904c-4a2c-41ea-8912-2dd8b5bf8869 admin admin] The token cache is being invalidate because project 619c0bc38fd241aa85fac2b8384f796d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:10:23.767167 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-2565904c-4a2c-41ea-8912-2dd8b5bf8869 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:23.767868 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-2565904c-4a2c-41ea-8912-2dd8b5bf8869 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:23.769428 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1112/2251] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:10:23 2022] DELETE /identity/v3/projects/619c0bc38fd241aa85fac2b8384f796d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:10:23.774104 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9c2c1-daa9-48d9-a902-7b5c0aac6513 service neutron] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:23.785231 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9c2c1-daa9-48d9-a902-7b5c0aac6513 service neutron] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:23.847876 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038db59-221d-4298-8acf-d439e09bdf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:23.848655 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038db59-221d-4298-8acf-d439e09bdf99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:23.848920 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038db59-221d-4298-8acf-d439e09bdf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:23.849181 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038db59-221d-4298-8acf-d439e09bdf99 admin admin] PATH_INFO: `/v3/users/66505a18c8174310b42d74c6951d8530` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:23.850357 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038db59-221d-4298-8acf-d439e09bdf99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66505a18c8174310b42d74c6951d8530)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:23.852412 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038db59-221d-4298-8acf-d439e09bdf99 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:23.907510 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-1038db59-221d-4298-8acf-d439e09bdf99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66505a18c8174310b42d74c6951d8530'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:23.916182 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-1038db59-221d-4298-8acf-d439e09bdf99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66505a18c8174310b42d74c6951d8530'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:23.917547 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-1038db59-221d-4298-8acf-d439e09bdf99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66505a18c8174310b42d74c6951d8530'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:23.918627 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-1038db59-221d-4298-8acf-d439e09bdf99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66505a18c8174310b42d74c6951d8530'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:23.932393 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-1038db59-221d-4298-8acf-d439e09bdf99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66505a18c8174310b42d74c6951d8530'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:23.946911 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1140/2252] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:10:23 2022] DELETE /identity/v3/users/66505a18c8174310b42d74c6951d8530 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:10:24.259778 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565904c-4a2c-41ea-8912-2dd8b5bf8869 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:24.261648 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-2565904c-4a2c-41ea-8912-2dd8b5bf8869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:24.283170 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565904c-4a2c-41ea-8912-2dd8b5bf8869 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:24.391416 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abc87d-5884-411a-928b-348e897b92cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:24.393037 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abc87d-5884-411a-928b-348e897b92cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:24.393512 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abc87d-5884-411a-928b-348e897b92cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:24.393772 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abc87d-5884-411a-928b-348e897b92cc admin admin] PATH_INFO: `/v3/projects/587d0a6f04134c58b77282574fbf0272` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:24.395261 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abc87d-5884-411a-928b-348e897b92cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=587d0a6f04134c58b77282574fbf0272)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:24.397882 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abc87d-5884-411a-928b-348e897b92cc admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:24.491296 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-11abc87d-5884-411a-928b-348e897b92cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '587d0a6f04134c58b77282574fbf0272', 'request_id': 'req-11abc87d-5884-411a-928b-348e897b92cc'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:24.503835 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-11abc87d-5884-411a-928b-348e897b92cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '587d0a6f04134c58b77282574fbf0272', 'request_id': 'req-11abc87d-5884-411a-928b-348e897b92cc'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:24.518929 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-11abc87d-5884-411a-928b-348e897b92cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '587d0a6f04134c58b77282574fbf0272', 'request_id': 'req-11abc87d-5884-411a-928b-348e897b92cc'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:24.573930 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-11abc87d-5884-411a-928b-348e897b92cc admin admin] The token cache is being invalidate because project 587d0a6f04134c58b77282574fbf0272 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:10:24.574221 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-11abc87d-5884-411a-928b-348e897b92cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:24.575892 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-11abc87d-5884-411a-928b-348e897b92cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:24.578041 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1113/2253] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:10:24 2022] DELETE /identity/v3/projects/587d0a6f04134c58b77282574fbf0272 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:10:24.582821 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806f48c-aabe-445c-be98-c4306b0d7eb0 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:24.583655 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806f48c-aabe-445c-be98-c4306b0d7eb0 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:24.583977 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806f48c-aabe-445c-be98-c4306b0d7eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:24.604549 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-e806f48c-aabe-445c-be98-c4306b0d7eb0 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:10:24.606556 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-e806f48c-aabe-445c-be98-c4306b0d7eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:24.670958 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1141/2254] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:10:24.678607 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3068d3-a91e-4e82-95c8-af8c9059b10b None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:24.679123 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3068d3-a91e-4e82-95c8-af8c9059b10b None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:24.679220 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3068d3-a91e-4e82-95c8-af8c9059b10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:24.698205 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-5d3068d3-a91e-4e82-95c8-af8c9059b10b None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:10:24.699690 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-5d3068d3-a91e-4e82-95c8-af8c9059b10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:24.709112 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1114/2255] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:10:24.713625 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806f48c-aabe-445c-be98-c4306b0d7eb0 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:24.724116 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806f48c-aabe-445c-be98-c4306b0d7eb0 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:24.729295 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be46a932-e3d4-44c5-a32a-476b0bab5816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:24.729960 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46a932-e3d4-44c5-a32a-476b0bab5816 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:24.730235 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46a932-e3d4-44c5-a32a-476b0bab5816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:24.730506 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46a932-e3d4-44c5-a32a-476b0bab5816 admin admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:24.731233 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be46a932-e3d4-44c5-a32a-476b0bab5816 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:10:24.731665 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be46a932-e3d4-44c5-a32a-476b0bab5816 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:24.733311 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be46a932-e3d4-44c5-a32a-476b0bab5816 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:24.746902 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1142/2256] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 03:10:24.750937 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3068d3-a91e-4e82-95c8-af8c9059b10b None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:24.762379 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3068d3-a91e-4e82-95c8-af8c9059b10b None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:24.768835 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126d63a-19c9-4ca4-84bc-5bda316c7823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:24.769734 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126d63a-19c9-4ca4-84bc-5bda316c7823 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:24.770300 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126d63a-19c9-4ca4-84bc-5bda316c7823 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:24.770300 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126d63a-19c9-4ca4-84bc-5bda316c7823 admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:24.770962 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3126d63a-19c9-4ca4-84bc-5bda316c7823 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:24.773227 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3126d63a-19c9-4ca4-84bc-5bda316c7823 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:24.805121 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1115/2257] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:10:24 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:10:24.809591 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be46a932-e3d4-44c5-a32a-476b0bab5816 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:24.819888 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be46a932-e3d4-44c5-a32a-476b0bab5816 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:24.879190 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a89ebe-6e3f-48ff-be87-186a27f7a88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:24.879891 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a89ebe-6e3f-48ff-be87-186a27f7a88a admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:24.880167 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a89ebe-6e3f-48ff-be87-186a27f7a88a admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:24.880439 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a89ebe-6e3f-48ff-be87-186a27f7a88a admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:24.881845 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a89ebe-6e3f-48ff-be87-186a27f7a88a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:24.883153 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a89ebe-6e3f-48ff-be87-186a27f7a88a admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:24.907770 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1143/2258] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:10:24 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 03:10:24.910754 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126d63a-19c9-4ca4-84bc-5bda316c7823 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:24.921995 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126d63a-19c9-4ca4-84bc-5bda316c7823 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:24.926831 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28f0d8-1312-4003-a534-7963b7fe5fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:24.927626 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28f0d8-1312-4003-a534-7963b7fe5fee admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:24.928142 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28f0d8-1312-4003-a534-7963b7fe5fee admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:24.928479 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28f0d8-1312-4003-a534-7963b7fe5fee admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:24.929286 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28f0d8-1312-4003-a534-7963b7fe5fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:24.931045 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28f0d8-1312-4003-a534-7963b7fe5fee admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:24.942606 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1116/2259] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:10:24.946878 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a89ebe-6e3f-48ff-be87-186a27f7a88a admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:24.957958 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a89ebe-6e3f-48ff-be87-186a27f7a88a admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:24.963004 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c785008-92fd-4f12-9a28-d6e25d423585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:24.963832 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c785008-92fd-4f12-9a28-d6e25d423585 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:24.964178 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c785008-92fd-4f12-9a28-d6e25d423585 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:24.964515 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c785008-92fd-4f12-9a28-d6e25d423585 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:24.965316 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c785008-92fd-4f12-9a28-d6e25d423585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:24.966997 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c785008-92fd-4f12-9a28-d6e25d423585 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:24.977956 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1144/2260] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:10:24.982477 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28f0d8-1312-4003-a534-7963b7fe5fee admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:24.993683 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28f0d8-1312-4003-a534-7963b7fe5fee admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:24.998868 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1abb3-23fd-4146-abfd-247527846361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:24.999938 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1abb3-23fd-4146-abfd-247527846361 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:25.000459 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1abb3-23fd-4146-abfd-247527846361 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:25.000733 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1abb3-23fd-4146-abfd-247527846361 admin admin] PATH_INFO: `/v3/projects/2a20c78e49a74b57a174e0e0672210e1/users/0a686b8fac8042b1a47fda8c0d280de3/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:25.017498 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1abb3-23fd-4146-abfd-247527846361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a20c78e49a74b57a174e0e0672210e1, user_id=0a686b8fac8042b1a47fda8c0d280de3, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:25.020323 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1abb3-23fd-4146-abfd-247527846361 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:25.038513 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1117/2261] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:10:24 2022] PUT /identity/v3/projects/2a20c78e49a74b57a174e0e0672210e1/users/0a686b8fac8042b1a47fda8c0d280de3/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:10:25.050069 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128c5ab-4e86-43b1-833f-b587f488c5e4 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:25.050466 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128c5ab-4e86-43b1-833f-b587f488c5e4 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:25.050833 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128c5ab-4e86-43b1-833f-b587f488c5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:25.079829 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-5128c5ab-4e86-43b1-833f-b587f488c5e4 None None] MFA Rules not processed for user `0a686b8fac8042b1a47fda8c0d280de3`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:10:25.081031 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-5128c5ab-4e86-43b1-833f-b587f488c5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:25.148537 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1145/2262] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:10:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:10:25.153265 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1abb3-23fd-4146-abfd-247527846361 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:25.238588 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1abb3-23fd-4146-abfd-247527846361 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:25.244568 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e123a3-75d4-4793-8249-a6280b48df73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:25.245516 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e123a3-75d4-4793-8249-a6280b48df73 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:25.245793 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e123a3-75d4-4793-8249-a6280b48df73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:25.246059 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e123a3-75d4-4793-8249-a6280b48df73 admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:25.246747 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e123a3-75d4-4793-8249-a6280b48df73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:25.248782 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e123a3-75d4-4793-8249-a6280b48df73 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:25.282780 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1118/2263] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:10:25 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:10:25.283588 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128c5ab-4e86-43b1-833f-b587f488c5e4 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:25.295117 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128c5ab-4e86-43b1-833f-b587f488c5e4 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:25.355848 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d798d-9831-4cd9-9d31-c1ea43641cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:25.356785 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d798d-9831-4cd9-9d31-c1ea43641cca admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:25.357205 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d798d-9831-4cd9-9d31-c1ea43641cca admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:25.357637 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d798d-9831-4cd9-9d31-c1ea43641cca admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:25.358533 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d798d-9831-4cd9-9d31-c1ea43641cca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:25.360817 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d798d-9831-4cd9-9d31-c1ea43641cca admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:25.385004 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1146/2264] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:10:25 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 03:10:25.388054 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e123a3-75d4-4793-8249-a6280b48df73 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:25.401321 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e123a3-75d4-4793-8249-a6280b48df73 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:25.405967 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955bdcf-7f4a-46f8-9f4f-358bbb87654b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:25.406859 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955bdcf-7f4a-46f8-9f4f-358bbb87654b admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:25.406977 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955bdcf-7f4a-46f8-9f4f-358bbb87654b admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:25.407221 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955bdcf-7f4a-46f8-9f4f-358bbb87654b admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:25.407946 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955bdcf-7f4a-46f8-9f4f-358bbb87654b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:25.409716 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955bdcf-7f4a-46f8-9f4f-358bbb87654b admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:25.425146 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1119/2265] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:10:25.429370 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d798d-9831-4cd9-9d31-c1ea43641cca admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:25.440707 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d798d-9831-4cd9-9d31-c1ea43641cca admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:25.446130 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718f258-6664-48e8-a766-c75442d7c9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:25.447096 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718f258-6664-48e8-a766-c75442d7c9e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:25.447356 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718f258-6664-48e8-a766-c75442d7c9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:25.447618 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718f258-6664-48e8-a766-c75442d7c9e0 admin admin] PATH_INFO: `/v3/projects/be081b6cf70d4c9b840c3839731ac8af/users/fff06c055c55408fa156c93b3eebc15f/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:25.465781 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718f258-6664-48e8-a766-c75442d7c9e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be081b6cf70d4c9b840c3839731ac8af, user_id=fff06c055c55408fa156c93b3eebc15f, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:25.470208 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718f258-6664-48e8-a766-c75442d7c9e0 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:25.486587 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1147/2266] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:10:25 2022] PUT /identity/v3/projects/be081b6cf70d4c9b840c3839731ac8af/users/fff06c055c55408fa156c93b3eebc15f/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:10:25.491193 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955bdcf-7f4a-46f8-9f4f-358bbb87654b admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:25.502566 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955bdcf-7f4a-46f8-9f4f-358bbb87654b admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:25.568252 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d37c4-d431-494e-a6f2-1c8e2f1d0893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:25.568922 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d37c4-d431-494e-a6f2-1c8e2f1d0893 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:25.569199 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d37c4-d431-494e-a6f2-1c8e2f1d0893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:25.569468 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d37c4-d431-494e-a6f2-1c8e2f1d0893 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:25.570191 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d37c4-d431-494e-a6f2-1c8e2f1d0893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:25.571919 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d37c4-d431-494e-a6f2-1c8e2f1d0893 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:25.589753 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1120/2267] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:10:25.593711 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718f258-6664-48e8-a766-c75442d7c9e0 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:25.605378 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718f258-6664-48e8-a766-c75442d7c9e0 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:25.619586 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec22f8c-471c-49cf-8dda-b9ebe2275880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:25.620773 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec22f8c-471c-49cf-8dda-b9ebe2275880 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:25.621105 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec22f8c-471c-49cf-8dda-b9ebe2275880 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:25.621376 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec22f8c-471c-49cf-8dda-b9ebe2275880 admin admin] PATH_INFO: `/v3/projects/be081b6cf70d4c9b840c3839731ac8af/users/fff06c055c55408fa156c93b3eebc15f/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:25.626285 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec22f8c-471c-49cf-8dda-b9ebe2275880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be081b6cf70d4c9b840c3839731ac8af, user_id=fff06c055c55408fa156c93b3eebc15f, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:25.629089 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec22f8c-471c-49cf-8dda-b9ebe2275880 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:25.640933 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1148/2268] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:10:25 2022] PUT /identity/v3/projects/be081b6cf70d4c9b840c3839731ac8af/users/fff06c055c55408fa156c93b3eebc15f/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:10:25.650777 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60b9e1-c10c-4deb-9cb6-3cb50885d821 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:25.651142 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60b9e1-c10c-4deb-9cb6-3cb50885d821 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:25.651486 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60b9e1-c10c-4deb-9cb6-3cb50885d821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:25.688509 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-9d60b9e1-c10c-4deb-9cb6-3cb50885d821 None None] MFA Rules not processed for user `fff06c055c55408fa156c93b3eebc15f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:10:25.689835 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-9d60b9e1-c10c-4deb-9cb6-3cb50885d821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:25.768056 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1121/2269] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:10:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:10:25.784349 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec22f8c-471c-49cf-8dda-b9ebe2275880 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:25.786081 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-0ec22f8c-471c-49cf-8dda-b9ebe2275880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:25.851974 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec22f8c-471c-49cf-8dda-b9ebe2275880 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:25.856133 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda2a36-6485-4b31-a533-d3b70bf0e0f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:25.856779 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda2a36-6485-4b31-a533-d3b70bf0e0f4 service cinder] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:25.857054 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda2a36-6485-4b31-a533-d3b70bf0e0f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:25.857317 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda2a36-6485-4b31-a533-d3b70bf0e0f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:25.868269 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda2a36-6485-4b31-a533-d3b70bf0e0f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:25.870251 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda2a36-6485-4b31-a533-d3b70bf0e0f4 service cinder] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:25.882402 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1149/2270] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:10:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:10:26.525013 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60b9e1-c10c-4deb-9cb6-3cb50885d821 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:26.609010 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60b9e1-c10c-4deb-9cb6-3cb50885d821 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:26.615603 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8ebe1-aa14-454e-b0ba-e44e0f0d8bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:26.616527 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8ebe1-aa14-454e-b0ba-e44e0f0d8bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:26.616805 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8ebe1-aa14-454e-b0ba-e44e0f0d8bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:26.617076 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8ebe1-aa14-454e-b0ba-e44e0f0d8bcd admin admin] PATH_INFO: `/v3/users/0a686b8fac8042b1a47fda8c0d280de3` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:26.618620 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e8ebe1-aa14-454e-b0ba-e44e0f0d8bcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a686b8fac8042b1a47fda8c0d280de3)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:26.621351 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e8ebe1-aa14-454e-b0ba-e44e0f0d8bcd admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:26.678203 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-27e8ebe1-aa14-454e-b0ba-e44e0f0d8bcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a686b8fac8042b1a47fda8c0d280de3'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:26.678851 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-27e8ebe1-aa14-454e-b0ba-e44e0f0d8bcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a686b8fac8042b1a47fda8c0d280de3'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:26.695833 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-27e8ebe1-aa14-454e-b0ba-e44e0f0d8bcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a686b8fac8042b1a47fda8c0d280de3'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:26.697706 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-27e8ebe1-aa14-454e-b0ba-e44e0f0d8bcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a686b8fac8042b1a47fda8c0d280de3'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:26.709027 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-27e8ebe1-aa14-454e-b0ba-e44e0f0d8bcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a686b8fac8042b1a47fda8c0d280de3'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:26.731036 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1122/2271] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:10:26 2022] DELETE /identity/v3/users/0a686b8fac8042b1a47fda8c0d280de3 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:10:26.735664 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bcdf2-8133-4e5d-b7b1-fe3e6fb7e982 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:26.736171 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bcdf2-8133-4e5d-b7b1-fe3e6fb7e982 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:26.736265 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bcdf2-8133-4e5d-b7b1-fe3e6fb7e982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:26.754857 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-0b3bcdf2-8133-4e5d-b7b1-fe3e6fb7e982 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:10:26.756636 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-0b3bcdf2-8133-4e5d-b7b1-fe3e6fb7e982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:26.844762 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1150/2272] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:10:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:10:26.850460 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8ebe1-aa14-454e-b0ba-e44e0f0d8bcd admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:26.852103 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-27e8ebe1-aa14-454e-b0ba-e44e0f0d8bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:26.919997 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8ebe1-aa14-454e-b0ba-e44e0f0d8bcd admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:26.926432 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed65f1e-f911-4dd1-8137-5b3e159a022f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:26.927590 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed65f1e-f911-4dd1-8137-5b3e159a022f service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:26.927590 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed65f1e-f911-4dd1-8137-5b3e159a022f service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:26.927590 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed65f1e-f911-4dd1-8137-5b3e159a022f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:26.946013 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed65f1e-f911-4dd1-8137-5b3e159a022f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:26.948132 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed65f1e-f911-4dd1-8137-5b3e159a022f service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:26.959288 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1123/2273] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:10:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:10:27.284285 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3bcdf2-8133-4e5d-b7b1-fe3e6fb7e982 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:27.286324 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-0b3bcdf2-8133-4e5d-b7b1-fe3e6fb7e982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:27.303837 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3bcdf2-8133-4e5d-b7b1-fe3e6fb7e982 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:27.308712 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debed65e-8d11-43fc-a29c-47ec0b7c8bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:27.309596 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debed65e-8d11-43fc-a29c-47ec0b7c8bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:27.311642 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debed65e-8d11-43fc-a29c-47ec0b7c8bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:27.312381 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debed65e-8d11-43fc-a29c-47ec0b7c8bf1 admin admin] PATH_INFO: `/v3/projects/2a20c78e49a74b57a174e0e0672210e1` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:27.313936 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debed65e-8d11-43fc-a29c-47ec0b7c8bf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a20c78e49a74b57a174e0e0672210e1)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:27.315815 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debed65e-8d11-43fc-a29c-47ec0b7c8bf1 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:27.377792 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-debed65e-8d11-43fc-a29c-47ec0b7c8bf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a20c78e49a74b57a174e0e0672210e1', 'request_id': 'req-debed65e-8d11-43fc-a29c-47ec0b7c8bf1'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:27.387181 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-debed65e-8d11-43fc-a29c-47ec0b7c8bf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a20c78e49a74b57a174e0e0672210e1', 'request_id': 'req-debed65e-8d11-43fc-a29c-47ec0b7c8bf1'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:27.398416 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-debed65e-8d11-43fc-a29c-47ec0b7c8bf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a20c78e49a74b57a174e0e0672210e1', 'request_id': 'req-debed65e-8d11-43fc-a29c-47ec0b7c8bf1'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:27.409683 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-debed65e-8d11-43fc-a29c-47ec0b7c8bf1 admin admin] The token cache is being invalidate because project 2a20c78e49a74b57a174e0e0672210e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:10:27.409965 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-debed65e-8d11-43fc-a29c-47ec0b7c8bf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:27.410606 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-debed65e-8d11-43fc-a29c-47ec0b7c8bf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:27.412230 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1151/2274] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:10:27 2022] DELETE /identity/v3/projects/2a20c78e49a74b57a174e0e0672210e1 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:10:27.416304 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed65f1e-f911-4dd1-8137-5b3e159a022f service neutron] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:27.426056 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed65f1e-f911-4dd1-8137-5b3e159a022f service neutron] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:27.488639 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3242a7-de4f-42f5-bd80-6153176d622b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:27.489717 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3242a7-de4f-42f5-bd80-6153176d622b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:27.489994 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3242a7-de4f-42f5-bd80-6153176d622b admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:27.490259 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3242a7-de4f-42f5-bd80-6153176d622b admin admin] PATH_INFO: `/v3/users/fff06c055c55408fa156c93b3eebc15f` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:27.491435 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3242a7-de4f-42f5-bd80-6153176d622b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fff06c055c55408fa156c93b3eebc15f)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:27.493633 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3242a7-de4f-42f5-bd80-6153176d622b admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:27.545662 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3e3242a7-de4f-42f5-bd80-6153176d622b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fff06c055c55408fa156c93b3eebc15f'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:27.546337 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3e3242a7-de4f-42f5-bd80-6153176d622b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fff06c055c55408fa156c93b3eebc15f'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:27.559747 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3e3242a7-de4f-42f5-bd80-6153176d622b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fff06c055c55408fa156c93b3eebc15f'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:27.560492 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3e3242a7-de4f-42f5-bd80-6153176d622b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fff06c055c55408fa156c93b3eebc15f'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:27.567358 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3e3242a7-de4f-42f5-bd80-6153176d622b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fff06c055c55408fa156c93b3eebc15f'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:27.583954 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1124/2275] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:10:27 2022] DELETE /identity/v3/users/fff06c055c55408fa156c93b3eebc15f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:10:27.924449 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debed65e-8d11-43fc-a29c-47ec0b7c8bf1 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:27.925922 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-debed65e-8d11-43fc-a29c-47ec0b7c8bf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:27.939080 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debed65e-8d11-43fc-a29c-47ec0b7c8bf1 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:28.009168 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2d84c-aa34-4bbe-b05a-b00482ec07bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:28.010200 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2d84c-aa34-4bbe-b05a-b00482ec07bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:28.010566 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2d84c-aa34-4bbe-b05a-b00482ec07bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:28.010916 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2d84c-aa34-4bbe-b05a-b00482ec07bf admin admin] PATH_INFO: `/v3/projects/be081b6cf70d4c9b840c3839731ac8af` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:28.012465 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2d84c-aa34-4bbe-b05a-b00482ec07bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=be081b6cf70d4c9b840c3839731ac8af)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:28.014341 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2d84c-aa34-4bbe-b05a-b00482ec07bf admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:28.092959 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-b2a2d84c-aa34-4bbe-b05a-b00482ec07bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be081b6cf70d4c9b840c3839731ac8af', 'request_id': 'req-b2a2d84c-aa34-4bbe-b05a-b00482ec07bf'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:28.112000 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-b2a2d84c-aa34-4bbe-b05a-b00482ec07bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be081b6cf70d4c9b840c3839731ac8af', 'request_id': 'req-b2a2d84c-aa34-4bbe-b05a-b00482ec07bf'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:28.118975 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-b2a2d84c-aa34-4bbe-b05a-b00482ec07bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be081b6cf70d4c9b840c3839731ac8af', 'request_id': 'req-b2a2d84c-aa34-4bbe-b05a-b00482ec07bf'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:28.130018 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-b2a2d84c-aa34-4bbe-b05a-b00482ec07bf admin admin] The token cache is being invalidate because project be081b6cf70d4c9b840c3839731ac8af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:10:28.130309 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-b2a2d84c-aa34-4bbe-b05a-b00482ec07bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:28.131095 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-b2a2d84c-aa34-4bbe-b05a-b00482ec07bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:28.132679 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1152/2276] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:10:27 2022] DELETE /identity/v3/projects/be081b6cf70d4c9b840c3839731ac8af => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:10:28.137618 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51709fcd-dc17-4290-a1b6-b4b04d36affb None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:28.138137 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51709fcd-dc17-4290-a1b6-b4b04d36affb None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:28.138281 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51709fcd-dc17-4290-a1b6-b4b04d36affb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:28.157863 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-51709fcd-dc17-4290-a1b6-b4b04d36affb None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:10:28.159369 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-51709fcd-dc17-4290-a1b6-b4b04d36affb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:28.238718 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1125/2277] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:10:28.247462 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2577c-0e4c-451e-9113-e9db1de9377f None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:28.247862 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2577c-0e4c-451e-9113-e9db1de9377f None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:28.248229 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2577c-0e4c-451e-9113-e9db1de9377f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:28.269040 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-e2c2577c-0e4c-451e-9113-e9db1de9377f None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:10:28.270532 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-e2c2577c-0e4c-451e-9113-e9db1de9377f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:28.281079 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1153/2278] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:10:28.285523 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51709fcd-dc17-4290-a1b6-b4b04d36affb None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:28.297793 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51709fcd-dc17-4290-a1b6-b4b04d36affb None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:28.302438 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0cc523-2fdc-4dbe-9339-95fd408155c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:28.303312 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cc523-2fdc-4dbe-9339-95fd408155c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:28.303652 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cc523-2fdc-4dbe-9339-95fd408155c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:28.304109 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cc523-2fdc-4dbe-9339-95fd408155c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:28.304884 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0cc523-2fdc-4dbe-9339-95fd408155c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:10:28.306567 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0cc523-2fdc-4dbe-9339-95fd408155c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:28.307280 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0cc523-2fdc-4dbe-9339-95fd408155c3 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:28.321128 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1126/2279] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:10:28.325569 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2577c-0e4c-451e-9113-e9db1de9377f None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:28.336816 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2577c-0e4c-451e-9113-e9db1de9377f None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:28.343948 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd6891-4c38-466a-8090-afafcae64a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:28.344989 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd6891-4c38-466a-8090-afafcae64a55 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:28.345246 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd6891-4c38-466a-8090-afafcae64a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:28.345511 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd6891-4c38-466a-8090-afafcae64a55 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:28.346204 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd6891-4c38-466a-8090-afafcae64a55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:28.348213 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd6891-4c38-466a-8090-afafcae64a55 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:28.385486 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1154/2280] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:10:28 2022] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 03:10:28.390960 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0cc523-2fdc-4dbe-9339-95fd408155c3 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:28.401875 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0cc523-2fdc-4dbe-9339-95fd408155c3 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:28.470487 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81b0bd-5838-417a-a5ef-56994db90268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:28.471156 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81b0bd-5838-417a-a5ef-56994db90268 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:28.471428 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81b0bd-5838-417a-a5ef-56994db90268 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:28.471697 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81b0bd-5838-417a-a5ef-56994db90268 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:28.472408 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81b0bd-5838-417a-a5ef-56994db90268 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:28.474473 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81b0bd-5838-417a-a5ef-56994db90268 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:28.501387 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1127/2281] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:10:28 2022] POST /identity/v3/users => generated 291 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:10:28.505253 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd6891-4c38-466a-8090-afafcae64a55 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:28.516201 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd6891-4c38-466a-8090-afafcae64a55 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:28.528674 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a43dc16-5285-44db-a15e-7367756f4d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:28.529356 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43dc16-5285-44db-a15e-7367756f4d54 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:28.529626 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43dc16-5285-44db-a15e-7367756f4d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:28.529887 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43dc16-5285-44db-a15e-7367756f4d54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:28.530617 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a43dc16-5285-44db-a15e-7367756f4d54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:28.532235 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a43dc16-5285-44db-a15e-7367756f4d54 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:28.546077 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1155/2282] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:10:28.547756 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81b0bd-5838-417a-a5ef-56994db90268 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:28.559327 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81b0bd-5838-417a-a5ef-56994db90268 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:28.567629 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee44ab-42e8-486e-af65-cc991b372156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:28.568922 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee44ab-42e8-486e-af65-cc991b372156 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:28.569212 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee44ab-42e8-486e-af65-cc991b372156 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:28.569814 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee44ab-42e8-486e-af65-cc991b372156 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:28.570464 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee44ab-42e8-486e-af65-cc991b372156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:28.572701 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee44ab-42e8-486e-af65-cc991b372156 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:28.584730 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1128/2283] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:10:28.589490 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a43dc16-5285-44db-a15e-7367756f4d54 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:28.606587 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a43dc16-5285-44db-a15e-7367756f4d54 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:28.613817 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baace94-bb9f-4dc7-b28c-3c341841cbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:28.614715 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baace94-bb9f-4dc7-b28c-3c341841cbfe admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:28.614990 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baace94-bb9f-4dc7-b28c-3c341841cbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:28.615259 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baace94-bb9f-4dc7-b28c-3c341841cbfe admin admin] PATH_INFO: `/v3/projects/4b7dcdcb931d49f59aa237f55a0a545a/users/2696a28eedf4455ab029b30ec20baca2/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:28.638030 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baace94-bb9f-4dc7-b28c-3c341841cbfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b7dcdcb931d49f59aa237f55a0a545a, user_id=2696a28eedf4455ab029b30ec20baca2, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:28.640796 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baace94-bb9f-4dc7-b28c-3c341841cbfe admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:28.663014 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1156/2284] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:10:28 2022] PUT /identity/v3/projects/4b7dcdcb931d49f59aa237f55a0a545a/users/2696a28eedf4455ab029b30ec20baca2/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:10:28.674499 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de677b48-7a55-41e2-9a18-79f9ea2022c8 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:28.674826 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de677b48-7a55-41e2-9a18-79f9ea2022c8 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:28.675043 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de677b48-7a55-41e2-9a18-79f9ea2022c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:28.706675 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-de677b48-7a55-41e2-9a18-79f9ea2022c8 None None] MFA Rules not processed for user `2696a28eedf4455ab029b30ec20baca2`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:10:28.707976 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-de677b48-7a55-41e2-9a18-79f9ea2022c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:28.780810 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1129/2285] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:10:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:10:28.782073 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baace94-bb9f-4dc7-b28c-3c341841cbfe admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:28.848670 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baace94-bb9f-4dc7-b28c-3c341841cbfe admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:28.854230 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa7c9d-9c8b-429c-af6d-7c38df53c9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:28.854960 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa7c9d-9c8b-429c-af6d-7c38df53c9d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:28.855299 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa7c9d-9c8b-429c-af6d-7c38df53c9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:28.855629 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa7c9d-9c8b-429c-af6d-7c38df53c9d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:28.856453 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa7c9d-9c8b-429c-af6d-7c38df53c9d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:28.858417 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa7c9d-9c8b-429c-af6d-7c38df53c9d5 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:28.890772 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1157/2286] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:10:28 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 03:10:28.894581 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de677b48-7a55-41e2-9a18-79f9ea2022c8 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:28.906462 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de677b48-7a55-41e2-9a18-79f9ea2022c8 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:28.967376 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7044479f-4f0e-4bd8-8c17-a589d93d655e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:28.968091 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044479f-4f0e-4bd8-8c17-a589d93d655e admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:28.968393 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044479f-4f0e-4bd8-8c17-a589d93d655e admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:28.968627 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044479f-4f0e-4bd8-8c17-a589d93d655e admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:28.969308 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7044479f-4f0e-4bd8-8c17-a589d93d655e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:28.971244 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7044479f-4f0e-4bd8-8c17-a589d93d655e admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:28.993892 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1130/2287] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:10:28 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:10:28.997922 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa7c9d-9c8b-429c-af6d-7c38df53c9d5 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:29.010368 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa7c9d-9c8b-429c-af6d-7c38df53c9d5 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:29.015959 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146c0da-08b8-488c-9827-dd6c44499775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:29.016681 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146c0da-08b8-488c-9827-dd6c44499775 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:29.017022 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146c0da-08b8-488c-9827-dd6c44499775 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:29.017487 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146c0da-08b8-488c-9827-dd6c44499775 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:29.018256 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146c0da-08b8-488c-9827-dd6c44499775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:29.020045 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146c0da-08b8-488c-9827-dd6c44499775 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:29.035913 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1158/2288] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:10:29.037147 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7044479f-4f0e-4bd8-8c17-a589d93d655e admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:29.048338 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7044479f-4f0e-4bd8-8c17-a589d93d655e admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:29.052946 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c51da-a5c0-4329-8c3e-b93a2a4216c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:29.053827 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c51da-a5c0-4329-8c3e-b93a2a4216c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:29.054223 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c51da-a5c0-4329-8c3e-b93a2a4216c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:29.054496 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c51da-a5c0-4329-8c3e-b93a2a4216c2 admin admin] PATH_INFO: `/v3/projects/90610e835d63481db05085e68cac124e/users/fdff15a2c1d94f49b0286bcbb1b6cb10/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:29.070773 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c51da-a5c0-4329-8c3e-b93a2a4216c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90610e835d63481db05085e68cac124e, user_id=fdff15a2c1d94f49b0286bcbb1b6cb10, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:29.073507 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c51da-a5c0-4329-8c3e-b93a2a4216c2 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:29.089164 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1131/2289] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:10:29 2022] PUT /identity/v3/projects/90610e835d63481db05085e68cac124e/users/fdff15a2c1d94f49b0286bcbb1b6cb10/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:10:29.093225 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146c0da-08b8-488c-9827-dd6c44499775 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:29.109325 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146c0da-08b8-488c-9827-dd6c44499775 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:29.172180 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e851a-0148-4359-ad44-afe4081c635d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:29.172847 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e851a-0148-4359-ad44-afe4081c635d admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:29.173117 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e851a-0148-4359-ad44-afe4081c635d admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:29.173506 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e851a-0148-4359-ad44-afe4081c635d admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:29.174368 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e851a-0148-4359-ad44-afe4081c635d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:29.176093 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e851a-0148-4359-ad44-afe4081c635d admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:29.191422 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1159/2290] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:10:29.195430 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c51da-a5c0-4329-8c3e-b93a2a4216c2 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:29.208338 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c51da-a5c0-4329-8c3e-b93a2a4216c2 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:29.213755 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d602d0-7651-41ed-8488-74f9faa116a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:29.214679 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d602d0-7651-41ed-8488-74f9faa116a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:29.214950 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d602d0-7651-41ed-8488-74f9faa116a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:29.215214 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d602d0-7651-41ed-8488-74f9faa116a0 admin admin] PATH_INFO: `/v3/projects/90610e835d63481db05085e68cac124e/users/fdff15a2c1d94f49b0286bcbb1b6cb10/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:29.217211 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d602d0-7651-41ed-8488-74f9faa116a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90610e835d63481db05085e68cac124e, user_id=fdff15a2c1d94f49b0286bcbb1b6cb10, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:29.220933 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d602d0-7651-41ed-8488-74f9faa116a0 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:29.231528 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1132/2291] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:10:29 2022] PUT /identity/v3/projects/90610e835d63481db05085e68cac124e/users/fdff15a2c1d94f49b0286bcbb1b6cb10/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:10:29.245423 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59e179-11fc-4e1d-8453-3b88b0fbf88b None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:29.245929 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59e179-11fc-4e1d-8453-3b88b0fbf88b None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:29.245929 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59e179-11fc-4e1d-8453-3b88b0fbf88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:29.273280 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-fe59e179-11fc-4e1d-8453-3b88b0fbf88b None None] MFA Rules not processed for user `fdff15a2c1d94f49b0286bcbb1b6cb10`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:10:29.274550 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-fe59e179-11fc-4e1d-8453-3b88b0fbf88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:29.360827 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1160/2292] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:10:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:10:29.370153 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d602d0-7651-41ed-8488-74f9faa116a0 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:29.372433 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-e6d602d0-7651-41ed-8488-74f9faa116a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:29.440951 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d602d0-7651-41ed-8488-74f9faa116a0 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:29.446195 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fad86-9f36-4f81-9196-9566d4bfc82e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:29.447054 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fad86-9f36-4f81-9196-9566d4bfc82e service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:29.447568 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fad86-9f36-4f81-9196-9566d4bfc82e service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:29.447875 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fad86-9f36-4f81-9196-9566d4bfc82e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:29.458382 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080fad86-9f36-4f81-9196-9566d4bfc82e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:29.460064 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080fad86-9f36-4f81-9196-9566d4bfc82e service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:29.471018 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1133/2293] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:10:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 03:10:29.570295 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59e179-11fc-4e1d-8453-3b88b0fbf88b None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:29.581979 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59e179-11fc-4e1d-8453-3b88b0fbf88b None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:29.585710 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333c299-d4ae-4dcc-a9ab-7b44b5e63a09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:29.586602 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333c299-d4ae-4dcc-a9ab-7b44b5e63a09 service cinder] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:29.587013 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333c299-d4ae-4dcc-a9ab-7b44b5e63a09 service cinder] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:29.587373 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333c299-d4ae-4dcc-a9ab-7b44b5e63a09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:29.651230 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333c299-d4ae-4dcc-a9ab-7b44b5e63a09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:29.654684 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333c299-d4ae-4dcc-a9ab-7b44b5e63a09 service cinder] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:29.667033 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1161/2294] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:10:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:10:29.963513 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fad86-9f36-4f81-9196-9566d4bfc82e service cinder] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:30.042742 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fad86-9f36-4f81-9196-9566d4bfc82e service cinder] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:30.049047 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3604d93-5129-4eef-9c02-90e645c1d77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:30.049882 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3604d93-5129-4eef-9c02-90e645c1d77b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:30.050156 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3604d93-5129-4eef-9c02-90e645c1d77b admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:30.050422 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3604d93-5129-4eef-9c02-90e645c1d77b admin admin] PATH_INFO: `/v3/users/2696a28eedf4455ab029b30ec20baca2` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:30.051638 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3604d93-5129-4eef-9c02-90e645c1d77b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2696a28eedf4455ab029b30ec20baca2)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:30.053659 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3604d93-5129-4eef-9c02-90e645c1d77b admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:30.106568 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-f3604d93-5129-4eef-9c02-90e645c1d77b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2696a28eedf4455ab029b30ec20baca2'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:30.107261 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-f3604d93-5129-4eef-9c02-90e645c1d77b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2696a28eedf4455ab029b30ec20baca2'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:30.119591 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-f3604d93-5129-4eef-9c02-90e645c1d77b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2696a28eedf4455ab029b30ec20baca2'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:30.120427 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-f3604d93-5129-4eef-9c02-90e645c1d77b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2696a28eedf4455ab029b30ec20baca2'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:30.127518 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-f3604d93-5129-4eef-9c02-90e645c1d77b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2696a28eedf4455ab029b30ec20baca2'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:30.141745 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1134/2295] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:10:29 2022] DELETE /identity/v3/users/2696a28eedf4455ab029b30ec20baca2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:10:30.146270 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236946d-9cff-48f6-be3c-c1276a2d5281 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:30.146749 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236946d-9cff-48f6-be3c-c1276a2d5281 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:30.146853 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236946d-9cff-48f6-be3c-c1276a2d5281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:30.165025 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-5236946d-9cff-48f6-be3c-c1276a2d5281 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:10:30.166450 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-5236946d-9cff-48f6-be3c-c1276a2d5281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:30.231744 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1162/2296] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:10:30.241504 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3604d93-5129-4eef-9c02-90e645c1d77b admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:30.243695 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-f3604d93-5129-4eef-9c02-90e645c1d77b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:30.308742 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3604d93-5129-4eef-9c02-90e645c1d77b admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:30.312904 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce2acb-0d17-4e12-87d7-d76f2036e718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:30.313915 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce2acb-0d17-4e12-87d7-d76f2036e718 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:30.314388 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce2acb-0d17-4e12-87d7-d76f2036e718 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:30.314741 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce2acb-0d17-4e12-87d7-d76f2036e718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:30.327181 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce2acb-0d17-4e12-87d7-d76f2036e718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:30.328755 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce2acb-0d17-4e12-87d7-d76f2036e718 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:30.339880 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1135/2297] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:10:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:10:30.727852 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236946d-9cff-48f6-be3c-c1276a2d5281 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:30.729376 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-5236946d-9cff-48f6-be3c-c1276a2d5281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:30.741293 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236946d-9cff-48f6-be3c-c1276a2d5281 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:30.746118 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18158e92-97bd-4bb2-a905-bc1ac7aea4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:30.747086 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18158e92-97bd-4bb2-a905-bc1ac7aea4ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:30.747452 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18158e92-97bd-4bb2-a905-bc1ac7aea4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:30.747866 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18158e92-97bd-4bb2-a905-bc1ac7aea4ad admin admin] PATH_INFO: `/v3/projects/4b7dcdcb931d49f59aa237f55a0a545a` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:30.749156 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18158e92-97bd-4bb2-a905-bc1ac7aea4ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b7dcdcb931d49f59aa237f55a0a545a)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:30.751147 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18158e92-97bd-4bb2-a905-bc1ac7aea4ad admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:30.811978 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-18158e92-97bd-4bb2-a905-bc1ac7aea4ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b7dcdcb931d49f59aa237f55a0a545a', 'request_id': 'req-18158e92-97bd-4bb2-a905-bc1ac7aea4ad'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:30.825823 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-18158e92-97bd-4bb2-a905-bc1ac7aea4ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b7dcdcb931d49f59aa237f55a0a545a', 'request_id': 'req-18158e92-97bd-4bb2-a905-bc1ac7aea4ad'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:30.834014 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-18158e92-97bd-4bb2-a905-bc1ac7aea4ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b7dcdcb931d49f59aa237f55a0a545a', 'request_id': 'req-18158e92-97bd-4bb2-a905-bc1ac7aea4ad'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:30.850831 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-18158e92-97bd-4bb2-a905-bc1ac7aea4ad admin admin] The token cache is being invalidate because project 4b7dcdcb931d49f59aa237f55a0a545a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:10:30.851123 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-18158e92-97bd-4bb2-a905-bc1ac7aea4ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:30.851791 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-18158e92-97bd-4bb2-a905-bc1ac7aea4ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:30.853588 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1163/2298] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:10:30 2022] DELETE /identity/v3/projects/4b7dcdcb931d49f59aa237f55a0a545a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:10:30.857880 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce2acb-0d17-4e12-87d7-d76f2036e718 service neutron] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:30.868221 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce2acb-0d17-4e12-87d7-d76f2036e718 service neutron] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:30.931931 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2acfe-789a-48ae-910a-77b20b8b86bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:30.933054 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2acfe-789a-48ae-910a-77b20b8b86bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:30.933414 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2acfe-789a-48ae-910a-77b20b8b86bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:30.933781 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2acfe-789a-48ae-910a-77b20b8b86bf admin admin] PATH_INFO: `/v3/users/fdff15a2c1d94f49b0286bcbb1b6cb10` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:30.935040 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2acfe-789a-48ae-910a-77b20b8b86bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdff15a2c1d94f49b0286bcbb1b6cb10)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:30.937110 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2acfe-789a-48ae-910a-77b20b8b86bf admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:30.992282 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-19a2acfe-789a-48ae-910a-77b20b8b86bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdff15a2c1d94f49b0286bcbb1b6cb10'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:30.992980 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-19a2acfe-789a-48ae-910a-77b20b8b86bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdff15a2c1d94f49b0286bcbb1b6cb10'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:31.004605 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-19a2acfe-789a-48ae-910a-77b20b8b86bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdff15a2c1d94f49b0286bcbb1b6cb10'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:31.005502 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-19a2acfe-789a-48ae-910a-77b20b8b86bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdff15a2c1d94f49b0286bcbb1b6cb10'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:31.012757 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-19a2acfe-789a-48ae-910a-77b20b8b86bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdff15a2c1d94f49b0286bcbb1b6cb10'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:31.032227 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1136/2299] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:10:30 2022] DELETE /identity/v3/users/fdff15a2c1d94f49b0286bcbb1b6cb10 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:10:31.327820 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18158e92-97bd-4bb2-a905-bc1ac7aea4ad admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:31.329319 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-18158e92-97bd-4bb2-a905-bc1ac7aea4ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:31.353365 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18158e92-97bd-4bb2-a905-bc1ac7aea4ad admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:31.416955 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f4625-213b-4af5-8a2c-6d5e90e6203c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:31.418022 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f4625-213b-4af5-8a2c-6d5e90e6203c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:31.418344 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f4625-213b-4af5-8a2c-6d5e90e6203c admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:31.418612 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f4625-213b-4af5-8a2c-6d5e90e6203c admin admin] PATH_INFO: `/v3/projects/90610e835d63481db05085e68cac124e` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:31.419784 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f4625-213b-4af5-8a2c-6d5e90e6203c admin admin] RBAC: Authorizing `identity:delete_project(project_id=90610e835d63481db05085e68cac124e)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:31.421724 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f4625-213b-4af5-8a2c-6d5e90e6203c admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:31.468926 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-4a3f4625-213b-4af5-8a2c-6d5e90e6203c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90610e835d63481db05085e68cac124e', 'request_id': 'req-4a3f4625-213b-4af5-8a2c-6d5e90e6203c'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:31.478142 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-4a3f4625-213b-4af5-8a2c-6d5e90e6203c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90610e835d63481db05085e68cac124e', 'request_id': 'req-4a3f4625-213b-4af5-8a2c-6d5e90e6203c'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:31.484941 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-4a3f4625-213b-4af5-8a2c-6d5e90e6203c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90610e835d63481db05085e68cac124e', 'request_id': 'req-4a3f4625-213b-4af5-8a2c-6d5e90e6203c'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:31.496407 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-4a3f4625-213b-4af5-8a2c-6d5e90e6203c admin admin] The token cache is being invalidate because project 90610e835d63481db05085e68cac124e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:10:31.496687 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-4a3f4625-213b-4af5-8a2c-6d5e90e6203c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:31.497433 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-4a3f4625-213b-4af5-8a2c-6d5e90e6203c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:10:31.499055 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1164/2300] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:10:31 2022] DELETE /identity/v3/projects/90610e835d63481db05085e68cac124e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:10:31.504066 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf69ac-949a-4c64-8f5d-bb09386b14c1 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:31.504552 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf69ac-949a-4c64-8f5d-bb09386b14c1 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:31.504552 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf69ac-949a-4c64-8f5d-bb09386b14c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:31.524871 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-4abf69ac-949a-4c64-8f5d-bb09386b14c1 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:10:31.525972 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-4abf69ac-949a-4c64-8f5d-bb09386b14c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:31.586745 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1137/2301] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:10:31.597539 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d41ee-d916-40d4-bb30-1ffedfa00cdb None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:31.597843 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d41ee-d916-40d4-bb30-1ffedfa00cdb None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:31.598144 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d41ee-d916-40d4-bb30-1ffedfa00cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:31.617788 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-a00d41ee-d916-40d4-bb30-1ffedfa00cdb None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:10:31.619118 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-a00d41ee-d916-40d4-bb30-1ffedfa00cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:31.628199 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1165/2302] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:10:31.632673 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf69ac-949a-4c64-8f5d-bb09386b14c1 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:31.643887 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf69ac-949a-4c64-8f5d-bb09386b14c1 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:31.648584 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c00bbf-a43d-4b1a-9573-fa2854674258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:31.650101 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c00bbf-a43d-4b1a-9573-fa2854674258 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:31.650101 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c00bbf-a43d-4b1a-9573-fa2854674258 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:31.650290 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c00bbf-a43d-4b1a-9573-fa2854674258 admin admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:31.650949 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c00bbf-a43d-4b1a-9573-fa2854674258 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:10:31.651240 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c00bbf-a43d-4b1a-9573-fa2854674258 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:31.652873 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c00bbf-a43d-4b1a-9573-fa2854674258 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:31.664724 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1138/2303] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:10:31.669612 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d41ee-d916-40d4-bb30-1ffedfa00cdb None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:31.680724 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d41ee-d916-40d4-bb30-1ffedfa00cdb None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:31.686204 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b1e8ba-a01a-427c-8b45-3538f0264e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:31.686846 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1e8ba-a01a-427c-8b45-3538f0264e91 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:31.687127 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1e8ba-a01a-427c-8b45-3538f0264e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:31.687385 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1e8ba-a01a-427c-8b45-3538f0264e91 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:31.688105 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b1e8ba-a01a-427c-8b45-3538f0264e91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:31.689988 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b1e8ba-a01a-427c-8b45-3538f0264e91 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:31.717987 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1166/2304] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:10:31 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 03:10:31.725238 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c00bbf-a43d-4b1a-9573-fa2854674258 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:31.735568 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c00bbf-a43d-4b1a-9573-fa2854674258 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:31.794658 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3e12c-c03f-4d24-a99f-89f70ca4c2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:31.795228 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3e12c-c03f-4d24-a99f-89f70ca4c2d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:31.795503 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3e12c-c03f-4d24-a99f-89f70ca4c2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:31.795793 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3e12c-c03f-4d24-a99f-89f70ca4c2d0 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:31.796467 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3e12c-c03f-4d24-a99f-89f70ca4c2d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:31.798381 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3e12c-c03f-4d24-a99f-89f70ca4c2d0 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:31.817983 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1139/2305] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:10:31 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:10:31.821983 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b1e8ba-a01a-427c-8b45-3538f0264e91 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:31.832587 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b1e8ba-a01a-427c-8b45-3538f0264e91 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:31.837497 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1cbcd-bf2d-46ef-8471-2b3344208227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:31.838211 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1cbcd-bf2d-46ef-8471-2b3344208227 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:31.838486 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1cbcd-bf2d-46ef-8471-2b3344208227 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:31.838766 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1cbcd-bf2d-46ef-8471-2b3344208227 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:31.839489 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1cbcd-bf2d-46ef-8471-2b3344208227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:31.841146 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1cbcd-bf2d-46ef-8471-2b3344208227 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:31.851766 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1167/2306] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:10:31.856583 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3e12c-c03f-4d24-a99f-89f70ca4c2d0 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:31.868659 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3e12c-c03f-4d24-a99f-89f70ca4c2d0 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:31.874003 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b1921-0e45-406b-a2cc-e489935e3edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:31.874882 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b1921-0e45-406b-a2cc-e489935e3edd admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:31.875679 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b1921-0e45-406b-a2cc-e489935e3edd admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:31.875818 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b1921-0e45-406b-a2cc-e489935e3edd admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:31.876487 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b1921-0e45-406b-a2cc-e489935e3edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:31.878077 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b1921-0e45-406b-a2cc-e489935e3edd admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:31.893961 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1140/2307] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:10:31.897949 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1cbcd-bf2d-46ef-8471-2b3344208227 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:31.907933 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1cbcd-bf2d-46ef-8471-2b3344208227 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:31.912463 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646cd1c7-3781-4673-89a7-84f9c2559a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:31.913360 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646cd1c7-3781-4673-89a7-84f9c2559a4e admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:31.913635 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646cd1c7-3781-4673-89a7-84f9c2559a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:31.913903 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646cd1c7-3781-4673-89a7-84f9c2559a4e admin admin] PATH_INFO: `/v3/projects/1f52ab2178aa4d6298764f79cd311cc1/users/c001f76623f043bab4dfb3984bf89d28/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:31.928463 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646cd1c7-3781-4673-89a7-84f9c2559a4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f52ab2178aa4d6298764f79cd311cc1, user_id=c001f76623f043bab4dfb3984bf89d28, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:31.931166 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646cd1c7-3781-4673-89a7-84f9c2559a4e admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:31.943888 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1168/2308] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:10:31 2022] PUT /identity/v3/projects/1f52ab2178aa4d6298764f79cd311cc1/users/c001f76623f043bab4dfb3984bf89d28/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:10:31.955473 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e4105-a9a6-43df-8739-97e00f9fb667 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:31.955745 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e4105-a9a6-43df-8739-97e00f9fb667 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:31.956009 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e4105-a9a6-43df-8739-97e00f9fb667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:31.986771 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-bf5e4105-a9a6-43df-8739-97e00f9fb667 None None] MFA Rules not processed for user `c001f76623f043bab4dfb3984bf89d28`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:10:31.988832 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-bf5e4105-a9a6-43df-8739-97e00f9fb667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:32.058258 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1141/2309] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:10:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:10:32.070101 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646cd1c7-3781-4673-89a7-84f9c2559a4e admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:32.072079 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-646cd1c7-3781-4673-89a7-84f9c2559a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:32.129171 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646cd1c7-3781-4673-89a7-84f9c2559a4e admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:32.134118 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57f742-6b6e-4018-9ac7-40ef70565a1f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a6cffa8af470388d4b063c3c49849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:32.134883 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57f742-6b6e-4018-9ac7-40ef70565a1f service glance] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:32.135164 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57f742-6b6e-4018-9ac7-40ef70565a1f service glance] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:32.135425 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57f742-6b6e-4018-9ac7-40ef70565a1f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:32.144916 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57f742-6b6e-4018-9ac7-40ef70565a1f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:32.146385 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57f742-6b6e-4018-9ac7-40ef70565a1f service glance] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:32.156134 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1169/2310] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:10:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:10:36.467711 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e4105-a9a6-43df-8739-97e00f9fb667 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:36.470613 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-bf5e4105-a9a6-43df-8739-97e00f9fb667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:36.578022 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e4105-a9a6-43df-8739-97e00f9fb667 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:36.583621 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3c2ec-dd73-4546-bc1e-f7b5b481b270 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:36.584343 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3c2ec-dd73-4546-bc1e-f7b5b481b270 service nova] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:36.584659 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3c2ec-dd73-4546-bc1e-f7b5b481b270 service nova] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:36.584933 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3c2ec-dd73-4546-bc1e-f7b5b481b270 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:36.586815 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-3da3c2ec-dd73-4546-bc1e-f7b5b481b270 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:36.600623 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3c2ec-dd73-4546-bc1e-f7b5b481b270 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:36.602970 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3c2ec-dd73-4546-bc1e-f7b5b481b270 service nova] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:36.614977 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1142/2311] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:10:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:10:38.206586 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e273b4-d667-4302-a2d9-5258a72f0873 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:38.207097 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e273b4-d667-4302-a2d9-5258a72f0873 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:38.207097 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e273b4-d667-4302-a2d9-5258a72f0873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:38.226576 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-27e273b4-d667-4302-a2d9-5258a72f0873 None None] MFA Rules not processed for user `83115653901749f6ade6638593fb54e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:10:38.227977 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-27e273b4-d667-4302-a2d9-5258a72f0873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:38.288358 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1170/2312] 10.222.0.32 () {58 vars in 1009 bytes} [Tue Apr 12 03:10:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:10:38.300797 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3c2ec-dd73-4546-bc1e-f7b5b481b270 service nova] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:38.302249 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-3da3c2ec-dd73-4546-bc1e-f7b5b481b270 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:38.374479 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3c2ec-dd73-4546-bc1e-f7b5b481b270 service nova] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:38.383067 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4bfae-6ce4-4750-92be-74b9aadc28ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e8d78f92f12405fb746ddeb2579bd2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:38.383916 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4bfae-6ce4-4750-92be-74b9aadc28ca service swift] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:38.384301 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4bfae-6ce4-4750-92be-74b9aadc28ca service swift] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:38.384574 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4bfae-6ce4-4750-92be-74b9aadc28ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:38.394389 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea4bfae-6ce4-4750-92be-74b9aadc28ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:38.396112 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea4bfae-6ce4-4750-92be-74b9aadc28ca service swift] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:38.405838 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1143/2313] 10.222.0.32 () {60 vars in 1384 bytes} [Tue Apr 12 03:10:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 03:10:44.501751 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e273b4-d667-4302-a2d9-5258a72f0873 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:44.503535 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-27e273b4-d667-4302-a2d9-5258a72f0873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:44.522287 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e273b4-d667-4302-a2d9-5258a72f0873 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:44.529122 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49ed41-8c26-4463-a2d0-eabc8f9e8800 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:44.529802 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49ed41-8c26-4463-a2d0-eabc8f9e8800 service nova] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:44.530076 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49ed41-8c26-4463-a2d0-eabc8f9e8800 service nova] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:44.530355 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49ed41-8c26-4463-a2d0-eabc8f9e8800 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:44.532532 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-2f49ed41-8c26-4463-a2d0-eabc8f9e8800 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:44.599426 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49ed41-8c26-4463-a2d0-eabc8f9e8800 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:44.601008 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49ed41-8c26-4463-a2d0-eabc8f9e8800 service nova] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:44.610237 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1171/2314] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:10:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:10:59.832258 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4bfae-6ce4-4750-92be-74b9aadc28ca service swift] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:10:59.845253 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4bfae-6ce4-4750-92be-74b9aadc28ca service swift] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:10:59.851633 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae72ea-1613-4893-a512-aa26fe3560d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:10:59.852955 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae72ea-1613-4893-a512-aa26fe3560d5 service nova] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:10:59.853276 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae72ea-1613-4893-a512-aa26fe3560d5 service nova] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:10:59.853547 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae72ea-1613-4893-a512-aa26fe3560d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:10:59.855414 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-b8ae72ea-1613-4893-a512-aa26fe3560d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:10:59.868367 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae72ea-1613-4893-a512-aa26fe3560d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:10:59.870084 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae72ea-1613-4893-a512-aa26fe3560d5 service nova] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:10:59.882079 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1144/2315] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:10:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:11:00.840468 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ff9ff-3e28-48dc-b8c2-bdb95f2ae37c None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:00.841017 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ff9ff-3e28-48dc-b8c2-bdb95f2ae37c None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:00.841017 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ff9ff-3e28-48dc-b8c2-bdb95f2ae37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:00.868092 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-be1ff9ff-3e28-48dc-b8c2-bdb95f2ae37c None None] MFA Rules not processed for user `83115653901749f6ade6638593fb54e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:11:00.869261 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-be1ff9ff-3e28-48dc-b8c2-bdb95f2ae37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:00.877805 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1172/2316] 10.222.0.32 () {58 vars in 967 bytes} [Tue Apr 12 03:11:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:11:00.891306 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae72ea-1613-4893-a512-aa26fe3560d5 service nova] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:00.902736 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae72ea-1613-4893-a512-aa26fe3560d5 service nova] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:00.907807 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d32e0c-2e1e-4231-9b79-8c762443d3f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e8d78f92f12405fb746ddeb2579bd2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:00.908442 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d32e0c-2e1e-4231-9b79-8c762443d3f2 service swift] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:00.908741 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d32e0c-2e1e-4231-9b79-8c762443d3f2 service swift] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:00.909105 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d32e0c-2e1e-4231-9b79-8c762443d3f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:00.917102 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d32e0c-2e1e-4231-9b79-8c762443d3f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:00.918683 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d32e0c-2e1e-4231-9b79-8c762443d3f2 service swift] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:00.928153 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1145/2317] 10.222.0.32 () {60 vars in 1384 bytes} [Tue Apr 12 03:11:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 03:11:01.766797 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71832bb-ee02-4d95-aabe-8bcd2baf597d None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:01.767084 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71832bb-ee02-4d95-aabe-8bcd2baf597d None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:01.767355 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71832bb-ee02-4d95-aabe-8bcd2baf597d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:01.786085 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-a71832bb-ee02-4d95-aabe-8bcd2baf597d None None] MFA Rules not processed for user `157ff7b3ca7b4af69a47cc36b0d1917a`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:11:01.787267 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-a71832bb-ee02-4d95-aabe-8bcd2baf597d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:01.846006 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1173/2318] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:11:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:11:04.179629 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d32e0c-2e1e-4231-9b79-8c762443d3f2 service swift] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:04.242379 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d32e0c-2e1e-4231-9b79-8c762443d3f2 service swift] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:04.248067 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1f63a-c479-4503-9efe-3da81a1f5ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:04.249075 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1f63a-c479-4503-9efe-3da81a1f5ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:04.249367 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1f63a-c479-4503-9efe-3da81a1f5ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:04.249632 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1f63a-c479-4503-9efe-3da81a1f5ed5 admin admin] PATH_INFO: `/v3/users/c001f76623f043bab4dfb3984bf89d28` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:04.250948 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1f63a-c479-4503-9efe-3da81a1f5ed5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c001f76623f043bab4dfb3984bf89d28)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:04.253012 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1f63a-c479-4503-9efe-3da81a1f5ed5 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:04.299421 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3ff1f63a-c479-4503-9efe-3da81a1f5ed5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c001f76623f043bab4dfb3984bf89d28'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:04.300081 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3ff1f63a-c479-4503-9efe-3da81a1f5ed5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c001f76623f043bab4dfb3984bf89d28'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:04.312244 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3ff1f63a-c479-4503-9efe-3da81a1f5ed5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c001f76623f043bab4dfb3984bf89d28'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:04.313081 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3ff1f63a-c479-4503-9efe-3da81a1f5ed5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c001f76623f043bab4dfb3984bf89d28'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:04.320314 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3ff1f63a-c479-4503-9efe-3da81a1f5ed5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c001f76623f043bab4dfb3984bf89d28'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:04.335265 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1146/2319] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:11:04 2022] DELETE /identity/v3/users/c001f76623f043bab4dfb3984bf89d28 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:11:04.339864 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b65f3e-7fdf-421a-a0ed-658cea7de142 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:04.340349 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b65f3e-7fdf-421a-a0ed-658cea7de142 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:04.340450 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b65f3e-7fdf-421a-a0ed-658cea7de142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:04.357969 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-d9b65f3e-7fdf-421a-a0ed-658cea7de142 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:11:04.359198 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-d9b65f3e-7fdf-421a-a0ed-658cea7de142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:04.420369 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1174/2320] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:11:04.430067 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1f63a-c479-4503-9efe-3da81a1f5ed5 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:04.431602 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-3ff1f63a-c479-4503-9efe-3da81a1f5ed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:04.491624 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1f63a-c479-4503-9efe-3da81a1f5ed5 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:04.495586 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2055d4-0127-492a-b7bc-24ee3691b0cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:04.496265 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2055d4-0127-492a-b7bc-24ee3691b0cd service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:04.496545 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2055d4-0127-492a-b7bc-24ee3691b0cd service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:04.496844 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2055d4-0127-492a-b7bc-24ee3691b0cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:04.506547 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2055d4-0127-492a-b7bc-24ee3691b0cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:04.508094 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2055d4-0127-492a-b7bc-24ee3691b0cd service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:04.523953 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1147/2321] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:11:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:11:04.820926 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b65f3e-7fdf-421a-a0ed-658cea7de142 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:04.822361 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-d9b65f3e-7fdf-421a-a0ed-658cea7de142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:04.835590 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b65f3e-7fdf-421a-a0ed-658cea7de142 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:04.840669 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669801de-d915-42ec-9403-2c434eb3bc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:04.842307 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669801de-d915-42ec-9403-2c434eb3bc3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:04.842679 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669801de-d915-42ec-9403-2c434eb3bc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:04.843288 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669801de-d915-42ec-9403-2c434eb3bc3e admin admin] PATH_INFO: `/v3/projects/1f52ab2178aa4d6298764f79cd311cc1` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:04.844910 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669801de-d915-42ec-9403-2c434eb3bc3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f52ab2178aa4d6298764f79cd311cc1)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:04.848176 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669801de-d915-42ec-9403-2c434eb3bc3e admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:04.895397 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-669801de-d915-42ec-9403-2c434eb3bc3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f52ab2178aa4d6298764f79cd311cc1', 'request_id': 'req-669801de-d915-42ec-9403-2c434eb3bc3e'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:04.903699 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-669801de-d915-42ec-9403-2c434eb3bc3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f52ab2178aa4d6298764f79cd311cc1', 'request_id': 'req-669801de-d915-42ec-9403-2c434eb3bc3e'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:04.910638 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-669801de-d915-42ec-9403-2c434eb3bc3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f52ab2178aa4d6298764f79cd311cc1', 'request_id': 'req-669801de-d915-42ec-9403-2c434eb3bc3e'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:04.920471 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-669801de-d915-42ec-9403-2c434eb3bc3e admin admin] The token cache is being invalidate because project 1f52ab2178aa4d6298764f79cd311cc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:11:04.920754 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-669801de-d915-42ec-9403-2c434eb3bc3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:04.921595 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-669801de-d915-42ec-9403-2c434eb3bc3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:04.923764 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1175/2322] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:11:04 2022] DELETE /identity/v3/projects/1f52ab2178aa4d6298764f79cd311cc1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:11:04.928323 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74093e0d-9cbe-4e2a-97ea-ee0de84d08cf None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:04.928717 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74093e0d-9cbe-4e2a-97ea-ee0de84d08cf None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:04.929035 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74093e0d-9cbe-4e2a-97ea-ee0de84d08cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:04.947385 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-74093e0d-9cbe-4e2a-97ea-ee0de84d08cf None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:11:04.948605 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-74093e0d-9cbe-4e2a-97ea-ee0de84d08cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:05.013116 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1148/2323] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:11:05.022037 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a26b8-2fe5-4cfa-9098-452c9939b4ad None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:05.022319 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a26b8-2fe5-4cfa-9098-452c9939b4ad None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:05.022590 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a26b8-2fe5-4cfa-9098-452c9939b4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:05.041394 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-6f0a26b8-2fe5-4cfa-9098-452c9939b4ad None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:11:05.042580 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-6f0a26b8-2fe5-4cfa-9098-452c9939b4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:05.051502 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1176/2324] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:11:05.056049 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74093e0d-9cbe-4e2a-97ea-ee0de84d08cf None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:05.066211 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74093e0d-9cbe-4e2a-97ea-ee0de84d08cf None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:05.072181 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fef92e-7e67-493f-a17a-25f9b17c6660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:05.072849 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fef92e-7e67-493f-a17a-25f9b17c6660 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:05.073126 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fef92e-7e67-493f-a17a-25f9b17c6660 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:05.073384 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fef92e-7e67-493f-a17a-25f9b17c6660 admin admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:05.074124 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fef92e-7e67-493f-a17a-25f9b17c6660 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:11:05.074423 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fef92e-7e67-493f-a17a-25f9b17c6660 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:05.076373 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fef92e-7e67-493f-a17a-25f9b17c6660 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:05.089360 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1149/2325] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:11:05.094114 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a26b8-2fe5-4cfa-9098-452c9939b4ad None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:05.103473 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a26b8-2fe5-4cfa-9098-452c9939b4ad None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:05.109355 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c1154-9072-49b4-993e-695f867bd7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:05.109990 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c1154-9072-49b4-993e-695f867bd7eb admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:05.110260 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c1154-9072-49b4-993e-695f867bd7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:05.110527 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c1154-9072-49b4-993e-695f867bd7eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:05.111210 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c1154-9072-49b4-993e-695f867bd7eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:05.113138 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c1154-9072-49b4-993e-695f867bd7eb admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:05.146025 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1177/2326] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:11:05 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:11:05.150172 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fef92e-7e67-493f-a17a-25f9b17c6660 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:05.161419 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fef92e-7e67-493f-a17a-25f9b17c6660 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:05.223232 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6eead-dc84-432e-abfc-6d5d0abff867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:05.223978 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6eead-dc84-432e-abfc-6d5d0abff867 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:05.224221 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6eead-dc84-432e-abfc-6d5d0abff867 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:05.224486 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6eead-dc84-432e-abfc-6d5d0abff867 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:05.225173 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d6eead-dc84-432e-abfc-6d5d0abff867 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:05.227163 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d6eead-dc84-432e-abfc-6d5d0abff867 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:05.253337 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1150/2327] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:11:05 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:11:05.254376 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c1154-9072-49b4-993e-695f867bd7eb admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:05.265450 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c1154-9072-49b4-993e-695f867bd7eb admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:05.270697 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc86636-e29e-4811-aa8b-05b5ac41d4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:05.271388 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc86636-e29e-4811-aa8b-05b5ac41d4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:05.271661 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc86636-e29e-4811-aa8b-05b5ac41d4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:05.272063 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc86636-e29e-4811-aa8b-05b5ac41d4c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:05.272687 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc86636-e29e-4811-aa8b-05b5ac41d4c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:05.274423 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc86636-e29e-4811-aa8b-05b5ac41d4c9 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:05.286074 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1178/2328] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:11:05.290349 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6eead-dc84-432e-abfc-6d5d0abff867 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:05.301077 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6eead-dc84-432e-abfc-6d5d0abff867 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:05.307528 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98442609-4eb2-4fc6-83d8-f7ae8148dddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:05.308221 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98442609-4eb2-4fc6-83d8-f7ae8148dddc admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:05.308494 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98442609-4eb2-4fc6-83d8-f7ae8148dddc admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:05.308763 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98442609-4eb2-4fc6-83d8-f7ae8148dddc admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:05.309650 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98442609-4eb2-4fc6-83d8-f7ae8148dddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:05.311234 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98442609-4eb2-4fc6-83d8-f7ae8148dddc admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:05.325360 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1151/2329] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:11:05.326283 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc86636-e29e-4811-aa8b-05b5ac41d4c9 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:05.340132 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc86636-e29e-4811-aa8b-05b5ac41d4c9 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:05.346627 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb72169-69e8-460a-810b-ce5028aba3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:05.348136 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb72169-69e8-460a-810b-ce5028aba3d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:05.348412 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb72169-69e8-460a-810b-ce5028aba3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:05.348680 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb72169-69e8-460a-810b-ce5028aba3d4 admin admin] PATH_INFO: `/v3/projects/93bbadf297534dd28da937ad11f5e24a/users/5fa9975255bc4bceb902d552f99402bb/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:05.371057 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb72169-69e8-460a-810b-ce5028aba3d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93bbadf297534dd28da937ad11f5e24a, user_id=5fa9975255bc4bceb902d552f99402bb, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:05.374995 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb72169-69e8-460a-810b-ce5028aba3d4 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:05.389072 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1179/2330] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:11:05 2022] PUT /identity/v3/projects/93bbadf297534dd28da937ad11f5e24a/users/5fa9975255bc4bceb902d552f99402bb/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:11:05.394231 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32479c-af30-4943-8bc2-ea6403b041e7 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:05.394510 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32479c-af30-4943-8bc2-ea6403b041e7 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:05.394778 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32479c-af30-4943-8bc2-ea6403b041e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:05.412995 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-da32479c-af30-4943-8bc2-ea6403b041e7 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:11:05.414117 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-da32479c-af30-4943-8bc2-ea6403b041e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:05.476058 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1152/2331] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:11:05.485754 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb72169-69e8-460a-810b-ce5028aba3d4 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:05.487764 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-6fb72169-69e8-460a-810b-ce5028aba3d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:05.544126 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb72169-69e8-460a-810b-ce5028aba3d4 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:05.548316 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b409f3-9ad5-4a84-9080-cdbe37714c70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:05.548966 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b409f3-9ad5-4a84-9080-cdbe37714c70 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:05.549250 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b409f3-9ad5-4a84-9080-cdbe37714c70 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:05.549511 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b409f3-9ad5-4a84-9080-cdbe37714c70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:05.558641 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b409f3-9ad5-4a84-9080-cdbe37714c70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:05.560119 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b409f3-9ad5-4a84-9080-cdbe37714c70 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:05.569321 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1180/2332] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:11:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:11:06.182096 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468045f-8fa2-4085-8a36-f1b084c113f2 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:06.182377 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468045f-8fa2-4085-8a36-f1b084c113f2 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:06.182680 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468045f-8fa2-4085-8a36-f1b084c113f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:06.208101 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-9468045f-8fa2-4085-8a36-f1b084c113f2 None None] MFA Rules not processed for user `5fa9975255bc4bceb902d552f99402bb`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:11:06.209301 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-9468045f-8fa2-4085-8a36-f1b084c113f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:06.275273 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1153/2333] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:11:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:11:06.286224 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b409f3-9ad5-4a84-9080-cdbe37714c70 service neutron] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:06.287626 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-f0b409f3-9ad5-4a84-9080-cdbe37714c70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:06.345402 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b409f3-9ad5-4a84-9080-cdbe37714c70 service neutron] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:06.349027 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88347b72-99dd-430d-bf05-561cfaab4d56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:06.349691 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88347b72-99dd-430d-bf05-561cfaab4d56 service cinder] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:06.349960 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88347b72-99dd-430d-bf05-561cfaab4d56 service cinder] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:06.350223 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88347b72-99dd-430d-bf05-561cfaab4d56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:06.358733 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88347b72-99dd-430d-bf05-561cfaab4d56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:06.360246 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88347b72-99dd-430d-bf05-561cfaab4d56 service cinder] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:06.369104 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1181/2334] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:11:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:11:07.711154 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19495c-0fac-473b-bd17-1e6be776862d None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:07.711836 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19495c-0fac-473b-bd17-1e6be776862d None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:07.711836 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19495c-0fac-473b-bd17-1e6be776862d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:07.730287 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-8c19495c-0fac-473b-bd17-1e6be776862d None None] MFA Rules not processed for user `5fa9975255bc4bceb902d552f99402bb`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:11:07.731484 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-8c19495c-0fac-473b-bd17-1e6be776862d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:07.740471 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1154/2335] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:11:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:11:07.976571 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88347b72-99dd-430d-bf05-561cfaab4d56 service cinder] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:07.986853 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88347b72-99dd-430d-bf05-561cfaab4d56 service cinder] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:07.990831 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f887add-dd4c-46e4-a561-cac3a973fe33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:07.991458 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f887add-dd4c-46e4-a561-cac3a973fe33 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:07.991735 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f887add-dd4c-46e4-a561-cac3a973fe33 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:07.992021 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f887add-dd4c-46e4-a561-cac3a973fe33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:07.993953 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-4f887add-dd4c-46e4-a561-cac3a973fe33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:08.004169 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f887add-dd4c-46e4-a561-cac3a973fe33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:08.005562 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f887add-dd4c-46e4-a561-cac3a973fe33 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:08.013830 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1182/2336] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:11:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:11:12.125650 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19495c-0fac-473b-bd17-1e6be776862d None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:12.127946 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-8c19495c-0fac-473b-bd17-1e6be776862d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:12.224043 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19495c-0fac-473b-bd17-1e6be776862d None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:12.229962 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7c9fb-f3a1-4689-ae50-4adfc5ba5815 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:12.230603 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7c9fb-f3a1-4689-ae50-4adfc5ba5815 service nova] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:12.231155 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7c9fb-f3a1-4689-ae50-4adfc5ba5815 service nova] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:12.231484 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7c9fb-f3a1-4689-ae50-4adfc5ba5815 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:12.233351 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-0aa7c9fb-f3a1-4689-ae50-4adfc5ba5815 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:12.246115 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7c9fb-f3a1-4689-ae50-4adfc5ba5815 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:12.247775 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7c9fb-f3a1-4689-ae50-4adfc5ba5815 service nova] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:12.258764 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1155/2337] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:11:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:11:34.378454 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f887add-dd4c-46e4-a561-cac3a973fe33 service neutron] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:34.380122 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-4f887add-dd4c-46e4-a561-cac3a973fe33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:34.390390 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f887add-dd4c-46e4-a561-cac3a973fe33 service neutron] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:34.394219 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61844c03-2bb7-410c-998e-195c59b5cb7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:34.394864 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61844c03-2bb7-410c-998e-195c59b5cb7b service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:34.395142 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61844c03-2bb7-410c-998e-195c59b5cb7b service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:34.395413 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61844c03-2bb7-410c-998e-195c59b5cb7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:34.397180 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-61844c03-2bb7-410c-998e-195c59b5cb7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:34.409048 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61844c03-2bb7-410c-998e-195c59b5cb7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:34.410701 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61844c03-2bb7-410c-998e-195c59b5cb7b service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:34.420912 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1183/2338] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:11:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:11:37.951679 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7c9fb-f3a1-4689-ae50-4adfc5ba5815 service nova] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:37.953264 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-0aa7c9fb-f3a1-4689-ae50-4adfc5ba5815 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:37.984256 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7c9fb-f3a1-4689-ae50-4adfc5ba5815 service nova] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:37.991441 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82290aa-6ecb-415b-8d6c-40612a36f893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:37.992617 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82290aa-6ecb-415b-8d6c-40612a36f893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:37.992965 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82290aa-6ecb-415b-8d6c-40612a36f893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:37.993301 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82290aa-6ecb-415b-8d6c-40612a36f893 admin admin] PATH_INFO: `/v3/users/4ded28c2ffe345ccbefde50585023857` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:37.994736 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82290aa-6ecb-415b-8d6c-40612a36f893 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ded28c2ffe345ccbefde50585023857)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:37.998510 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82290aa-6ecb-415b-8d6c-40612a36f893 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:38.057431 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-c82290aa-6ecb-415b-8d6c-40612a36f893 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ded28c2ffe345ccbefde50585023857'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:38.058071 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-c82290aa-6ecb-415b-8d6c-40612a36f893 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ded28c2ffe345ccbefde50585023857'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:38.081099 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-c82290aa-6ecb-415b-8d6c-40612a36f893 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ded28c2ffe345ccbefde50585023857'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:38.081857 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-c82290aa-6ecb-415b-8d6c-40612a36f893 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ded28c2ffe345ccbefde50585023857'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:38.089766 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-c82290aa-6ecb-415b-8d6c-40612a36f893 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ded28c2ffe345ccbefde50585023857'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:38.104774 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1156/2339] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:11:37 2022] DELETE /identity/v3/users/4ded28c2ffe345ccbefde50585023857 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:11:38.284312 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61844c03-2bb7-410c-998e-195c59b5cb7b service neutron] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:38.295673 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61844c03-2bb7-410c-998e-195c59b5cb7b service neutron] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:38.355622 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce311965-46df-431e-9f3d-c367d07c810f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:38.356643 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce311965-46df-431e-9f3d-c367d07c810f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:38.357066 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce311965-46df-431e-9f3d-c367d07c810f admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:38.357322 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce311965-46df-431e-9f3d-c367d07c810f admin admin] PATH_INFO: `/v3/projects/e9ed2cca6cce43c599fc86b60cfafda6` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:38.358501 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce311965-46df-431e-9f3d-c367d07c810f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9ed2cca6cce43c599fc86b60cfafda6)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:38.360485 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce311965-46df-431e-9f3d-c367d07c810f admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:38.407921 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-ce311965-46df-431e-9f3d-c367d07c810f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9ed2cca6cce43c599fc86b60cfafda6', 'request_id': 'req-ce311965-46df-431e-9f3d-c367d07c810f'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:38.416104 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-ce311965-46df-431e-9f3d-c367d07c810f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9ed2cca6cce43c599fc86b60cfafda6', 'request_id': 'req-ce311965-46df-431e-9f3d-c367d07c810f'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:38.424700 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-ce311965-46df-431e-9f3d-c367d07c810f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9ed2cca6cce43c599fc86b60cfafda6', 'request_id': 'req-ce311965-46df-431e-9f3d-c367d07c810f'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:38.435125 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-ce311965-46df-431e-9f3d-c367d07c810f admin admin] The token cache is being invalidate because project e9ed2cca6cce43c599fc86b60cfafda6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:11:38.435406 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-ce311965-46df-431e-9f3d-c367d07c810f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:38.436067 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-ce311965-46df-431e-9f3d-c367d07c810f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:38.437605 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1184/2340] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:11:38 2022] DELETE /identity/v3/projects/e9ed2cca6cce43c599fc86b60cfafda6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:11:38.442653 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d356e7-3c35-409a-99e9-e035315e8e18 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:38.442937 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d356e7-3c35-409a-99e9-e035315e8e18 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:38.443266 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d356e7-3c35-409a-99e9-e035315e8e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:38.461720 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-99d356e7-3c35-409a-99e9-e035315e8e18 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:11:38.463012 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-99d356e7-3c35-409a-99e9-e035315e8e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:38.524636 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1157/2341] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:11:38.533411 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4876d-f715-411e-9a64-4d208b00cb67 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:38.533555 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4876d-f715-411e-9a64-4d208b00cb67 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:38.533802 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4876d-f715-411e-9a64-4d208b00cb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:38.552988 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-fbf4876d-f715-411e-9a64-4d208b00cb67 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:11:38.554186 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-fbf4876d-f715-411e-9a64-4d208b00cb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:38.562448 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1185/2342] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:11:38.567010 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d356e7-3c35-409a-99e9-e035315e8e18 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:38.577003 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d356e7-3c35-409a-99e9-e035315e8e18 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:38.581870 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90266a2e-ed65-40dc-a728-98d211736f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:38.582521 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90266a2e-ed65-40dc-a728-98d211736f0c admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:38.582798 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90266a2e-ed65-40dc-a728-98d211736f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:38.583069 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90266a2e-ed65-40dc-a728-98d211736f0c admin admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:38.583940 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90266a2e-ed65-40dc-a728-98d211736f0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:11:38.584201 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90266a2e-ed65-40dc-a728-98d211736f0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:38.585813 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90266a2e-ed65-40dc-a728-98d211736f0c admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:38.598084 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1158/2343] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:11:38.603112 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4876d-f715-411e-9a64-4d208b00cb67 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:38.614163 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4876d-f715-411e-9a64-4d208b00cb67 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:38.619639 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4acf67e-c015-4d8a-b455-752d99287a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:38.620376 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acf67e-c015-4d8a-b455-752d99287a87 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:38.620674 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acf67e-c015-4d8a-b455-752d99287a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:38.620970 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acf67e-c015-4d8a-b455-752d99287a87 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:38.621677 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4acf67e-c015-4d8a-b455-752d99287a87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:38.623707 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4acf67e-c015-4d8a-b455-752d99287a87 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:38.661901 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1186/2344] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:11:38 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:11:38.668118 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90266a2e-ed65-40dc-a728-98d211736f0c admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:38.679026 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90266a2e-ed65-40dc-a728-98d211736f0c admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:38.749792 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef04d14-1b74-4a4b-99cc-ad7003da6a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:38.750463 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef04d14-1b74-4a4b-99cc-ad7003da6a1e admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:38.750733 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef04d14-1b74-4a4b-99cc-ad7003da6a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:38.751028 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef04d14-1b74-4a4b-99cc-ad7003da6a1e admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:38.751749 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef04d14-1b74-4a4b-99cc-ad7003da6a1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:38.753731 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef04d14-1b74-4a4b-99cc-ad7003da6a1e admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:38.781311 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1159/2345] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:11:38 2022] POST /identity/v3/users => generated 291 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:11:38.785999 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4acf67e-c015-4d8a-b455-752d99287a87 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:38.800302 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4acf67e-c015-4d8a-b455-752d99287a87 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:38.806268 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cea72d-e148-48bd-b77c-ba21ae739c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:38.807004 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cea72d-e148-48bd-b77c-ba21ae739c35 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:38.807375 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cea72d-e148-48bd-b77c-ba21ae739c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:38.807647 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cea72d-e148-48bd-b77c-ba21ae739c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:38.808411 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cea72d-e148-48bd-b77c-ba21ae739c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:38.810105 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cea72d-e148-48bd-b77c-ba21ae739c35 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:38.821433 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1187/2346] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:11:38.826262 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef04d14-1b74-4a4b-99cc-ad7003da6a1e admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:38.837058 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef04d14-1b74-4a4b-99cc-ad7003da6a1e admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:38.842654 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc370e4-28c7-4fbb-be71-5f547dcf2a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:38.843313 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc370e4-28c7-4fbb-be71-5f547dcf2a86 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:38.843588 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc370e4-28c7-4fbb-be71-5f547dcf2a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:38.843890 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc370e4-28c7-4fbb-be71-5f547dcf2a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:38.844646 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc370e4-28c7-4fbb-be71-5f547dcf2a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:38.846348 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc370e4-28c7-4fbb-be71-5f547dcf2a86 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:38.857505 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1160/2347] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:11:38.862382 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cea72d-e148-48bd-b77c-ba21ae739c35 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:38.872788 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cea72d-e148-48bd-b77c-ba21ae739c35 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:38.878543 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a8e59-5c6f-4ed8-9c6a-bc39233a0657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:38.879427 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a8e59-5c6f-4ed8-9c6a-bc39233a0657 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:38.879706 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a8e59-5c6f-4ed8-9c6a-bc39233a0657 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:38.880058 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a8e59-5c6f-4ed8-9c6a-bc39233a0657 admin admin] PATH_INFO: `/v3/projects/c4c46b2874a74d80bd682ac65c39cf30/users/9b31c8b395724f588dc3f8797ec4255e/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:38.895300 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a8e59-5c6f-4ed8-9c6a-bc39233a0657 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4c46b2874a74d80bd682ac65c39cf30, user_id=9b31c8b395724f588dc3f8797ec4255e, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:38.898005 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a8e59-5c6f-4ed8-9c6a-bc39233a0657 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:38.913508 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1188/2348] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:11:38 2022] PUT /identity/v3/projects/c4c46b2874a74d80bd682ac65c39cf30/users/9b31c8b395724f588dc3f8797ec4255e/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:11:38.923735 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8b076-d462-4e47-af9d-4d18d7cad852 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:38.924036 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8b076-d462-4e47-af9d-4d18d7cad852 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:38.924402 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8b076-d462-4e47-af9d-4d18d7cad852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:38.953043 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-53e8b076-d462-4e47-af9d-4d18d7cad852 None None] MFA Rules not processed for user `9b31c8b395724f588dc3f8797ec4255e`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:11:38.954242 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-53e8b076-d462-4e47-af9d-4d18d7cad852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:39.024809 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1161/2349] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:11:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:11:39.029360 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a8e59-5c6f-4ed8-9c6a-bc39233a0657 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:39.091962 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a8e59-5c6f-4ed8-9c6a-bc39233a0657 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:39.097126 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93160945-d46a-4fd4-b9fd-8c467b4302e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:39.097790 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93160945-d46a-4fd4-b9fd-8c467b4302e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:39.098060 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93160945-d46a-4fd4-b9fd-8c467b4302e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:39.098326 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93160945-d46a-4fd4-b9fd-8c467b4302e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:39.098986 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93160945-d46a-4fd4-b9fd-8c467b4302e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:39.100923 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93160945-d46a-4fd4-b9fd-8c467b4302e9 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:39.137127 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1189/2350] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:11:39 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:11:39.141231 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8b076-d462-4e47-af9d-4d18d7cad852 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:39.152616 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8b076-d462-4e47-af9d-4d18d7cad852 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:39.215317 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f927e68a-9302-42f8-b214-f41d2b90af05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:39.216162 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927e68a-9302-42f8-b214-f41d2b90af05 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:39.216435 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927e68a-9302-42f8-b214-f41d2b90af05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:39.216695 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927e68a-9302-42f8-b214-f41d2b90af05 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:39.217382 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f927e68a-9302-42f8-b214-f41d2b90af05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:39.219333 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f927e68a-9302-42f8-b214-f41d2b90af05 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:39.243730 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1162/2351] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:11:39 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 03:11:39.249392 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93160945-d46a-4fd4-b9fd-8c467b4302e9 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:39.264933 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93160945-d46a-4fd4-b9fd-8c467b4302e9 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:39.269731 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480561f3-40d8-4364-aa19-7b7bca5243b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:39.270405 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480561f3-40d8-4364-aa19-7b7bca5243b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:39.270692 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480561f3-40d8-4364-aa19-7b7bca5243b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:39.270942 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480561f3-40d8-4364-aa19-7b7bca5243b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:39.271709 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480561f3-40d8-4364-aa19-7b7bca5243b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:39.273388 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480561f3-40d8-4364-aa19-7b7bca5243b0 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:39.284516 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1190/2352] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:11:39.289006 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f927e68a-9302-42f8-b214-f41d2b90af05 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:39.299593 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f927e68a-9302-42f8-b214-f41d2b90af05 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:39.306485 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc2837-df0c-4c7c-b228-b4bce4ed8de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:39.307908 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc2837-df0c-4c7c-b228-b4bce4ed8de5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:39.308360 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc2837-df0c-4c7c-b228-b4bce4ed8de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:39.308769 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc2837-df0c-4c7c-b228-b4bce4ed8de5 admin admin] PATH_INFO: `/v3/projects/a26d77cf34a140698eadd126f0fbb82a/users/57ab04c81bcd4b1393e10cb418d7fa52/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:39.326479 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc2837-df0c-4c7c-b228-b4bce4ed8de5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a26d77cf34a140698eadd126f0fbb82a, user_id=57ab04c81bcd4b1393e10cb418d7fa52, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:39.329202 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc2837-df0c-4c7c-b228-b4bce4ed8de5 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:39.347828 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1163/2353] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:11:39 2022] PUT /identity/v3/projects/a26d77cf34a140698eadd126f0fbb82a/users/57ab04c81bcd4b1393e10cb418d7fa52/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:11:39.353194 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480561f3-40d8-4364-aa19-7b7bca5243b0 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:39.365200 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480561f3-40d8-4364-aa19-7b7bca5243b0 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:39.425756 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc8ca7-4ba0-4ec0-b528-78148ebdb902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:39.426425 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc8ca7-4ba0-4ec0-b528-78148ebdb902 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:39.426904 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc8ca7-4ba0-4ec0-b528-78148ebdb902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:39.427067 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc8ca7-4ba0-4ec0-b528-78148ebdb902 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:39.427842 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefc8ca7-4ba0-4ec0-b528-78148ebdb902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:39.429438 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefc8ca7-4ba0-4ec0-b528-78148ebdb902 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:39.439453 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1191/2354] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:11:39.443539 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc2837-df0c-4c7c-b228-b4bce4ed8de5 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:39.454738 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc2837-df0c-4c7c-b228-b4bce4ed8de5 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:39.459908 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a13d4-fff5-4798-aff1-fb242fb52a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:39.460820 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a13d4-fff5-4798-aff1-fb242fb52a6e admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:39.461101 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a13d4-fff5-4798-aff1-fb242fb52a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:39.461399 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a13d4-fff5-4798-aff1-fb242fb52a6e admin admin] PATH_INFO: `/v3/projects/a26d77cf34a140698eadd126f0fbb82a/users/57ab04c81bcd4b1393e10cb418d7fa52/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:39.463369 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a13d4-fff5-4798-aff1-fb242fb52a6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a26d77cf34a140698eadd126f0fbb82a, user_id=57ab04c81bcd4b1393e10cb418d7fa52, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:39.466233 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a13d4-fff5-4798-aff1-fb242fb52a6e admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:39.477378 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1164/2355] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:11:39 2022] PUT /identity/v3/projects/a26d77cf34a140698eadd126f0fbb82a/users/57ab04c81bcd4b1393e10cb418d7fa52/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:11:39.487979 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc8ca7-4ba0-4ec0-b528-78148ebdb902 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:39.488904 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5630dff-799d-4274-836b-adeeff069687 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:39.489187 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5630dff-799d-4274-836b-adeeff069687 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:39.489453 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5630dff-799d-4274-836b-adeeff069687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:39.489781 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-cefc8ca7-4ba0-4ec0-b528-78148ebdb902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:39.515967 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-f5630dff-799d-4274-836b-adeeff069687 None None] MFA Rules not processed for user `57ab04c81bcd4b1393e10cb418d7fa52`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:11:39.520908 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-f5630dff-799d-4274-836b-adeeff069687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:39.546203 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc8ca7-4ba0-4ec0-b528-78148ebdb902 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:39.587180 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1165/2356] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:11:39 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:11:39.603811 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5630dff-799d-4274-836b-adeeff069687 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:39.605257 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-f5630dff-799d-4274-836b-adeeff069687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:39.608223 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a579934-eb0c-47eb-a667-f80172f476f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:39.608929 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a579934-eb0c-47eb-a667-f80172f476f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:39.609213 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a579934-eb0c-47eb-a667-f80172f476f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:39.609478 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a579934-eb0c-47eb-a667-f80172f476f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:39.611221 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-8a579934-eb0c-47eb-a667-f80172f476f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:39.660059 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5630dff-799d-4274-836b-adeeff069687 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:39.664221 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831d5a3-18dc-4fbe-82ab-1d2c30c8853d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:39.664931 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831d5a3-18dc-4fbe-82ab-1d2c30c8853d service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:39.665267 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831d5a3-18dc-4fbe-82ab-1d2c30c8853d service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:39.665608 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831d5a3-18dc-4fbe-82ab-1d2c30c8853d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:39.670512 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a579934-eb0c-47eb-a667-f80172f476f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:39.672092 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a579934-eb0c-47eb-a667-f80172f476f1 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:39.675491 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831d5a3-18dc-4fbe-82ab-1d2c30c8853d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:39.676960 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831d5a3-18dc-4fbe-82ab-1d2c30c8853d service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:39.681755 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1192/2357] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:11:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:11:39.686277 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1166/2358] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:11:39 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:11:39.760525 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a579934-eb0c-47eb-a667-f80172f476f1 service neutron] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:39.770894 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a579934-eb0c-47eb-a667-f80172f476f1 service neutron] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:39.774775 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540e106-c941-4602-9ea7-3b562e1ada2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:39.775421 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540e106-c941-4602-9ea7-3b562e1ada2f service cinder] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:39.775693 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540e106-c941-4602-9ea7-3b562e1ada2f service cinder] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:39.776001 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540e106-c941-4602-9ea7-3b562e1ada2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:39.832160 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2540e106-c941-4602-9ea7-3b562e1ada2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:39.833552 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2540e106-c941-4602-9ea7-3b562e1ada2f service cinder] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:39.842870 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1193/2359] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:11:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:11:43.101851 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831d5a3-18dc-4fbe-82ab-1d2c30c8853d service cinder] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:43.103449 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-d831d5a3-18dc-4fbe-82ab-1d2c30c8853d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:43.122647 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831d5a3-18dc-4fbe-82ab-1d2c30c8853d service cinder] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:43.128185 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457785f-33d6-4adb-91c8-a6c76dfb7bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:43.129068 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457785f-33d6-4adb-91c8-a6c76dfb7bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:43.129343 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457785f-33d6-4adb-91c8-a6c76dfb7bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:43.129610 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457785f-33d6-4adb-91c8-a6c76dfb7bd8 admin admin] PATH_INFO: `/v3/users/d452c4f1c0ac4646ac7869552de56b96` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:43.130952 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457785f-33d6-4adb-91c8-a6c76dfb7bd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d452c4f1c0ac4646ac7869552de56b96)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:43.132934 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457785f-33d6-4adb-91c8-a6c76dfb7bd8 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:43.184310 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-e457785f-33d6-4adb-91c8-a6c76dfb7bd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd452c4f1c0ac4646ac7869552de56b96'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:43.184978 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-e457785f-33d6-4adb-91c8-a6c76dfb7bd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd452c4f1c0ac4646ac7869552de56b96'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:43.196808 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-e457785f-33d6-4adb-91c8-a6c76dfb7bd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd452c4f1c0ac4646ac7869552de56b96'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:43.197494 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-e457785f-33d6-4adb-91c8-a6c76dfb7bd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd452c4f1c0ac4646ac7869552de56b96'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:43.204438 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-e457785f-33d6-4adb-91c8-a6c76dfb7bd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd452c4f1c0ac4646ac7869552de56b96'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:43.218736 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1167/2360] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:11:43 2022] DELETE /identity/v3/users/d452c4f1c0ac4646ac7869552de56b96 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:11:43.400499 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540e106-c941-4602-9ea7-3b562e1ada2f service cinder] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:43.416701 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540e106-c941-4602-9ea7-3b562e1ada2f service cinder] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:43.476274 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8d27f-665a-4e35-81ad-b139f98c22c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:43.477132 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8d27f-665a-4e35-81ad-b139f98c22c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:43.477406 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8d27f-665a-4e35-81ad-b139f98c22c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:43.478290 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8d27f-665a-4e35-81ad-b139f98c22c1 admin admin] PATH_INFO: `/v3/projects/e1e5d1d0e5ee459d9a29175e6dfae245` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:43.479463 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8d27f-665a-4e35-81ad-b139f98c22c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1e5d1d0e5ee459d9a29175e6dfae245)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:43.481415 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8d27f-665a-4e35-81ad-b139f98c22c1 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:43.528333 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-f7a8d27f-665a-4e35-81ad-b139f98c22c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1e5d1d0e5ee459d9a29175e6dfae245', 'request_id': 'req-f7a8d27f-665a-4e35-81ad-b139f98c22c1'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:43.537243 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-f7a8d27f-665a-4e35-81ad-b139f98c22c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1e5d1d0e5ee459d9a29175e6dfae245', 'request_id': 'req-f7a8d27f-665a-4e35-81ad-b139f98c22c1'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:43.543824 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-f7a8d27f-665a-4e35-81ad-b139f98c22c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1e5d1d0e5ee459d9a29175e6dfae245', 'request_id': 'req-f7a8d27f-665a-4e35-81ad-b139f98c22c1'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:43.553867 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-f7a8d27f-665a-4e35-81ad-b139f98c22c1 admin admin] The token cache is being invalidate because project e1e5d1d0e5ee459d9a29175e6dfae245 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:11:43.554139 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-f7a8d27f-665a-4e35-81ad-b139f98c22c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:43.554767 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-f7a8d27f-665a-4e35-81ad-b139f98c22c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:43.556367 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1194/2361] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:11:43 2022] DELETE /identity/v3/projects/e1e5d1d0e5ee459d9a29175e6dfae245 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:11:43.561724 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e522b-6223-4cf7-9769-e5e1bbed61a1 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:43.562033 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e522b-6223-4cf7-9769-e5e1bbed61a1 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:43.562310 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e522b-6223-4cf7-9769-e5e1bbed61a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:43.581897 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-0b2e522b-6223-4cf7-9769-e5e1bbed61a1 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:11:43.583091 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-0b2e522b-6223-4cf7-9769-e5e1bbed61a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:43.643792 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1168/2362] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:11:43.660412 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa960e77-175b-4ad0-b00b-2f5ed78ab9c4 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:43.660412 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa960e77-175b-4ad0-b00b-2f5ed78ab9c4 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:43.660412 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa960e77-175b-4ad0-b00b-2f5ed78ab9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:43.679428 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-aa960e77-175b-4ad0-b00b-2f5ed78ab9c4 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:11:43.680681 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-aa960e77-175b-4ad0-b00b-2f5ed78ab9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:43.689308 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1195/2363] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:11:43.694009 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e522b-6223-4cf7-9769-e5e1bbed61a1 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:43.704191 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e522b-6223-4cf7-9769-e5e1bbed61a1 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:43.709387 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6dcb84-abf5-462f-8752-3291317d38b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:43.710050 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6dcb84-abf5-462f-8752-3291317d38b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:43.710322 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6dcb84-abf5-462f-8752-3291317d38b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:43.710584 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6dcb84-abf5-462f-8752-3291317d38b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:43.711300 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6dcb84-abf5-462f-8752-3291317d38b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:11:43.711598 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6dcb84-abf5-462f-8752-3291317d38b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:43.713286 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6dcb84-abf5-462f-8752-3291317d38b8 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:43.725322 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1169/2364] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:11:43.729801 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa960e77-175b-4ad0-b00b-2f5ed78ab9c4 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:43.739068 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa960e77-175b-4ad0-b00b-2f5ed78ab9c4 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:43.743983 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1653b-efb5-4b90-9047-91783818ff4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:43.744630 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1653b-efb5-4b90-9047-91783818ff4d admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:43.744900 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1653b-efb5-4b90-9047-91783818ff4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:43.745162 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1653b-efb5-4b90-9047-91783818ff4d admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:43.745942 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1653b-efb5-4b90-9047-91783818ff4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:43.751099 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1653b-efb5-4b90-9047-91783818ff4d admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:43.783936 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1196/2365] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:11:43 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:11:43.788064 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6dcb84-abf5-462f-8752-3291317d38b8 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:43.798849 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6dcb84-abf5-462f-8752-3291317d38b8 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:43.864319 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2bf05-9ab0-4545-8608-8954ae7d35c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:43.865145 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2bf05-9ab0-4545-8608-8954ae7d35c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:43.865485 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2bf05-9ab0-4545-8608-8954ae7d35c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:43.865819 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2bf05-9ab0-4545-8608-8954ae7d35c2 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:43.866672 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c2bf05-9ab0-4545-8608-8954ae7d35c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:43.875423 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c2bf05-9ab0-4545-8608-8954ae7d35c2 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:43.891263 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1170/2366] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:11:43 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:11:43.895399 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1653b-efb5-4b90-9047-91783818ff4d admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:43.905827 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1653b-efb5-4b90-9047-91783818ff4d admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:43.910701 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d4776-b107-4e21-8c2e-8e32397c591e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:43.911370 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d4776-b107-4e21-8c2e-8e32397c591e admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:43.911641 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d4776-b107-4e21-8c2e-8e32397c591e admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:43.911961 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d4776-b107-4e21-8c2e-8e32397c591e admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:43.912726 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d4776-b107-4e21-8c2e-8e32397c591e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:43.914282 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d4776-b107-4e21-8c2e-8e32397c591e admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:43.925476 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1197/2367] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:11:43.929364 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2bf05-9ab0-4545-8608-8954ae7d35c2 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:43.941022 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2bf05-9ab0-4545-8608-8954ae7d35c2 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:43.946483 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd810b-0ec0-405d-9d53-4f646ee3723e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:43.947142 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd810b-0ec0-405d-9d53-4f646ee3723e admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:43.947408 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd810b-0ec0-405d-9d53-4f646ee3723e admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:43.947671 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd810b-0ec0-405d-9d53-4f646ee3723e admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:43.948424 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd810b-0ec0-405d-9d53-4f646ee3723e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:43.950380 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd810b-0ec0-405d-9d53-4f646ee3723e admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:43.961019 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1171/2368] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:11:43.967983 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d4776-b107-4e21-8c2e-8e32397c591e admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:43.983111 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d4776-b107-4e21-8c2e-8e32397c591e admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:43.990047 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3eba7e-ffeb-447d-ad95-65a57c01f1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:43.990937 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3eba7e-ffeb-447d-ad95-65a57c01f1be admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:43.991204 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3eba7e-ffeb-447d-ad95-65a57c01f1be admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:43.991477 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3eba7e-ffeb-447d-ad95-65a57c01f1be admin admin] PATH_INFO: `/v3/projects/a17aa7efaeee465eae5de9b3566db031/users/28bcf75b3e5b4a36a38078db957ad568/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:44.006483 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3eba7e-ffeb-447d-ad95-65a57c01f1be admin admin] RBAC: Authorizing `identity:create_grant(project_id=a17aa7efaeee465eae5de9b3566db031, user_id=28bcf75b3e5b4a36a38078db957ad568, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:44.009183 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3eba7e-ffeb-447d-ad95-65a57c01f1be admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:44.023035 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1198/2369] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:11:43 2022] PUT /identity/v3/projects/a17aa7efaeee465eae5de9b3566db031/users/28bcf75b3e5b4a36a38078db957ad568/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:11:44.034196 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320df08c-e785-48b3-b844-13f9cae48b16 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:44.034414 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320df08c-e785-48b3-b844-13f9cae48b16 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:44.034686 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320df08c-e785-48b3-b844-13f9cae48b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:44.063134 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-320df08c-e785-48b3-b844-13f9cae48b16 None None] MFA Rules not processed for user `28bcf75b3e5b4a36a38078db957ad568`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:11:44.064368 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-320df08c-e785-48b3-b844-13f9cae48b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:44.272961 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1172/2370] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:11:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:11:44.284551 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3eba7e-ffeb-447d-ad95-65a57c01f1be admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:44.286342 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-4e3eba7e-ffeb-447d-ad95-65a57c01f1be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:44.367837 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3eba7e-ffeb-447d-ad95-65a57c01f1be admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:44.374771 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be21d2-58de-41be-a970-62fcd9a85adb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:44.375443 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be21d2-58de-41be-a970-62fcd9a85adb service nova] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:44.375759 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be21d2-58de-41be-a970-62fcd9a85adb service nova] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:44.376026 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be21d2-58de-41be-a970-62fcd9a85adb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:44.384745 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be21d2-58de-41be-a970-62fcd9a85adb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:44.386364 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be21d2-58de-41be-a970-62fcd9a85adb service nova] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:44.395547 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1199/2371] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:11:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:11:56.227584 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320df08c-e785-48b3-b844-13f9cae48b16 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:56.229432 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-320df08c-e785-48b3-b844-13f9cae48b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:56.294362 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320df08c-e785-48b3-b844-13f9cae48b16 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:56.300312 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5e440-6375-461c-8948-639bbdf120c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:56.301178 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5e440-6375-461c-8948-639bbdf120c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:56.301444 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5e440-6375-461c-8948-639bbdf120c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:56.301704 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5e440-6375-461c-8948-639bbdf120c8 admin admin] PATH_INFO: `/v3/users/9b31c8b395724f588dc3f8797ec4255e` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:56.302985 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5e440-6375-461c-8948-639bbdf120c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b31c8b395724f588dc3f8797ec4255e)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:56.304932 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5e440-6375-461c-8948-639bbdf120c8 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:56.354577 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-78a5e440-6375-461c-8948-639bbdf120c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b31c8b395724f588dc3f8797ec4255e'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:56.355269 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-78a5e440-6375-461c-8948-639bbdf120c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b31c8b395724f588dc3f8797ec4255e'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:56.366926 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-78a5e440-6375-461c-8948-639bbdf120c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b31c8b395724f588dc3f8797ec4255e'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:56.367635 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-78a5e440-6375-461c-8948-639bbdf120c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b31c8b395724f588dc3f8797ec4255e'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:56.374555 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-78a5e440-6375-461c-8948-639bbdf120c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b31c8b395724f588dc3f8797ec4255e'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:56.388155 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1173/2372] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:11:56 2022] DELETE /identity/v3/users/9b31c8b395724f588dc3f8797ec4255e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:11:56.392706 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b3413-fc90-42c7-a997-96d18f4a69eb None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:56.393204 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b3413-fc90-42c7-a997-96d18f4a69eb None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:56.393204 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b3413-fc90-42c7-a997-96d18f4a69eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:56.411390 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-f68b3413-fc90-42c7-a997-96d18f4a69eb None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:11:56.412687 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-f68b3413-fc90-42c7-a997-96d18f4a69eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:56.493667 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1200/2373] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:11:56.504427 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5e440-6375-461c-8948-639bbdf120c8 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:56.506509 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-78a5e440-6375-461c-8948-639bbdf120c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:56.565299 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5e440-6375-461c-8948-639bbdf120c8 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:56.569827 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba65617-16e1-44f0-82e5-c2d84b427728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:56.570516 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba65617-16e1-44f0-82e5-c2d84b427728 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:56.570805 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba65617-16e1-44f0-82e5-c2d84b427728 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:56.571074 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba65617-16e1-44f0-82e5-c2d84b427728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:56.581473 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba65617-16e1-44f0-82e5-c2d84b427728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:56.582993 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba65617-16e1-44f0-82e5-c2d84b427728 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:56.593246 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1174/2374] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:11:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:11:56.871808 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b3413-fc90-42c7-a997-96d18f4a69eb None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:56.873225 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-f68b3413-fc90-42c7-a997-96d18f4a69eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:56.890377 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b3413-fc90-42c7-a997-96d18f4a69eb None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:56.896947 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705f226-2541-4f9d-a57c-a0ee69225158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:56.897824 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705f226-2541-4f9d-a57c-a0ee69225158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:56.898193 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705f226-2541-4f9d-a57c-a0ee69225158 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:56.898621 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705f226-2541-4f9d-a57c-a0ee69225158 admin admin] PATH_INFO: `/v3/projects/c4c46b2874a74d80bd682ac65c39cf30` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:56.904927 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705f226-2541-4f9d-a57c-a0ee69225158 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4c46b2874a74d80bd682ac65c39cf30)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:56.906877 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705f226-2541-4f9d-a57c-a0ee69225158 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:56.953627 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-c705f226-2541-4f9d-a57c-a0ee69225158 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4c46b2874a74d80bd682ac65c39cf30', 'request_id': 'req-c705f226-2541-4f9d-a57c-a0ee69225158'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:56.961731 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-c705f226-2541-4f9d-a57c-a0ee69225158 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4c46b2874a74d80bd682ac65c39cf30', 'request_id': 'req-c705f226-2541-4f9d-a57c-a0ee69225158'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:56.971046 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-c705f226-2541-4f9d-a57c-a0ee69225158 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4c46b2874a74d80bd682ac65c39cf30', 'request_id': 'req-c705f226-2541-4f9d-a57c-a0ee69225158'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:56.983015 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-c705f226-2541-4f9d-a57c-a0ee69225158 admin admin] The token cache is being invalidate because project c4c46b2874a74d80bd682ac65c39cf30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:11:56.983297 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-c705f226-2541-4f9d-a57c-a0ee69225158 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:56.983942 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-c705f226-2541-4f9d-a57c-a0ee69225158 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:56.985479 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1201/2375] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:11:56 2022] DELETE /identity/v3/projects/c4c46b2874a74d80bd682ac65c39cf30 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:11:56.989473 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba65617-16e1-44f0-82e5-c2d84b427728 service neutron] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:56.999008 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba65617-16e1-44f0-82e5-c2d84b427728 service neutron] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:57.052798 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea95e89-793a-4486-b316-72af31071a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:57.053665 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea95e89-793a-4486-b316-72af31071a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:57.053999 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea95e89-793a-4486-b316-72af31071a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:57.054182 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea95e89-793a-4486-b316-72af31071a28 admin admin] PATH_INFO: `/v3/users/57ab04c81bcd4b1393e10cb418d7fa52` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:57.056386 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea95e89-793a-4486-b316-72af31071a28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57ab04c81bcd4b1393e10cb418d7fa52)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:57.057481 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea95e89-793a-4486-b316-72af31071a28 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:57.106858 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-eea95e89-793a-4486-b316-72af31071a28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57ab04c81bcd4b1393e10cb418d7fa52'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:57.107610 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-eea95e89-793a-4486-b316-72af31071a28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57ab04c81bcd4b1393e10cb418d7fa52'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:57.119408 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-eea95e89-793a-4486-b316-72af31071a28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57ab04c81bcd4b1393e10cb418d7fa52'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:57.120068 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-eea95e89-793a-4486-b316-72af31071a28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57ab04c81bcd4b1393e10cb418d7fa52'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:57.127152 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-eea95e89-793a-4486-b316-72af31071a28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57ab04c81bcd4b1393e10cb418d7fa52'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:57.141063 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1175/2376] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:11:56 2022] DELETE /identity/v3/users/57ab04c81bcd4b1393e10cb418d7fa52 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:11:57.432716 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705f226-2541-4f9d-a57c-a0ee69225158 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:57.434439 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-c705f226-2541-4f9d-a57c-a0ee69225158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:57.448565 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705f226-2541-4f9d-a57c-a0ee69225158 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:57.516048 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be90ae-9681-47ce-b0df-f79fd67d531c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:57.516833 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be90ae-9681-47ce-b0df-f79fd67d531c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:57.517300 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be90ae-9681-47ce-b0df-f79fd67d531c admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:57.517776 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be90ae-9681-47ce-b0df-f79fd67d531c admin admin] PATH_INFO: `/v3/projects/a26d77cf34a140698eadd126f0fbb82a` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:57.520963 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be90ae-9681-47ce-b0df-f79fd67d531c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a26d77cf34a140698eadd126f0fbb82a)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:57.522855 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be90ae-9681-47ce-b0df-f79fd67d531c admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:57.571134 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-62be90ae-9681-47ce-b0df-f79fd67d531c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a26d77cf34a140698eadd126f0fbb82a', 'request_id': 'req-62be90ae-9681-47ce-b0df-f79fd67d531c'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:57.580899 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-62be90ae-9681-47ce-b0df-f79fd67d531c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a26d77cf34a140698eadd126f0fbb82a', 'request_id': 'req-62be90ae-9681-47ce-b0df-f79fd67d531c'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:57.588261 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-62be90ae-9681-47ce-b0df-f79fd67d531c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a26d77cf34a140698eadd126f0fbb82a', 'request_id': 'req-62be90ae-9681-47ce-b0df-f79fd67d531c'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:57.601299 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-62be90ae-9681-47ce-b0df-f79fd67d531c admin admin] The token cache is being invalidate because project a26d77cf34a140698eadd126f0fbb82a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:11:57.601676 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-62be90ae-9681-47ce-b0df-f79fd67d531c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:57.602401 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-62be90ae-9681-47ce-b0df-f79fd67d531c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:57.604792 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1202/2377] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:11:57 2022] DELETE /identity/v3/projects/a26d77cf34a140698eadd126f0fbb82a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:11:57.609947 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de460fc-9414-4b3f-8f58-b3a163e06dbf None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:57.610395 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de460fc-9414-4b3f-8f58-b3a163e06dbf None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:57.610507 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de460fc-9414-4b3f-8f58-b3a163e06dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:57.628480 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-4de460fc-9414-4b3f-8f58-b3a163e06dbf None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:11:57.629640 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-4de460fc-9414-4b3f-8f58-b3a163e06dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:57.697911 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1176/2378] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:11:57.706284 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0ee47-42e2-4228-a0c6-98516862afe0 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:57.706564 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0ee47-42e2-4228-a0c6-98516862afe0 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:57.706831 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0ee47-42e2-4228-a0c6-98516862afe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:57.725295 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-8ca0ee47-42e2-4228-a0c6-98516862afe0 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:11:57.726507 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-8ca0ee47-42e2-4228-a0c6-98516862afe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:57.734958 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1203/2379] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:11:57.739272 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de460fc-9414-4b3f-8f58-b3a163e06dbf None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:57.749355 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de460fc-9414-4b3f-8f58-b3a163e06dbf None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:57.754885 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6435db-68c8-49e1-90f9-605ddaf4a53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:57.755534 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6435db-68c8-49e1-90f9-605ddaf4a53d admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:57.755842 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6435db-68c8-49e1-90f9-605ddaf4a53d admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:57.756145 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6435db-68c8-49e1-90f9-605ddaf4a53d admin admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:57.756859 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6435db-68c8-49e1-90f9-605ddaf4a53d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:11:57.757156 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6435db-68c8-49e1-90f9-605ddaf4a53d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:57.758976 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6435db-68c8-49e1-90f9-605ddaf4a53d admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:57.771114 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1177/2380] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:11:57.775542 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0ee47-42e2-4228-a0c6-98516862afe0 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:57.785681 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0ee47-42e2-4228-a0c6-98516862afe0 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:57.792308 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed9e79-b5e6-4d37-ae1a-4d14ff70a595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:57.792937 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed9e79-b5e6-4d37-ae1a-4d14ff70a595 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:57.793205 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed9e79-b5e6-4d37-ae1a-4d14ff70a595 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:57.793465 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed9e79-b5e6-4d37-ae1a-4d14ff70a595 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:57.794136 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed9e79-b5e6-4d37-ae1a-4d14ff70a595 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:57.796059 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed9e79-b5e6-4d37-ae1a-4d14ff70a595 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:57.822519 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1204/2381] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:11:57 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:11:57.826970 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6435db-68c8-49e1-90f9-605ddaf4a53d admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:57.836697 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6435db-68c8-49e1-90f9-605ddaf4a53d admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:57.893022 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da476e-5a68-4e72-88eb-fdfd01050908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:57.893637 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da476e-5a68-4e72-88eb-fdfd01050908 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:57.893948 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da476e-5a68-4e72-88eb-fdfd01050908 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:57.894362 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da476e-5a68-4e72-88eb-fdfd01050908 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:57.895042 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da476e-5a68-4e72-88eb-fdfd01050908 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:57.896995 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da476e-5a68-4e72-88eb-fdfd01050908 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:57.921173 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1178/2382] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:11:57 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:11:57.922502 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed9e79-b5e6-4d37-ae1a-4d14ff70a595 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:57.933029 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed9e79-b5e6-4d37-ae1a-4d14ff70a595 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:57.938001 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb26f0-9bd2-4997-9fbc-542d46e5a2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:57.938678 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb26f0-9bd2-4997-9fbc-542d46e5a2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:57.938937 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb26f0-9bd2-4997-9fbc-542d46e5a2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:57.939203 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb26f0-9bd2-4997-9fbc-542d46e5a2f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:57.939954 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb26f0-9bd2-4997-9fbc-542d46e5a2f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:57.941625 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb26f0-9bd2-4997-9fbc-542d46e5a2f3 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:57.954203 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1205/2383] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:11:57.958405 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da476e-5a68-4e72-88eb-fdfd01050908 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:57.969416 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da476e-5a68-4e72-88eb-fdfd01050908 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:57.975017 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92735ebb-99c3-4013-8141-b21eec3897f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:57.975674 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92735ebb-99c3-4013-8141-b21eec3897f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:57.975978 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92735ebb-99c3-4013-8141-b21eec3897f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:57.976238 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92735ebb-99c3-4013-8141-b21eec3897f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:57.976949 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92735ebb-99c3-4013-8141-b21eec3897f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:57.978535 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92735ebb-99c3-4013-8141-b21eec3897f6 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:57.991838 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1179/2384] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:11:57.994023 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb26f0-9bd2-4997-9fbc-542d46e5a2f3 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:58.004602 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb26f0-9bd2-4997-9fbc-542d46e5a2f3 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:58.009416 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f19ed-a3eb-4b76-9c9d-c27fa2b57c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:58.010287 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f19ed-a3eb-4b76-9c9d-c27fa2b57c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:58.010702 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f19ed-a3eb-4b76-9c9d-c27fa2b57c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:58.011116 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f19ed-a3eb-4b76-9c9d-c27fa2b57c70 admin admin] PATH_INFO: `/v3/projects/e40e3013ef0449bdbe39c7086b58ecf9/users/f9f7cd7308cc46c7811662755fdf1b9a/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:58.027940 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f19ed-a3eb-4b76-9c9d-c27fa2b57c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e40e3013ef0449bdbe39c7086b58ecf9, user_id=f9f7cd7308cc46c7811662755fdf1b9a, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:58.030578 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f19ed-a3eb-4b76-9c9d-c27fa2b57c70 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:58.047994 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1206/2385] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:11:57 2022] PUT /identity/v3/projects/e40e3013ef0449bdbe39c7086b58ecf9/users/f9f7cd7308cc46c7811662755fdf1b9a/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:11:58.058979 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93055f0b-8dea-4b2b-9513-4e28d38004e1 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:58.059269 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93055f0b-8dea-4b2b-9513-4e28d38004e1 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:58.059543 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93055f0b-8dea-4b2b-9513-4e28d38004e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:58.088359 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-93055f0b-8dea-4b2b-9513-4e28d38004e1 None None] MFA Rules not processed for user `f9f7cd7308cc46c7811662755fdf1b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:11:58.089851 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-93055f0b-8dea-4b2b-9513-4e28d38004e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:58.163265 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1180/2386] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:11:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:11:58.168737 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f19ed-a3eb-4b76-9c9d-c27fa2b57c70 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:58.239325 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f19ed-a3eb-4b76-9c9d-c27fa2b57c70 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:58.245485 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754c10a-74c7-4aee-8a74-1c3842d3442f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:58.246360 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754c10a-74c7-4aee-8a74-1c3842d3442f admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:58.246632 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754c10a-74c7-4aee-8a74-1c3842d3442f admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:58.246915 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754c10a-74c7-4aee-8a74-1c3842d3442f admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:58.247755 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b754c10a-74c7-4aee-8a74-1c3842d3442f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:58.250410 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b754c10a-74c7-4aee-8a74-1c3842d3442f admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:58.279049 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1207/2387] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:11:58 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:11:58.286412 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93055f0b-8dea-4b2b-9513-4e28d38004e1 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:58.297440 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93055f0b-8dea-4b2b-9513-4e28d38004e1 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:58.360603 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa55ab2-ac18-48cd-8dc5-11b6eea98a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:58.361283 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa55ab2-ac18-48cd-8dc5-11b6eea98a6b admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:58.361559 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa55ab2-ac18-48cd-8dc5-11b6eea98a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:58.361827 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa55ab2-ac18-48cd-8dc5-11b6eea98a6b admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:58.362532 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa55ab2-ac18-48cd-8dc5-11b6eea98a6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:58.364535 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa55ab2-ac18-48cd-8dc5-11b6eea98a6b admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:58.386136 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1181/2388] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:11:58 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:11:58.390553 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754c10a-74c7-4aee-8a74-1c3842d3442f admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:58.401365 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754c10a-74c7-4aee-8a74-1c3842d3442f admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:58.406335 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efce33-b623-4a88-9adf-408fbde51b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:58.406998 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efce33-b623-4a88-9adf-408fbde51b23 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:58.407269 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efce33-b623-4a88-9adf-408fbde51b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:58.407530 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efce33-b623-4a88-9adf-408fbde51b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:58.408300 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efce33-b623-4a88-9adf-408fbde51b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:58.409911 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efce33-b623-4a88-9adf-408fbde51b23 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:58.422827 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1208/2389] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:11:58.427170 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa55ab2-ac18-48cd-8dc5-11b6eea98a6b admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:58.437814 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa55ab2-ac18-48cd-8dc5-11b6eea98a6b admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:58.443305 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17555779-db99-4cbf-936c-2dfe5401ca80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:58.444255 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17555779-db99-4cbf-936c-2dfe5401ca80 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:58.444530 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17555779-db99-4cbf-936c-2dfe5401ca80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:58.444795 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17555779-db99-4cbf-936c-2dfe5401ca80 admin admin] PATH_INFO: `/v3/projects/6b00b527a9324ea392f11c168b27b53a/users/7528d631e8814254ab085c6be50b9b29/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:58.460893 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17555779-db99-4cbf-936c-2dfe5401ca80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b00b527a9324ea392f11c168b27b53a, user_id=7528d631e8814254ab085c6be50b9b29, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:58.463797 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17555779-db99-4cbf-936c-2dfe5401ca80 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:58.478862 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1182/2390] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:11:58 2022] PUT /identity/v3/projects/6b00b527a9324ea392f11c168b27b53a/users/7528d631e8814254ab085c6be50b9b29/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:11:58.483609 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efce33-b623-4a88-9adf-408fbde51b23 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:58.494118 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efce33-b623-4a88-9adf-408fbde51b23 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:58.550527 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3581ef7-8648-4532-b466-83d64512110c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:58.551113 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3581ef7-8648-4532-b466-83d64512110c admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:58.551388 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3581ef7-8648-4532-b466-83d64512110c admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:58.551680 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3581ef7-8648-4532-b466-83d64512110c admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:58.552409 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3581ef7-8648-4532-b466-83d64512110c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:58.554002 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3581ef7-8648-4532-b466-83d64512110c admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:58.563775 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1209/2391] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:11:58.568077 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17555779-db99-4cbf-936c-2dfe5401ca80 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:58.578817 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17555779-db99-4cbf-936c-2dfe5401ca80 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:58.583920 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825b2a2-3ae4-4146-a48b-a864267e2258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:58.584801 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825b2a2-3ae4-4146-a48b-a864267e2258 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:58.585081 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825b2a2-3ae4-4146-a48b-a864267e2258 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:58.585342 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825b2a2-3ae4-4146-a48b-a864267e2258 admin admin] PATH_INFO: `/v3/projects/6b00b527a9324ea392f11c168b27b53a/users/7528d631e8814254ab085c6be50b9b29/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:58.587311 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825b2a2-3ae4-4146-a48b-a864267e2258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b00b527a9324ea392f11c168b27b53a, user_id=7528d631e8814254ab085c6be50b9b29, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:58.590046 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825b2a2-3ae4-4146-a48b-a864267e2258 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:58.600797 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1183/2392] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:11:58 2022] PUT /identity/v3/projects/6b00b527a9324ea392f11c168b27b53a/users/7528d631e8814254ab085c6be50b9b29/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:11:58.612371 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42795da-5699-435f-a80f-f60555bf9cb1 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:58.612640 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42795da-5699-435f-a80f-f60555bf9cb1 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:58.612913 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42795da-5699-435f-a80f-f60555bf9cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:58.642748 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-f42795da-5699-435f-a80f-f60555bf9cb1 None None] MFA Rules not processed for user `7528d631e8814254ab085c6be50b9b29`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:11:58.643993 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-f42795da-5699-435f-a80f-f60555bf9cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:58.725403 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1210/2393] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:11:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:11:58.736902 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825b2a2-3ae4-4146-a48b-a864267e2258 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:58.738939 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-9825b2a2-3ae4-4146-a48b-a864267e2258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:58.796613 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825b2a2-3ae4-4146-a48b-a864267e2258 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:58.800958 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63eebeb-e2d1-4638-b2a1-8dd9a8e976c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:58.801520 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63eebeb-e2d1-4638-b2a1-8dd9a8e976c9 service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:58.801787 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63eebeb-e2d1-4638-b2a1-8dd9a8e976c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:58.802058 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63eebeb-e2d1-4638-b2a1-8dd9a8e976c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:58.812170 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63eebeb-e2d1-4638-b2a1-8dd9a8e976c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:58.813628 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63eebeb-e2d1-4638-b2a1-8dd9a8e976c9 service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:58.822907 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1184/2394] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:11:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:11:59.094724 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42795da-5699-435f-a80f-f60555bf9cb1 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:59.096569 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-f42795da-5699-435f-a80f-f60555bf9cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:59.097875 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63eebeb-e2d1-4638-b2a1-8dd9a8e976c9 service cinder] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:59.099490 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-e63eebeb-e2d1-4638-b2a1-8dd9a8e976c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:59.158552 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63eebeb-e2d1-4638-b2a1-8dd9a8e976c9 service cinder] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:59.162275 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592fadda-f1e7-4836-83dd-5bb0e2151af4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:59.162940 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fadda-f1e7-4836-83dd-5bb0e2151af4 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:59.166836 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fadda-f1e7-4836-83dd-5bb0e2151af4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:59.166836 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fadda-f1e7-4836-83dd-5bb0e2151af4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:59.167885 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42795da-5699-435f-a80f-f60555bf9cb1 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:59.169754 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-592fadda-f1e7-4836-83dd-5bb0e2151af4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:59.172897 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2b7b3-0488-47b5-b009-14b92d7573a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:59.174195 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2b7b3-0488-47b5-b009-14b92d7573a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:59.174543 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2b7b3-0488-47b5-b009-14b92d7573a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:59.174878 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2b7b3-0488-47b5-b009-14b92d7573a4 admin admin] PATH_INFO: `/v3/users/28bcf75b3e5b4a36a38078db957ad568` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:59.176142 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2b7b3-0488-47b5-b009-14b92d7573a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28bcf75b3e5b4a36a38078db957ad568)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:59.178114 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2b7b3-0488-47b5-b009-14b92d7573a4 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:59.182997 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592fadda-f1e7-4836-83dd-5bb0e2151af4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:59.184738 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592fadda-f1e7-4836-83dd-5bb0e2151af4 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:59.196074 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1185/2395] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:11:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 03:11:59.226645 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592fadda-f1e7-4836-83dd-5bb0e2151af4 service neutron] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:59.237246 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592fadda-f1e7-4836-83dd-5bb0e2151af4 service neutron] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:59.239190 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-2cf2b7b3-0488-47b5-b009-14b92d7573a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28bcf75b3e5b4a36a38078db957ad568'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:59.241955 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1215d1-4232-47b3-93c0-31257647f710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:59.242842 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1215d1-4232-47b3-93c0-31257647f710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:59.243112 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1215d1-4232-47b3-93c0-31257647f710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:59.243380 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1215d1-4232-47b3-93c0-31257647f710 admin admin] PATH_INFO: `/v3/users/f9f7cd7308cc46c7811662755fdf1b9a` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:59.244791 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1215d1-4232-47b3-93c0-31257647f710 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9f7cd7308cc46c7811662755fdf1b9a)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:59.246984 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1215d1-4232-47b3-93c0-31257647f710 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:59.249527 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-2cf2b7b3-0488-47b5-b009-14b92d7573a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28bcf75b3e5b4a36a38078db957ad568'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:59.250410 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-2cf2b7b3-0488-47b5-b009-14b92d7573a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28bcf75b3e5b4a36a38078db957ad568'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:59.251102 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-2cf2b7b3-0488-47b5-b009-14b92d7573a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28bcf75b3e5b4a36a38078db957ad568'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:59.264320 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-2cf2b7b3-0488-47b5-b009-14b92d7573a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28bcf75b3e5b4a36a38078db957ad568'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:59.278172 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1211/2396] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:11:59 2022] DELETE /identity/v3/users/28bcf75b3e5b4a36a38078db957ad568 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:11:59.283131 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c3bf2-9799-4ea1-8666-2362f9f51f5e None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:59.283623 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c3bf2-9799-4ea1-8666-2362f9f51f5e None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:59.283936 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c3bf2-9799-4ea1-8666-2362f9f51f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:59.304498 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-5c1215d1-4232-47b3-93c0-31257647f710 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9f7cd7308cc46c7811662755fdf1b9a'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:59.305255 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-5c1215d1-4232-47b3-93c0-31257647f710 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9f7cd7308cc46c7811662755fdf1b9a'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:59.309394 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-0f5c3bf2-9799-4ea1-8666-2362f9f51f5e None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:11:59.312950 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-0f5c3bf2-9799-4ea1-8666-2362f9f51f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:59.319095 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-5c1215d1-4232-47b3-93c0-31257647f710 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9f7cd7308cc46c7811662755fdf1b9a'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:59.320038 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-5c1215d1-4232-47b3-93c0-31257647f710 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9f7cd7308cc46c7811662755fdf1b9a'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:59.328335 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-5c1215d1-4232-47b3-93c0-31257647f710 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9f7cd7308cc46c7811662755fdf1b9a'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:11:59.358853 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1186/2397] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:11:59 2022] DELETE /identity/v3/users/f9f7cd7308cc46c7811662755fdf1b9a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:11:59.360448 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008e363-70c6-44a9-a59f-adcb1da7e4db None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:59.360799 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008e363-70c6-44a9-a59f-adcb1da7e4db None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:59.361137 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008e363-70c6-44a9-a59f-adcb1da7e4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:59.384105 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-5008e363-70c6-44a9-a59f-adcb1da7e4db None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:11:59.386207 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-5008e363-70c6-44a9-a59f-adcb1da7e4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:59.392387 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1212/2398] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:11:59.400007 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c3bf2-9799-4ea1-8666-2362f9f51f5e None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:59.401811 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-0f5c3bf2-9799-4ea1-8666-2362f9f51f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:11:59.463072 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1187/2399] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:11:59.465504 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c3bf2-9799-4ea1-8666-2362f9f51f5e None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:59.475548 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008e363-70c6-44a9-a59f-adcb1da7e4db None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:11:59.548312 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18343bd8-5b88-46e5-a735-fa2829009a8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:59.549067 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18343bd8-5b88-46e5-a735-fa2829009a8e service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:59.549351 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18343bd8-5b88-46e5-a735-fa2829009a8e service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:59.549765 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18343bd8-5b88-46e5-a735-fa2829009a8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:59.557474 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008e363-70c6-44a9-a59f-adcb1da7e4db None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:11:59.560324 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18343bd8-5b88-46e5-a735-fa2829009a8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:59.561297 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590d839-4a22-450d-a5ef-7eaa559063ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:11:59.561771 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18343bd8-5b88-46e5-a735-fa2829009a8e service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:59.561960 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590d839-4a22-450d-a5ef-7eaa559063ed service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:11:59.562204 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590d839-4a22-450d-a5ef-7eaa559063ed service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:11:59.562468 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590d839-4a22-450d-a5ef-7eaa559063ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:11:59.571791 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1213/2400] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:11:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 03:11:59.572954 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b590d839-4a22-450d-a5ef-7eaa559063ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:11:59.574566 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b590d839-4a22-450d-a5ef-7eaa559063ed service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:11:59.585210 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1188/2401] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:11:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:12:00.147360 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18343bd8-5b88-46e5-a735-fa2829009a8e service neutron] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:00.148870 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-18343bd8-5b88-46e5-a735-fa2829009a8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:00.154136 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590d839-4a22-450d-a5ef-7eaa559063ed service neutron] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:00.155634 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-b590d839-4a22-450d-a5ef-7eaa559063ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:00.163602 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18343bd8-5b88-46e5-a735-fa2829009a8e service neutron] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:00.170046 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb9502-83af-40e2-a8a5-cc9f6b9530fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:00.171162 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb9502-83af-40e2-a8a5-cc9f6b9530fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:00.171162 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb9502-83af-40e2-a8a5-cc9f6b9530fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:00.171457 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb9502-83af-40e2-a8a5-cc9f6b9530fa admin admin] PATH_INFO: `/v3/projects/e40e3013ef0449bdbe39c7086b58ecf9` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:00.172792 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb9502-83af-40e2-a8a5-cc9f6b9530fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e40e3013ef0449bdbe39c7086b58ecf9)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:00.173579 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590d839-4a22-450d-a5ef-7eaa559063ed service neutron] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:00.174722 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb9502-83af-40e2-a8a5-cc9f6b9530fa admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:00.183373 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890bcce-c5b8-4525-a46a-6cd23411799e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:00.196644 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890bcce-c5b8-4525-a46a-6cd23411799e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:00.197442 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890bcce-c5b8-4525-a46a-6cd23411799e admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:00.197800 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890bcce-c5b8-4525-a46a-6cd23411799e admin admin] PATH_INFO: `/v3/projects/a17aa7efaeee465eae5de9b3566db031` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:00.201245 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890bcce-c5b8-4525-a46a-6cd23411799e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a17aa7efaeee465eae5de9b3566db031)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:00.210031 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890bcce-c5b8-4525-a46a-6cd23411799e admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:00.243352 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-7dbb9502-83af-40e2-a8a5-cc9f6b9530fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e40e3013ef0449bdbe39c7086b58ecf9', 'request_id': 'req-7dbb9502-83af-40e2-a8a5-cc9f6b9530fa'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:00.252558 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-7dbb9502-83af-40e2-a8a5-cc9f6b9530fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e40e3013ef0449bdbe39c7086b58ecf9', 'request_id': 'req-7dbb9502-83af-40e2-a8a5-cc9f6b9530fa'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:00.259762 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-7dbb9502-83af-40e2-a8a5-cc9f6b9530fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e40e3013ef0449bdbe39c7086b58ecf9', 'request_id': 'req-7dbb9502-83af-40e2-a8a5-cc9f6b9530fa'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:00.271083 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-5890bcce-c5b8-4525-a46a-6cd23411799e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a17aa7efaeee465eae5de9b3566db031', 'request_id': 'req-5890bcce-c5b8-4525-a46a-6cd23411799e'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:00.271587 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-7dbb9502-83af-40e2-a8a5-cc9f6b9530fa admin admin] The token cache is being invalidate because project e40e3013ef0449bdbe39c7086b58ecf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:12:00.271892 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-7dbb9502-83af-40e2-a8a5-cc9f6b9530fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:00.272537 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-7dbb9502-83af-40e2-a8a5-cc9f6b9530fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:00.274098 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1214/2402] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:12:00 2022] DELETE /identity/v3/projects/e40e3013ef0449bdbe39c7086b58ecf9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:00.278138 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb9502-83af-40e2-a8a5-cc9f6b9530fa admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:00.279542 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-7dbb9502-83af-40e2-a8a5-cc9f6b9530fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:00.280265 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-5890bcce-c5b8-4525-a46a-6cd23411799e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a17aa7efaeee465eae5de9b3566db031', 'request_id': 'req-5890bcce-c5b8-4525-a46a-6cd23411799e'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:00.288103 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-5890bcce-c5b8-4525-a46a-6cd23411799e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a17aa7efaeee465eae5de9b3566db031', 'request_id': 'req-5890bcce-c5b8-4525-a46a-6cd23411799e'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:00.301798 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-5890bcce-c5b8-4525-a46a-6cd23411799e admin admin] The token cache is being invalidate because project a17aa7efaeee465eae5de9b3566db031 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:12:00.302217 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-5890bcce-c5b8-4525-a46a-6cd23411799e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:00.302967 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-5890bcce-c5b8-4525-a46a-6cd23411799e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:00.304995 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1189/2403] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:12:00 2022] DELETE /identity/v3/projects/a17aa7efaeee465eae5de9b3566db031 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:00.309668 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aebd23-a379-4993-9121-3d723c8271f4 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:00.310146 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aebd23-a379-4993-9121-3d723c8271f4 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:00.310514 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aebd23-a379-4993-9121-3d723c8271f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:00.330659 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-65aebd23-a379-4993-9121-3d723c8271f4 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:00.331947 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-65aebd23-a379-4993-9121-3d723c8271f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:00.348906 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb9502-83af-40e2-a8a5-cc9f6b9530fa admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:00.395601 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1190/2404] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:12:00.404095 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142d711-517a-458c-af9b-d23e274a672e None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:00.404424 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142d711-517a-458c-af9b-d23e274a672e None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:00.404816 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142d711-517a-458c-af9b-d23e274a672e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:00.420343 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b9078-b987-4928-bfaa-b5c82682ec3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:00.421814 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b9078-b987-4928-bfaa-b5c82682ec3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:00.422267 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b9078-b987-4928-bfaa-b5c82682ec3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:00.422918 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b9078-b987-4928-bfaa-b5c82682ec3e admin admin] PATH_INFO: `/v3/users/7528d631e8814254ab085c6be50b9b29` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:00.424477 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b9078-b987-4928-bfaa-b5c82682ec3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7528d631e8814254ab085c6be50b9b29)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:00.425765 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-2142d711-517a-458c-af9b-d23e274a672e None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:00.426980 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-2142d711-517a-458c-af9b-d23e274a672e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:00.427953 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b9078-b987-4928-bfaa-b5c82682ec3e admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:00.439858 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1191/2405] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:00.440830 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142d711-517a-458c-af9b-d23e274a672e None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:00.451765 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142d711-517a-458c-af9b-d23e274a672e None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:00.457432 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c85c32-7360-41df-a390-f4e62dd04038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:00.459044 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c85c32-7360-41df-a390-f4e62dd04038 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:00.459044 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c85c32-7360-41df-a390-f4e62dd04038 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:00.459322 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c85c32-7360-41df-a390-f4e62dd04038 admin admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:00.460118 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c85c32-7360-41df-a390-f4e62dd04038 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:12:00.460559 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c85c32-7360-41df-a390-f4e62dd04038 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:00.462716 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c85c32-7360-41df-a390-f4e62dd04038 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:00.478777 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1192/2406] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:12:00.483683 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c85c32-7360-41df-a390-f4e62dd04038 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:00.488928 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-908b9078-b987-4928-bfaa-b5c82682ec3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7528d631e8814254ab085c6be50b9b29'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:00.494765 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c85c32-7360-41df-a390-f4e62dd04038 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:00.499739 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc905ab-0de6-42a5-bb69-41c4e7300a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:00.500154 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-908b9078-b987-4928-bfaa-b5c82682ec3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7528d631e8814254ab085c6be50b9b29'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:00.500530 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc905ab-0de6-42a5-bb69-41c4e7300a1f admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:00.500863 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc905ab-0de6-42a5-bb69-41c4e7300a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:00.501183 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc905ab-0de6-42a5-bb69-41c4e7300a1f admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:00.501481 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-908b9078-b987-4928-bfaa-b5c82682ec3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7528d631e8814254ab085c6be50b9b29'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:00.502005 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc905ab-0de6-42a5-bb69-41c4e7300a1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:00.502467 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-908b9078-b987-4928-bfaa-b5c82682ec3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7528d631e8814254ab085c6be50b9b29'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:00.504051 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc905ab-0de6-42a5-bb69-41c4e7300a1f admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:00.518993 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-908b9078-b987-4928-bfaa-b5c82682ec3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7528d631e8814254ab085c6be50b9b29'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:00.541616 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1215/2407] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:12:00 2022] DELETE /identity/v3/users/7528d631e8814254ab085c6be50b9b29 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:00.543240 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1193/2408] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:12:00 2022] POST /identity/v3/projects => generated 367 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 03:12:00.547369 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b9078-b987-4928-bfaa-b5c82682ec3e admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:00.548814 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-908b9078-b987-4928-bfaa-b5c82682ec3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:00.623640 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b9078-b987-4928-bfaa-b5c82682ec3e admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:00.684346 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495193d-a8a1-4992-bb3c-b5638521911a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:00.685097 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495193d-a8a1-4992-bb3c-b5638521911a admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:00.685737 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495193d-a8a1-4992-bb3c-b5638521911a admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:00.685737 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495193d-a8a1-4992-bb3c-b5638521911a admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:00.686555 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495193d-a8a1-4992-bb3c-b5638521911a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:00.689335 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495193d-a8a1-4992-bb3c-b5638521911a admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:00.721007 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1216/2409] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:12:00 2022] POST /identity/v3/users => generated 284 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:12:00.722865 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc905ab-0de6-42a5-bb69-41c4e7300a1f admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:00.733802 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc905ab-0de6-42a5-bb69-41c4e7300a1f admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:00.739419 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3666654-5b73-4145-8391-482a0ed32e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:00.740607 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3666654-5b73-4145-8391-482a0ed32e0f admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:00.741195 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3666654-5b73-4145-8391-482a0ed32e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:00.742122 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3666654-5b73-4145-8391-482a0ed32e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:00.742864 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3666654-5b73-4145-8391-482a0ed32e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:00.745095 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3666654-5b73-4145-8391-482a0ed32e0f admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:00.756126 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1194/2410] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:12:00.760734 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495193d-a8a1-4992-bb3c-b5638521911a admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:00.771228 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495193d-a8a1-4992-bb3c-b5638521911a admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:00.776199 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9f86b-1424-4884-8a0e-4b5b3ac57b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:00.777144 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9f86b-1424-4884-8a0e-4b5b3ac57b46 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:00.777581 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9f86b-1424-4884-8a0e-4b5b3ac57b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:00.777918 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9f86b-1424-4884-8a0e-4b5b3ac57b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:00.778709 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9f86b-1424-4884-8a0e-4b5b3ac57b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:00.780483 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9f86b-1424-4884-8a0e-4b5b3ac57b46 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:00.791010 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1217/2411] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:12:00.795758 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3666654-5b73-4145-8391-482a0ed32e0f admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:00.809113 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3666654-5b73-4145-8391-482a0ed32e0f admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:00.819145 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3aa075-25a3-4b9d-bcc8-23c322d2c4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:00.820457 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3aa075-25a3-4b9d-bcc8-23c322d2c4a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:00.820776 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3aa075-25a3-4b9d-bcc8-23c322d2c4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:00.821088 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3aa075-25a3-4b9d-bcc8-23c322d2c4a0 admin admin] PATH_INFO: `/v3/projects/775a43ee917247d19efce4b4abf9c021/users/6b25ff8c7eca4156a4755c83729be14e/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:00.842068 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9f86b-1424-4884-8a0e-4b5b3ac57b46 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:00.842520 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3aa075-25a3-4b9d-bcc8-23c322d2c4a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=775a43ee917247d19efce4b4abf9c021, user_id=6b25ff8c7eca4156a4755c83729be14e, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:00.843982 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-42e9f86b-1424-4884-8a0e-4b5b3ac57b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:00.846645 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3aa075-25a3-4b9d-bcc8-23c322d2c4a0 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:00.871395 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9f86b-1424-4884-8a0e-4b5b3ac57b46 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:00.880472 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1195/2412] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:12:00 2022] PUT /identity/v3/projects/775a43ee917247d19efce4b4abf9c021/users/6b25ff8c7eca4156a4755c83729be14e/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:12:00.885255 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9dc11-f648-4b6b-a559-b19e548114be None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:00.885579 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9dc11-f648-4b6b-a559-b19e548114be None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:00.885942 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9dc11-f648-4b6b-a559-b19e548114be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:00.912410 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-faa9dc11-f648-4b6b-a559-b19e548114be None None] MFA Rules not processed for user `6b25ff8c7eca4156a4755c83729be14e`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:00.913592 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-faa9dc11-f648-4b6b-a559-b19e548114be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:00.938343 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9f6b9-8f76-44d1-bb76-5035b5dd7b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:00.939420 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9f6b9-8f76-44d1-bb76-5035b5dd7b06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:00.939784 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9f6b9-8f76-44d1-bb76-5035b5dd7b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:00.940121 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9f6b9-8f76-44d1-bb76-5035b5dd7b06 admin admin] PATH_INFO: `/v3/projects/6b00b527a9324ea392f11c168b27b53a` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:00.941673 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9f6b9-8f76-44d1-bb76-5035b5dd7b06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b00b527a9324ea392f11c168b27b53a)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:00.943658 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9f6b9-8f76-44d1-bb76-5035b5dd7b06 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:00.999471 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1196/2413] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:00 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:01.000500 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-43e9f6b9-8f76-44d1-bb76-5035b5dd7b06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b00b527a9324ea392f11c168b27b53a', 'request_id': 'req-43e9f6b9-8f76-44d1-bb76-5035b5dd7b06'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:01.012978 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-43e9f6b9-8f76-44d1-bb76-5035b5dd7b06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b00b527a9324ea392f11c168b27b53a', 'request_id': 'req-43e9f6b9-8f76-44d1-bb76-5035b5dd7b06'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:01.014469 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9dc11-f648-4b6b-a559-b19e548114be None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:01.016452 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-faa9dc11-f648-4b6b-a559-b19e548114be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:01.020571 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-43e9f6b9-8f76-44d1-bb76-5035b5dd7b06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b00b527a9324ea392f11c168b27b53a', 'request_id': 'req-43e9f6b9-8f76-44d1-bb76-5035b5dd7b06'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:01.034351 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-43e9f6b9-8f76-44d1-bb76-5035b5dd7b06 admin admin] The token cache is being invalidate because project 6b00b527a9324ea392f11c168b27b53a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:12:01.034632 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-43e9f6b9-8f76-44d1-bb76-5035b5dd7b06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:01.036123 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-43e9f6b9-8f76-44d1-bb76-5035b5dd7b06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:01.038506 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1218/2414] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:12:00 2022] DELETE /identity/v3/projects/6b00b527a9324ea392f11c168b27b53a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:12:01.044457 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cb883-2e26-47e7-9ade-bdc9b2750279 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:01.045692 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cb883-2e26-47e7-9ade-bdc9b2750279 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:01.046144 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cb883-2e26-47e7-9ade-bdc9b2750279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:01.070503 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-b35cb883-2e26-47e7-9ade-bdc9b2750279 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:01.072573 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-b35cb883-2e26-47e7-9ade-bdc9b2750279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:01.091667 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9dc11-f648-4b6b-a559-b19e548114be None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:01.157188 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1219/2415] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:01.165468 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f3d80-8487-47e0-8b0b-4ecfd99db57c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:01.166033 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7c126-ea3b-4149-9227-46ce142484ef None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:01.166141 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7c126-ea3b-4149-9227-46ce142484ef None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:01.166395 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f3d80-8487-47e0-8b0b-4ecfd99db57c service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:01.166527 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7c126-ea3b-4149-9227-46ce142484ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:01.166910 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f3d80-8487-47e0-8b0b-4ecfd99db57c service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:01.167266 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f3d80-8487-47e0-8b0b-4ecfd99db57c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:01.169276 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-e01f3d80-8487-47e0-8b0b-4ecfd99db57c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:01.193001 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-ffd7c126-ea3b-4149-9227-46ce142484ef None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:01.195041 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-ffd7c126-ea3b-4149-9227-46ce142484ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:01.207824 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1220/2416] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:01.211555 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7c126-ea3b-4149-9227-46ce142484ef None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:01.222692 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7c126-ea3b-4149-9227-46ce142484ef None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:01.228210 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a666d9-3ded-4971-b2b8-81f4d4777a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:01.229069 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a666d9-3ded-4971-b2b8-81f4d4777a7d admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:01.229558 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a666d9-3ded-4971-b2b8-81f4d4777a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:01.229926 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a666d9-3ded-4971-b2b8-81f4d4777a7d admin admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:01.230887 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a666d9-3ded-4971-b2b8-81f4d4777a7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:12:01.231191 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a666d9-3ded-4971-b2b8-81f4d4777a7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:01.233025 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a666d9-3ded-4971-b2b8-81f4d4777a7d admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:01.240544 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f3d80-8487-47e0-8b0b-4ecfd99db57c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:01.242091 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f3d80-8487-47e0-8b0b-4ecfd99db57c service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:01.246421 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1221/2417] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:12:01.251633 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a666d9-3ded-4971-b2b8-81f4d4777a7d admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:01.258706 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1197/2418] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:12:01 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 03:12:01.267143 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a666d9-3ded-4971-b2b8-81f4d4777a7d admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:01.272533 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cd40a-10bc-406d-9164-84ee48a5f1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:01.273475 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cd40a-10bc-406d-9164-84ee48a5f1cd admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:01.273845 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cd40a-10bc-406d-9164-84ee48a5f1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:01.274211 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cd40a-10bc-406d-9164-84ee48a5f1cd admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:01.275026 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cd40a-10bc-406d-9164-84ee48a5f1cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:01.277721 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cd40a-10bc-406d-9164-84ee48a5f1cd admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:01.314619 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1222/2419] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:12:01 2022] POST /identity/v3/projects => generated 355 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:12:01.316660 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f3d80-8487-47e0-8b0b-4ecfd99db57c service cinder] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:01.332845 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f3d80-8487-47e0-8b0b-4ecfd99db57c service cinder] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:01.445572 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c79b4-faf3-4ac8-b340-9dd2996e4ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:01.446927 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c79b4-faf3-4ac8-b340-9dd2996e4ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:01.447274 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c79b4-faf3-4ac8-b340-9dd2996e4ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:01.447618 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c79b4-faf3-4ac8-b340-9dd2996e4ee3 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:01.448637 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c79b4-faf3-4ac8-b340-9dd2996e4ee3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:01.451813 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c79b4-faf3-4ac8-b340-9dd2996e4ee3 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:01.477171 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1198/2420] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:12:01 2022] POST /identity/v3/users => generated 278 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:12:01.482385 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cd40a-10bc-406d-9164-84ee48a5f1cd admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:01.496916 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cd40a-10bc-406d-9164-84ee48a5f1cd admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:01.503042 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e8c44-6b23-4927-8dd6-35de6a863885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:01.504600 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e8c44-6b23-4927-8dd6-35de6a863885 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:01.504890 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e8c44-6b23-4927-8dd6-35de6a863885 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:01.505157 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e8c44-6b23-4927-8dd6-35de6a863885 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:01.505885 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e8c44-6b23-4927-8dd6-35de6a863885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:01.507517 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e8c44-6b23-4927-8dd6-35de6a863885 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:01.524912 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1223/2421] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:12:01.530499 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c79b4-faf3-4ac8-b340-9dd2996e4ee3 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:01.547228 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c79b4-faf3-4ac8-b340-9dd2996e4ee3 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:01.555616 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c00fa-cb8d-44f7-97d6-252aa3230829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:01.557045 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c00fa-cb8d-44f7-97d6-252aa3230829 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:01.557484 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c00fa-cb8d-44f7-97d6-252aa3230829 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:01.557754 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c00fa-cb8d-44f7-97d6-252aa3230829 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:01.558520 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c00fa-cb8d-44f7-97d6-252aa3230829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:01.561006 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c00fa-cb8d-44f7-97d6-252aa3230829 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:01.578510 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1199/2422] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:12:01.582479 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e8c44-6b23-4927-8dd6-35de6a863885 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:01.593433 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e8c44-6b23-4927-8dd6-35de6a863885 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:01.608703 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf428ab-d8a8-45b7-8700-332a84c4ad36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:01.611257 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf428ab-d8a8-45b7-8700-332a84c4ad36 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:01.611610 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf428ab-d8a8-45b7-8700-332a84c4ad36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:01.612453 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf428ab-d8a8-45b7-8700-332a84c4ad36 admin admin] PATH_INFO: `/v3/projects/73f8bed4c0a1456ab85150288aeed5b3/users/dfcb427f0c8749cf9be29a5b921c6e2d/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:01.637740 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf428ab-d8a8-45b7-8700-332a84c4ad36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f8bed4c0a1456ab85150288aeed5b3, user_id=dfcb427f0c8749cf9be29a5b921c6e2d, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:01.640653 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf428ab-d8a8-45b7-8700-332a84c4ad36 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:01.671782 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1224/2423] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:12:01 2022] PUT /identity/v3/projects/73f8bed4c0a1456ab85150288aeed5b3/users/dfcb427f0c8749cf9be29a5b921c6e2d/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:12:01.676054 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88ed57-aa18-42c5-820a-206811d9dd06 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:01.676632 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88ed57-aa18-42c5-820a-206811d9dd06 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:01.677629 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88ed57-aa18-42c5-820a-206811d9dd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:01.716703 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-4f88ed57-aa18-42c5-820a-206811d9dd06 None None] MFA Rules not processed for user `dfcb427f0c8749cf9be29a5b921c6e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:01.717931 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-4f88ed57-aa18-42c5-820a-206811d9dd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:01.811388 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1200/2424] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:01 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:12:01.815816 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf428ab-d8a8-45b7-8700-332a84c4ad36 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:01.904919 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf428ab-d8a8-45b7-8700-332a84c4ad36 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:01.910059 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ab892-df85-431d-8865-54899c52e67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:01.910812 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ab892-df85-431d-8865-54899c52e67a admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:01.911202 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ab892-df85-431d-8865-54899c52e67a admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:01.911486 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ab892-df85-431d-8865-54899c52e67a admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:01.912300 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ab892-df85-431d-8865-54899c52e67a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:01.914298 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ab892-df85-431d-8865-54899c52e67a admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:01.947114 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1225/2425] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:12:01 2022] POST /identity/v3/projects => generated 355 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:12:01.948707 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88ed57-aa18-42c5-820a-206811d9dd06 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:01.959595 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88ed57-aa18-42c5-820a-206811d9dd06 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:02.016066 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32771390-78ef-49ca-be84-2deb65557680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:02.016823 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32771390-78ef-49ca-be84-2deb65557680 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:02.017067 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32771390-78ef-49ca-be84-2deb65557680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:02.017835 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32771390-78ef-49ca-be84-2deb65557680 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:02.018554 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32771390-78ef-49ca-be84-2deb65557680 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:02.020569 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32771390-78ef-49ca-be84-2deb65557680 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:02.051308 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1201/2426] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:12:01 2022] POST /identity/v3/users => generated 284 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:12:02.055330 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ab892-df85-431d-8865-54899c52e67a admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:02.073159 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ab892-df85-431d-8865-54899c52e67a admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:02.084973 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413ea9f-9100-4fad-986a-454dc79f5717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:02.086226 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413ea9f-9100-4fad-986a-454dc79f5717 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:02.086372 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413ea9f-9100-4fad-986a-454dc79f5717 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:02.086742 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413ea9f-9100-4fad-986a-454dc79f5717 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:02.087590 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413ea9f-9100-4fad-986a-454dc79f5717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:02.089517 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413ea9f-9100-4fad-986a-454dc79f5717 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:02.101975 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1226/2427] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:12:02.106456 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32771390-78ef-49ca-be84-2deb65557680 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:02.117419 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32771390-78ef-49ca-be84-2deb65557680 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:02.123164 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c6987-9c48-4086-a9b9-aeb833a9827c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:02.124273 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c6987-9c48-4086-a9b9-aeb833a9827c admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:02.124591 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c6987-9c48-4086-a9b9-aeb833a9827c admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:02.124920 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c6987-9c48-4086-a9b9-aeb833a9827c admin admin] PATH_INFO: `/v3/projects/258357e7f74b4cc285a187d755a31b59/users/c2828e10d1f243438af92712c3c98f5a/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:02.147116 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c6987-9c48-4086-a9b9-aeb833a9827c admin admin] RBAC: Authorizing `identity:create_grant(project_id=258357e7f74b4cc285a187d755a31b59, user_id=c2828e10d1f243438af92712c3c98f5a, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:02.150353 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c6987-9c48-4086-a9b9-aeb833a9827c admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:02.170275 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1202/2428] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:12:02 2022] PUT /identity/v3/projects/258357e7f74b4cc285a187d755a31b59/users/c2828e10d1f243438af92712c3c98f5a/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:02.174828 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413ea9f-9100-4fad-986a-454dc79f5717 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:02.186291 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413ea9f-9100-4fad-986a-454dc79f5717 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:02.245115 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf3505-2bdd-474e-a0b9-9d0a7f97bc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:02.245796 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf3505-2bdd-474e-a0b9-9d0a7f97bc5c admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:02.246069 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf3505-2bdd-474e-a0b9-9d0a7f97bc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:02.246360 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf3505-2bdd-474e-a0b9-9d0a7f97bc5c admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:02.247183 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf3505-2bdd-474e-a0b9-9d0a7f97bc5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:02.249494 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf3505-2bdd-474e-a0b9-9d0a7f97bc5c admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:02.259528 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1227/2429] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:12:02.264075 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c6987-9c48-4086-a9b9-aeb833a9827c admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:02.274544 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c6987-9c48-4086-a9b9-aeb833a9827c admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:02.279601 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd3259-a6d7-4a99-a875-1b3fc390445e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:02.280596 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd3259-a6d7-4a99-a875-1b3fc390445e admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:02.280935 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd3259-a6d7-4a99-a875-1b3fc390445e admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:02.281270 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd3259-a6d7-4a99-a875-1b3fc390445e admin admin] PATH_INFO: `/v3/projects/258357e7f74b4cc285a187d755a31b59/users/c2828e10d1f243438af92712c3c98f5a/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:02.283317 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd3259-a6d7-4a99-a875-1b3fc390445e admin admin] RBAC: Authorizing `identity:create_grant(project_id=258357e7f74b4cc285a187d755a31b59, user_id=c2828e10d1f243438af92712c3c98f5a, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:02.286038 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd3259-a6d7-4a99-a875-1b3fc390445e admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:02.296705 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1203/2430] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:12:02 2022] PUT /identity/v3/projects/258357e7f74b4cc285a187d755a31b59/users/c2828e10d1f243438af92712c3c98f5a/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:02.307893 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda087e-111a-4948-a5ef-de074d363359 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:02.308285 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda087e-111a-4948-a5ef-de074d363359 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:02.308573 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda087e-111a-4948-a5ef-de074d363359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:02.335670 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-1cda087e-111a-4948-a5ef-de074d363359 None None] MFA Rules not processed for user `c2828e10d1f243438af92712c3c98f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:02.336969 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-1cda087e-111a-4948-a5ef-de074d363359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:02.407073 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1228/2431] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:02 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:02.421204 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd3259-a6d7-4a99-a875-1b3fc390445e admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:02.423010 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-17cd3259-a6d7-4a99-a875-1b3fc390445e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:02.493209 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd3259-a6d7-4a99-a875-1b3fc390445e admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:02.498833 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73374b69-d564-4196-b5ec-fb32ebb95dc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:02.499508 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73374b69-d564-4196-b5ec-fb32ebb95dc6 service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:02.499810 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73374b69-d564-4196-b5ec-fb32ebb95dc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:02.500077 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73374b69-d564-4196-b5ec-fb32ebb95dc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:02.511830 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73374b69-d564-4196-b5ec-fb32ebb95dc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:02.514266 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73374b69-d564-4196-b5ec-fb32ebb95dc6 service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:02.530245 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1204/2432] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:12:02 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:12:02.627580 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda087e-111a-4948-a5ef-de074d363359 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:02.640653 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda087e-111a-4948-a5ef-de074d363359 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:02.646796 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a6f58-64bd-43e2-af6e-ae8487f5eca4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:02.647929 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a6f58-64bd-43e2-af6e-ae8487f5eca4 service cinder] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:02.648357 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a6f58-64bd-43e2-af6e-ae8487f5eca4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:02.648821 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a6f58-64bd-43e2-af6e-ae8487f5eca4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:02.735637 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a6f58-64bd-43e2-af6e-ae8487f5eca4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:02.737320 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a6f58-64bd-43e2-af6e-ae8487f5eca4 service cinder] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:02.751828 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1229/2433] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:12:02 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:12:03.128247 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73374b69-d564-4196-b5ec-fb32ebb95dc6 service cinder] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:03.130028 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-73374b69-d564-4196-b5ec-fb32ebb95dc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:03.199113 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73374b69-d564-4196-b5ec-fb32ebb95dc6 service cinder] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:03.204501 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd126d-1f80-41d1-8ab4-cf2398cb0771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:03.205477 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd126d-1f80-41d1-8ab4-cf2398cb0771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:03.205821 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd126d-1f80-41d1-8ab4-cf2398cb0771 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:03.206152 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd126d-1f80-41d1-8ab4-cf2398cb0771 admin admin] PATH_INFO: `/v3/users/569824a5ffb846f1a447f1195bb9c017` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:03.207380 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd126d-1f80-41d1-8ab4-cf2398cb0771 admin admin] RBAC: Authorizing `identity:delete_user(user_id=569824a5ffb846f1a447f1195bb9c017)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:03.209444 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd126d-1f80-41d1-8ab4-cf2398cb0771 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:03.262336 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-efbd126d-1f80-41d1-8ab4-cf2398cb0771 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '569824a5ffb846f1a447f1195bb9c017'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:03.263141 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-efbd126d-1f80-41d1-8ab4-cf2398cb0771 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '569824a5ffb846f1a447f1195bb9c017'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:03.277878 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-efbd126d-1f80-41d1-8ab4-cf2398cb0771 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '569824a5ffb846f1a447f1195bb9c017'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:03.281158 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-efbd126d-1f80-41d1-8ab4-cf2398cb0771 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '569824a5ffb846f1a447f1195bb9c017'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:03.288662 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-efbd126d-1f80-41d1-8ab4-cf2398cb0771 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '569824a5ffb846f1a447f1195bb9c017'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:03.303914 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1205/2434] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:12:03 2022] DELETE /identity/v3/users/569824a5ffb846f1a447f1195bb9c017 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:03.489725 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a6f58-64bd-43e2-af6e-ae8487f5eca4 service cinder] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:03.502625 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a6f58-64bd-43e2-af6e-ae8487f5eca4 service cinder] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:03.562866 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affeefed-0337-4d68-8e14-51642d201402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:03.563728 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affeefed-0337-4d68-8e14-51642d201402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:03.564011 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affeefed-0337-4d68-8e14-51642d201402 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:03.564273 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affeefed-0337-4d68-8e14-51642d201402 admin admin] PATH_INFO: `/v3/projects/aa116ee72616411e95552f4f7f6fdf9a` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:03.565445 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affeefed-0337-4d68-8e14-51642d201402 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa116ee72616411e95552f4f7f6fdf9a)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:03.567345 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affeefed-0337-4d68-8e14-51642d201402 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:03.613035 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-affeefed-0337-4d68-8e14-51642d201402 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa116ee72616411e95552f4f7f6fdf9a', 'request_id': 'req-affeefed-0337-4d68-8e14-51642d201402'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:03.622194 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-affeefed-0337-4d68-8e14-51642d201402 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa116ee72616411e95552f4f7f6fdf9a', 'request_id': 'req-affeefed-0337-4d68-8e14-51642d201402'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:03.628889 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-affeefed-0337-4d68-8e14-51642d201402 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa116ee72616411e95552f4f7f6fdf9a', 'request_id': 'req-affeefed-0337-4d68-8e14-51642d201402'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:03.639182 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-affeefed-0337-4d68-8e14-51642d201402 admin admin] The token cache is being invalidate because project aa116ee72616411e95552f4f7f6fdf9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:12:03.639463 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-affeefed-0337-4d68-8e14-51642d201402 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:03.640140 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-affeefed-0337-4d68-8e14-51642d201402 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:03.641748 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1230/2435] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:12:03 2022] DELETE /identity/v3/projects/aa116ee72616411e95552f4f7f6fdf9a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:03.647161 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe1d97-3298-4613-993c-a261fa9cfb98 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:03.647440 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe1d97-3298-4613-993c-a261fa9cfb98 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:03.647754 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe1d97-3298-4613-993c-a261fa9cfb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:03.665746 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-20fe1d97-3298-4613-993c-a261fa9cfb98 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:03.666958 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-20fe1d97-3298-4613-993c-a261fa9cfb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:03.728223 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1206/2436] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:03.736520 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae4358-3d0e-4fae-83b6-a948ccbfa046 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:03.736795 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae4358-3d0e-4fae-83b6-a948ccbfa046 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:03.737065 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae4358-3d0e-4fae-83b6-a948ccbfa046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:03.756602 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-2bae4358-3d0e-4fae-83b6-a948ccbfa046 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:03.757825 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-2bae4358-3d0e-4fae-83b6-a948ccbfa046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:03.766928 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1231/2437] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:03.771065 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe1d97-3298-4613-993c-a261fa9cfb98 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:03.781394 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe1d97-3298-4613-993c-a261fa9cfb98 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:03.787329 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3a3d8-3bc6-4723-8758-8be037822775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:03.788330 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3a3d8-3bc6-4723-8758-8be037822775 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:03.788633 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3a3d8-3bc6-4723-8758-8be037822775 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:03.788899 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3a3d8-3bc6-4723-8758-8be037822775 admin admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:03.789611 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3a3d8-3bc6-4723-8758-8be037822775 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:12:03.789911 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3a3d8-3bc6-4723-8758-8be037822775 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:03.791546 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3a3d8-3bc6-4723-8758-8be037822775 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:03.804331 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1207/2438] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:12:03.808889 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae4358-3d0e-4fae-83b6-a948ccbfa046 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:03.819992 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae4358-3d0e-4fae-83b6-a948ccbfa046 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:03.825516 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70b440-b98c-42cc-af60-61c856ef41e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:03.826244 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70b440-b98c-42cc-af60-61c856ef41e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:03.826557 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70b440-b98c-42cc-af60-61c856ef41e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:03.826996 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70b440-b98c-42cc-af60-61c856ef41e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:03.827882 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70b440-b98c-42cc-af60-61c856ef41e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:03.830042 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70b440-b98c-42cc-af60-61c856ef41e0 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:03.864575 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1232/2439] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:12:03 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:12:03.865339 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3a3d8-3bc6-4723-8758-8be037822775 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:03.876190 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3a3d8-3bc6-4723-8758-8be037822775 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:03.935655 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca2614-8ed4-4e10-98ce-8494ac03406a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:03.936408 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca2614-8ed4-4e10-98ce-8494ac03406a admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:03.936684 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca2614-8ed4-4e10-98ce-8494ac03406a admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:03.936972 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca2614-8ed4-4e10-98ce-8494ac03406a admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:03.937696 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca2614-8ed4-4e10-98ce-8494ac03406a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:03.939691 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca2614-8ed4-4e10-98ce-8494ac03406a admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:03.960122 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1208/2440] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:12:03 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:12:03.965117 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70b440-b98c-42cc-af60-61c856ef41e0 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:03.975434 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70b440-b98c-42cc-af60-61c856ef41e0 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:03.981508 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2cc98-b737-4ef2-a1fa-dfbabd3cb3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:03.982278 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2cc98-b737-4ef2-a1fa-dfbabd3cb3cd admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:03.982575 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2cc98-b737-4ef2-a1fa-dfbabd3cb3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:03.982832 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2cc98-b737-4ef2-a1fa-dfbabd3cb3cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:03.983566 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b2cc98-b737-4ef2-a1fa-dfbabd3cb3cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:03.985402 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b2cc98-b737-4ef2-a1fa-dfbabd3cb3cd admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:03.997815 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1233/2441] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:12:04.002147 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca2614-8ed4-4e10-98ce-8494ac03406a admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:04.016360 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca2614-8ed4-4e10-98ce-8494ac03406a admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:04.022070 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61526253-695a-442f-a834-bb191b2c0e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:04.022796 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61526253-695a-442f-a834-bb191b2c0e45 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:04.023078 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61526253-695a-442f-a834-bb191b2c0e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:04.023452 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61526253-695a-442f-a834-bb191b2c0e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:04.024285 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61526253-695a-442f-a834-bb191b2c0e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:04.025946 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61526253-695a-442f-a834-bb191b2c0e45 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:04.037543 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1209/2442] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:12:04.041877 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2cc98-b737-4ef2-a1fa-dfbabd3cb3cd admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:04.052284 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2cc98-b737-4ef2-a1fa-dfbabd3cb3cd admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:04.057363 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae769205-9099-401d-ad08-075bddbb3b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:04.058380 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae769205-9099-401d-ad08-075bddbb3b21 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:04.058656 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae769205-9099-401d-ad08-075bddbb3b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:04.058929 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae769205-9099-401d-ad08-075bddbb3b21 admin admin] PATH_INFO: `/v3/projects/c0f19a601ffa4ca9af1e99807ab4cce1/users/82f4e80a56624421b9ebacc3c98658c3/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:04.074796 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae769205-9099-401d-ad08-075bddbb3b21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0f19a601ffa4ca9af1e99807ab4cce1, user_id=82f4e80a56624421b9ebacc3c98658c3, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:04.078111 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae769205-9099-401d-ad08-075bddbb3b21 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:04.091046 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1234/2443] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:12:04 2022] PUT /identity/v3/projects/c0f19a601ffa4ca9af1e99807ab4cce1/users/82f4e80a56624421b9ebacc3c98658c3/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:12:04.102204 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fca29-bc2b-4bbe-bb45-eefe9659605b None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:04.102640 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fca29-bc2b-4bbe-bb45-eefe9659605b None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:04.102857 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fca29-bc2b-4bbe-bb45-eefe9659605b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:04.133297 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-878fca29-bc2b-4bbe-bb45-eefe9659605b None None] MFA Rules not processed for user `82f4e80a56624421b9ebacc3c98658c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:04.134457 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-878fca29-bc2b-4bbe-bb45-eefe9659605b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:04.198870 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1210/2444] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:04.212558 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae769205-9099-401d-ad08-075bddbb3b21 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:04.214798 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-ae769205-9099-401d-ad08-075bddbb3b21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:04.297911 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae769205-9099-401d-ad08-075bddbb3b21 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:04.303935 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e62ad-3d6a-4f71-a3cb-521b68435aa8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:04.304573 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e62ad-3d6a-4f71-a3cb-521b68435aa8 service nova] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:04.304843 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e62ad-3d6a-4f71-a3cb-521b68435aa8 service nova] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:04.305104 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e62ad-3d6a-4f71-a3cb-521b68435aa8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:04.313671 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e62ad-3d6a-4f71-a3cb-521b68435aa8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:04.315280 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e62ad-3d6a-4f71-a3cb-521b68435aa8 service nova] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:04.324247 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1235/2445] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:12:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:12:07.003624 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878fca29-bc2b-4bbe-bb45-eefe9659605b None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:07.071983 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878fca29-bc2b-4bbe-bb45-eefe9659605b None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:07.077177 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e061e3-dbc3-4162-8baa-b66c12215c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:07.078042 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e061e3-dbc3-4162-8baa-b66c12215c23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:07.078310 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e061e3-dbc3-4162-8baa-b66c12215c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:07.078569 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e061e3-dbc3-4162-8baa-b66c12215c23 admin admin] PATH_INFO: `/v3/users/82f4e80a56624421b9ebacc3c98658c3` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:07.079713 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e061e3-dbc3-4162-8baa-b66c12215c23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82f4e80a56624421b9ebacc3c98658c3)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:07.081846 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e061e3-dbc3-4162-8baa-b66c12215c23 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:07.130228 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-60e061e3-dbc3-4162-8baa-b66c12215c23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82f4e80a56624421b9ebacc3c98658c3'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:07.130921 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-60e061e3-dbc3-4162-8baa-b66c12215c23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82f4e80a56624421b9ebacc3c98658c3'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:07.143697 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-60e061e3-dbc3-4162-8baa-b66c12215c23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82f4e80a56624421b9ebacc3c98658c3'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:07.144413 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-60e061e3-dbc3-4162-8baa-b66c12215c23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82f4e80a56624421b9ebacc3c98658c3'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:07.150797 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-60e061e3-dbc3-4162-8baa-b66c12215c23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82f4e80a56624421b9ebacc3c98658c3'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:07.163242 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1211/2446] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:12:07 2022] DELETE /identity/v3/users/82f4e80a56624421b9ebacc3c98658c3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:07.167958 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2f025-fef4-43f2-b3b9-7c1c11364fc0 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:07.168429 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2f025-fef4-43f2-b3b9-7c1c11364fc0 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:07.168547 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2f025-fef4-43f2-b3b9-7c1c11364fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:07.187603 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-5ba2f025-fef4-43f2-b3b9-7c1c11364fc0 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:07.188966 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-5ba2f025-fef4-43f2-b3b9-7c1c11364fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:07.249690 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1236/2447] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:07.259672 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e061e3-dbc3-4162-8baa-b66c12215c23 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:07.262042 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-60e061e3-dbc3-4162-8baa-b66c12215c23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:07.322778 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e061e3-dbc3-4162-8baa-b66c12215c23 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:07.327063 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad2183-fcd0-4c17-8fe9-376f9a875ba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:07.327707 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad2183-fcd0-4c17-8fe9-376f9a875ba2 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:07.328003 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad2183-fcd0-4c17-8fe9-376f9a875ba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:07.328390 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad2183-fcd0-4c17-8fe9-376f9a875ba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:07.337762 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad2183-fcd0-4c17-8fe9-376f9a875ba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:07.339203 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad2183-fcd0-4c17-8fe9-376f9a875ba2 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:07.348950 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1212/2448] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:12:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:12:07.637272 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba2f025-fef4-43f2-b3b9-7c1c11364fc0 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:07.638623 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-5ba2f025-fef4-43f2-b3b9-7c1c11364fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:07.650104 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba2f025-fef4-43f2-b3b9-7c1c11364fc0 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:07.654888 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7ffa5-3e8d-49f0-8d72-7abfc23e5fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:07.655835 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7ffa5-3e8d-49f0-8d72-7abfc23e5fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:07.656111 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7ffa5-3e8d-49f0-8d72-7abfc23e5fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:07.656377 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7ffa5-3e8d-49f0-8d72-7abfc23e5fb3 admin admin] PATH_INFO: `/v3/projects/c0f19a601ffa4ca9af1e99807ab4cce1` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:07.657530 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7ffa5-3e8d-49f0-8d72-7abfc23e5fb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0f19a601ffa4ca9af1e99807ab4cce1)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:07.659425 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7ffa5-3e8d-49f0-8d72-7abfc23e5fb3 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:07.707489 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-15a7ffa5-3e8d-49f0-8d72-7abfc23e5fb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0f19a601ffa4ca9af1e99807ab4cce1', 'request_id': 'req-15a7ffa5-3e8d-49f0-8d72-7abfc23e5fb3'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:07.716429 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-15a7ffa5-3e8d-49f0-8d72-7abfc23e5fb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0f19a601ffa4ca9af1e99807ab4cce1', 'request_id': 'req-15a7ffa5-3e8d-49f0-8d72-7abfc23e5fb3'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:07.722497 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-15a7ffa5-3e8d-49f0-8d72-7abfc23e5fb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0f19a601ffa4ca9af1e99807ab4cce1', 'request_id': 'req-15a7ffa5-3e8d-49f0-8d72-7abfc23e5fb3'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:07.732667 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-15a7ffa5-3e8d-49f0-8d72-7abfc23e5fb3 admin admin] The token cache is being invalidate because project c0f19a601ffa4ca9af1e99807ab4cce1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:12:07.732946 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-15a7ffa5-3e8d-49f0-8d72-7abfc23e5fb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:07.733574 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-15a7ffa5-3e8d-49f0-8d72-7abfc23e5fb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:07.735166 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1237/2449] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:12:07 2022] DELETE /identity/v3/projects/c0f19a601ffa4ca9af1e99807ab4cce1 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:07.740600 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d713b-7ddc-4435-9aa7-83fbeac92ca6 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:07.740907 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d713b-7ddc-4435-9aa7-83fbeac92ca6 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:07.741176 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d713b-7ddc-4435-9aa7-83fbeac92ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:07.759628 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-115d713b-7ddc-4435-9aa7-83fbeac92ca6 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:07.760776 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-115d713b-7ddc-4435-9aa7-83fbeac92ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:07.825411 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1213/2450] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:07.834299 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6d13f-da77-4d2f-b159-8c9de6767dc6 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:07.834681 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6d13f-da77-4d2f-b159-8c9de6767dc6 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:07.835007 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6d13f-da77-4d2f-b159-8c9de6767dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:07.855179 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-81c6d13f-da77-4d2f-b159-8c9de6767dc6 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:07.856462 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-81c6d13f-da77-4d2f-b159-8c9de6767dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:07.864633 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1238/2451] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:07.868813 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d713b-7ddc-4435-9aa7-83fbeac92ca6 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:07.879433 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d713b-7ddc-4435-9aa7-83fbeac92ca6 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:07.885120 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff7e67-3d8f-4bf8-a9f3-3f384662eb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:07.885763 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff7e67-3d8f-4bf8-a9f3-3f384662eb09 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:07.886070 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff7e67-3d8f-4bf8-a9f3-3f384662eb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:07.886323 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff7e67-3d8f-4bf8-a9f3-3f384662eb09 admin admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:07.887059 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff7e67-3d8f-4bf8-a9f3-3f384662eb09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:12:07.887368 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff7e67-3d8f-4bf8-a9f3-3f384662eb09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:07.889027 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff7e67-3d8f-4bf8-a9f3-3f384662eb09 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:07.901024 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1214/2452] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:12:07.905503 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6d13f-da77-4d2f-b159-8c9de6767dc6 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:07.914824 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6d13f-da77-4d2f-b159-8c9de6767dc6 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:07.921580 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdef4bd-6f2d-43dd-9a1c-97f973e7cd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:07.922225 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdef4bd-6f2d-43dd-9a1c-97f973e7cd0e admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:07.922497 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdef4bd-6f2d-43dd-9a1c-97f973e7cd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:07.922790 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdef4bd-6f2d-43dd-9a1c-97f973e7cd0e admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:07.923466 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdef4bd-6f2d-43dd-9a1c-97f973e7cd0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:07.925388 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdef4bd-6f2d-43dd-9a1c-97f973e7cd0e admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:07.954790 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1239/2453] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:12:07 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:12:07.958855 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff7e67-3d8f-4bf8-a9f3-3f384662eb09 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:07.968877 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff7e67-3d8f-4bf8-a9f3-3f384662eb09 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:08.035085 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5de33c-2f59-4e76-832e-26b02bf7d318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:08.035744 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5de33c-2f59-4e76-832e-26b02bf7d318 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:08.036069 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5de33c-2f59-4e76-832e-26b02bf7d318 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:08.036336 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5de33c-2f59-4e76-832e-26b02bf7d318 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:08.036978 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5de33c-2f59-4e76-832e-26b02bf7d318 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:08.038955 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5de33c-2f59-4e76-832e-26b02bf7d318 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:08.060520 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1215/2454] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:12:07 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:12:08.065024 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdef4bd-6f2d-43dd-9a1c-97f973e7cd0e admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:08.077071 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdef4bd-6f2d-43dd-9a1c-97f973e7cd0e admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:08.082616 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19da2dc-49de-483f-a269-90361efeb12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:08.083289 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19da2dc-49de-483f-a269-90361efeb12d admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:08.083567 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19da2dc-49de-483f-a269-90361efeb12d admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:08.083875 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19da2dc-49de-483f-a269-90361efeb12d admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:08.084611 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19da2dc-49de-483f-a269-90361efeb12d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:08.086236 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19da2dc-49de-483f-a269-90361efeb12d admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:08.097183 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1240/2455] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:12:08.101422 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5de33c-2f59-4e76-832e-26b02bf7d318 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:08.111437 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5de33c-2f59-4e76-832e-26b02bf7d318 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:08.116219 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2aec3-47b3-4a5a-8a1a-5ecebda73e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:08.116887 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2aec3-47b3-4a5a-8a1a-5ecebda73e3f admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:08.117159 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2aec3-47b3-4a5a-8a1a-5ecebda73e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:08.117426 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2aec3-47b3-4a5a-8a1a-5ecebda73e3f admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:08.118161 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2aec3-47b3-4a5a-8a1a-5ecebda73e3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:08.119809 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2aec3-47b3-4a5a-8a1a-5ecebda73e3f admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:08.129993 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1216/2456] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:12:08.134412 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19da2dc-49de-483f-a269-90361efeb12d admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:08.145359 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19da2dc-49de-483f-a269-90361efeb12d admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:08.151215 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dcaeaa-4d29-4b46-9220-fd1641fe90f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:08.152400 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dcaeaa-4d29-4b46-9220-fd1641fe90f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:08.152858 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dcaeaa-4d29-4b46-9220-fd1641fe90f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:08.153219 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dcaeaa-4d29-4b46-9220-fd1641fe90f0 admin admin] PATH_INFO: `/v3/projects/dd71c62f9e704ba8b70ec850918c3d1e/users/c6cafef932dc495b9b866b5aef5c7652/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:08.170205 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dcaeaa-4d29-4b46-9220-fd1641fe90f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd71c62f9e704ba8b70ec850918c3d1e, user_id=c6cafef932dc495b9b866b5aef5c7652, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:08.172939 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dcaeaa-4d29-4b46-9220-fd1641fe90f0 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:08.189146 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1241/2457] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:12:08 2022] PUT /identity/v3/projects/dd71c62f9e704ba8b70ec850918c3d1e/users/c6cafef932dc495b9b866b5aef5c7652/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:08.202400 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39b0b4-e92b-4d76-8090-3cbc60afced0 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:08.202972 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39b0b4-e92b-4d76-8090-3cbc60afced0 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:08.203263 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39b0b4-e92b-4d76-8090-3cbc60afced0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:08.230983 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-ea39b0b4-e92b-4d76-8090-3cbc60afced0 None None] MFA Rules not processed for user `c6cafef932dc495b9b866b5aef5c7652`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:08.232305 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-ea39b0b4-e92b-4d76-8090-3cbc60afced0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:08.301622 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1217/2458] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:08.313073 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dcaeaa-4d29-4b46-9220-fd1641fe90f0 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:08.314933 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-f2dcaeaa-4d29-4b46-9220-fd1641fe90f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:08.388900 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dcaeaa-4d29-4b46-9220-fd1641fe90f0 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:08.395045 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f397b10-ba61-4600-9777-a9e0dc3dd3ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:08.395696 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f397b10-ba61-4600-9777-a9e0dc3dd3ef service nova] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:08.396001 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f397b10-ba61-4600-9777-a9e0dc3dd3ef service nova] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:08.396289 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f397b10-ba61-4600-9777-a9e0dc3dd3ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:08.404545 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f397b10-ba61-4600-9777-a9e0dc3dd3ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:08.406172 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f397b10-ba61-4600-9777-a9e0dc3dd3ef service nova] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:08.415137 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1242/2459] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:12:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:12:08.602423 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39b0b4-e92b-4d76-8090-3cbc60afced0 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:08.668786 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39b0b4-e92b-4d76-8090-3cbc60afced0 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:08.673687 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd995ad-32ba-4d9f-84bb-bdecba070963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:08.674556 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd995ad-32ba-4d9f-84bb-bdecba070963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:08.674827 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd995ad-32ba-4d9f-84bb-bdecba070963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:08.675096 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd995ad-32ba-4d9f-84bb-bdecba070963 admin admin] PATH_INFO: `/v3/users/c6cafef932dc495b9b866b5aef5c7652` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:08.676361 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd995ad-32ba-4d9f-84bb-bdecba070963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6cafef932dc495b9b866b5aef5c7652)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:08.678295 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd995ad-32ba-4d9f-84bb-bdecba070963 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:08.727485 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-0dd995ad-32ba-4d9f-84bb-bdecba070963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6cafef932dc495b9b866b5aef5c7652'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:08.728447 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-0dd995ad-32ba-4d9f-84bb-bdecba070963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6cafef932dc495b9b866b5aef5c7652'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:08.739963 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-0dd995ad-32ba-4d9f-84bb-bdecba070963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6cafef932dc495b9b866b5aef5c7652'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:08.740666 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-0dd995ad-32ba-4d9f-84bb-bdecba070963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6cafef932dc495b9b866b5aef5c7652'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:08.747185 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-0dd995ad-32ba-4d9f-84bb-bdecba070963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6cafef932dc495b9b866b5aef5c7652'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:08.760221 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1218/2460] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:12:08 2022] DELETE /identity/v3/users/c6cafef932dc495b9b866b5aef5c7652 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:08.764857 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01b85a-a60c-4482-83f5-197e79f035a9 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:08.765202 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01b85a-a60c-4482-83f5-197e79f035a9 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:08.765410 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01b85a-a60c-4482-83f5-197e79f035a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:08.782732 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-4c01b85a-a60c-4482-83f5-197e79f035a9 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:08.783886 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-4c01b85a-a60c-4482-83f5-197e79f035a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:08.841249 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1243/2461] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:08.851249 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd995ad-32ba-4d9f-84bb-bdecba070963 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:08.852840 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-0dd995ad-32ba-4d9f-84bb-bdecba070963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:08.908806 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd995ad-32ba-4d9f-84bb-bdecba070963 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:08.912849 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15716d-1836-4f8d-881f-91b31aff78e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:08.913477 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15716d-1836-4f8d-881f-91b31aff78e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:08.913751 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15716d-1836-4f8d-881f-91b31aff78e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:08.914016 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15716d-1836-4f8d-881f-91b31aff78e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:08.923528 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15716d-1836-4f8d-881f-91b31aff78e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:08.925020 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15716d-1836-4f8d-881f-91b31aff78e9 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:08.934278 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1219/2462] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:12:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:12:09.245156 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01b85a-a60c-4482-83f5-197e79f035a9 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:09.247016 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-4c01b85a-a60c-4482-83f5-197e79f035a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:09.262606 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01b85a-a60c-4482-83f5-197e79f035a9 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:09.267548 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21d0e9-dfea-49cc-8422-78cab00e3e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:09.268447 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21d0e9-dfea-49cc-8422-78cab00e3e1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:09.268907 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21d0e9-dfea-49cc-8422-78cab00e3e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:09.269186 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21d0e9-dfea-49cc-8422-78cab00e3e1e admin admin] PATH_INFO: `/v3/projects/dd71c62f9e704ba8b70ec850918c3d1e` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:09.270560 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d21d0e9-dfea-49cc-8422-78cab00e3e1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd71c62f9e704ba8b70ec850918c3d1e)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:09.272688 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d21d0e9-dfea-49cc-8422-78cab00e3e1e admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:09.333946 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-9d21d0e9-dfea-49cc-8422-78cab00e3e1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd71c62f9e704ba8b70ec850918c3d1e', 'request_id': 'req-9d21d0e9-dfea-49cc-8422-78cab00e3e1e'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:09.344373 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-9d21d0e9-dfea-49cc-8422-78cab00e3e1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd71c62f9e704ba8b70ec850918c3d1e', 'request_id': 'req-9d21d0e9-dfea-49cc-8422-78cab00e3e1e'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:09.352021 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-9d21d0e9-dfea-49cc-8422-78cab00e3e1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd71c62f9e704ba8b70ec850918c3d1e', 'request_id': 'req-9d21d0e9-dfea-49cc-8422-78cab00e3e1e'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:09.364126 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-9d21d0e9-dfea-49cc-8422-78cab00e3e1e admin admin] The token cache is being invalidate because project dd71c62f9e704ba8b70ec850918c3d1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:12:09.364418 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-9d21d0e9-dfea-49cc-8422-78cab00e3e1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:09.365351 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-9d21d0e9-dfea-49cc-8422-78cab00e3e1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:09.367088 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1244/2463] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:12:09 2022] DELETE /identity/v3/projects/dd71c62f9e704ba8b70ec850918c3d1e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:12:09.372408 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19a273-a99b-425b-ad9b-4a04e6e893e8 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:09.372949 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19a273-a99b-425b-ad9b-4a04e6e893e8 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:09.372949 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19a273-a99b-425b-ad9b-4a04e6e893e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:09.394068 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-da19a273-a99b-425b-ad9b-4a04e6e893e8 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:09.395370 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-da19a273-a99b-425b-ad9b-4a04e6e893e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:09.471218 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1220/2464] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:09.479232 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c52f78-321a-4ffa-a4a2-f8fe9e6aaaca None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:09.479520 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c52f78-321a-4ffa-a4a2-f8fe9e6aaaca None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:09.479832 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c52f78-321a-4ffa-a4a2-f8fe9e6aaaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:09.504107 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-18c52f78-321a-4ffa-a4a2-f8fe9e6aaaca None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:09.504107 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-18c52f78-321a-4ffa-a4a2-f8fe9e6aaaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:09.515338 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1245/2465] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:12:09.519625 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19a273-a99b-425b-ad9b-4a04e6e893e8 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:09.530561 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19a273-a99b-425b-ad9b-4a04e6e893e8 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:09.536055 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d497e-ca8f-471a-92a2-4efcea4690c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:09.537007 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d497e-ca8f-471a-92a2-4efcea4690c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:09.537203 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d497e-ca8f-471a-92a2-4efcea4690c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:09.537561 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d497e-ca8f-471a-92a2-4efcea4690c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:09.538288 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d497e-ca8f-471a-92a2-4efcea4690c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:12:09.538589 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d497e-ca8f-471a-92a2-4efcea4690c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:09.540246 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d497e-ca8f-471a-92a2-4efcea4690c0 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:09.556515 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1221/2466] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:12:09.561339 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c52f78-321a-4ffa-a4a2-f8fe9e6aaaca None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:09.571519 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c52f78-321a-4ffa-a4a2-f8fe9e6aaaca None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:09.578358 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c22fa-cbee-4959-bce9-867816928c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:09.579043 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c22fa-cbee-4959-bce9-867816928c1a admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:09.579337 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c22fa-cbee-4959-bce9-867816928c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:09.579587 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c22fa-cbee-4959-bce9-867816928c1a admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:09.580344 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c22fa-cbee-4959-bce9-867816928c1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:09.582289 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c22fa-cbee-4959-bce9-867816928c1a admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:09.618325 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1246/2467] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:12:09 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:12:09.623085 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d497e-ca8f-471a-92a2-4efcea4690c0 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:09.638823 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d497e-ca8f-471a-92a2-4efcea4690c0 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:09.717269 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731810b-72e7-4e70-8e7f-8c140ccd5e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:09.718067 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731810b-72e7-4e70-8e7f-8c140ccd5e3c admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:09.718413 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731810b-72e7-4e70-8e7f-8c140ccd5e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:09.718712 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731810b-72e7-4e70-8e7f-8c140ccd5e3c admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:09.719658 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731810b-72e7-4e70-8e7f-8c140ccd5e3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:09.721803 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731810b-72e7-4e70-8e7f-8c140ccd5e3c admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:09.743222 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1222/2468] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:12:09 2022] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 03:12:09.748013 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c22fa-cbee-4959-bce9-867816928c1a admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:09.758986 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c22fa-cbee-4959-bce9-867816928c1a admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:09.766395 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e5b7b-2d2a-468d-8035-fd9b084dd9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:09.766395 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e5b7b-2d2a-468d-8035-fd9b084dd9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:09.766395 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e5b7b-2d2a-468d-8035-fd9b084dd9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:09.766395 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e5b7b-2d2a-468d-8035-fd9b084dd9d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:09.769427 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e5b7b-2d2a-468d-8035-fd9b084dd9d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:09.771356 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e5b7b-2d2a-468d-8035-fd9b084dd9d0 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:09.784761 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1247/2469] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:12:09.788839 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731810b-72e7-4e70-8e7f-8c140ccd5e3c admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:09.802789 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731810b-72e7-4e70-8e7f-8c140ccd5e3c admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:09.808896 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaccd15-d3d4-404e-a852-51b8d174ac62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:09.809637 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaccd15-d3d4-404e-a852-51b8d174ac62 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:09.809983 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaccd15-d3d4-404e-a852-51b8d174ac62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:09.810255 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaccd15-d3d4-404e-a852-51b8d174ac62 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:09.811315 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaccd15-d3d4-404e-a852-51b8d174ac62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:09.813317 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaccd15-d3d4-404e-a852-51b8d174ac62 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:09.826281 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1223/2470] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:12:09.830717 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e5b7b-2d2a-468d-8035-fd9b084dd9d0 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:09.841048 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e5b7b-2d2a-468d-8035-fd9b084dd9d0 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:09.846476 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af685e-c50d-412a-9c8b-95900b89e730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:09.847367 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af685e-c50d-412a-9c8b-95900b89e730 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:09.847654 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af685e-c50d-412a-9c8b-95900b89e730 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:09.847974 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af685e-c50d-412a-9c8b-95900b89e730 admin admin] PATH_INFO: `/v3/projects/d15f4baf317d4241bc5a20077afede7c/users/60813282c8024606a322652d047880e3/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:09.862836 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af685e-c50d-412a-9c8b-95900b89e730 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d15f4baf317d4241bc5a20077afede7c, user_id=60813282c8024606a322652d047880e3, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:09.865605 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af685e-c50d-412a-9c8b-95900b89e730 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:09.879440 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1248/2471] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:12:09 2022] PUT /identity/v3/projects/d15f4baf317d4241bc5a20077afede7c/users/60813282c8024606a322652d047880e3/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:09.890592 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823ef61-de5e-46ae-ad95-002c0d95fffe None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:09.891060 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823ef61-de5e-46ae-ad95-002c0d95fffe None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:09.891340 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823ef61-de5e-46ae-ad95-002c0d95fffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:09.942259 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-4823ef61-de5e-46ae-ad95-002c0d95fffe None None] MFA Rules not processed for user `60813282c8024606a322652d047880e3`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:09.943451 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-4823ef61-de5e-46ae-ad95-002c0d95fffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:10.015743 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1224/2472] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:10.020431 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af685e-c50d-412a-9c8b-95900b89e730 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:10.084082 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af685e-c50d-412a-9c8b-95900b89e730 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:10.089461 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0cdb0-c87a-4d81-8eda-a80dd4d96af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:10.090406 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0cdb0-c87a-4d81-8eda-a80dd4d96af0 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:10.090784 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0cdb0-c87a-4d81-8eda-a80dd4d96af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:10.091120 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0cdb0-c87a-4d81-8eda-a80dd4d96af0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:10.091780 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f0cdb0-c87a-4d81-8eda-a80dd4d96af0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:10.093717 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f0cdb0-c87a-4d81-8eda-a80dd4d96af0 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:10.121642 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1249/2473] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:12:10 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:12:10.126158 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823ef61-de5e-46ae-ad95-002c0d95fffe None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:10.136965 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823ef61-de5e-46ae-ad95-002c0d95fffe None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:10.194897 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b2f91-ca56-4ca7-9e37-e377dfa226a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:10.195575 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b2f91-ca56-4ca7-9e37-e377dfa226a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:10.195884 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b2f91-ca56-4ca7-9e37-e377dfa226a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:10.196152 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b2f91-ca56-4ca7-9e37-e377dfa226a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:10.196833 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b2f91-ca56-4ca7-9e37-e377dfa226a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:10.198830 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b2f91-ca56-4ca7-9e37-e377dfa226a5 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:10.219843 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1225/2474] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:12:10 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:12:10.223589 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0cdb0-c87a-4d81-8eda-a80dd4d96af0 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:10.234408 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0cdb0-c87a-4d81-8eda-a80dd4d96af0 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:10.238690 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b2f91-ca56-4ca7-9e37-e377dfa226a5 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:10.239998 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4bfb8-8aae-4187-abff-55b661017aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:10.240658 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-238b2f91-ca56-4ca7-9e37-e377dfa226a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:10.240765 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4bfb8-8aae-4187-abff-55b661017aaf admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:10.240929 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4bfb8-8aae-4187-abff-55b661017aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:10.241198 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4bfb8-8aae-4187-abff-55b661017aaf admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:10.241916 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c4bfb8-8aae-4187-abff-55b661017aaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:10.243542 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c4bfb8-8aae-4187-abff-55b661017aaf admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:10.253836 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b2f91-ca56-4ca7-9e37-e377dfa226a5 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:10.255550 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1250/2475] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:12:10.259143 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe3a35-ac6b-42f0-b2d6-872641c76914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:10.259918 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4bfb8-8aae-4187-abff-55b661017aaf admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:10.260044 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe3a35-ac6b-42f0-b2d6-872641c76914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:10.260323 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe3a35-ac6b-42f0-b2d6-872641c76914 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:10.260595 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe3a35-ac6b-42f0-b2d6-872641c76914 admin admin] PATH_INFO: `/v3/users/6b25ff8c7eca4156a4755c83729be14e` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:10.261845 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe3a35-ac6b-42f0-b2d6-872641c76914 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b25ff8c7eca4156a4755c83729be14e)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:10.263990 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe3a35-ac6b-42f0-b2d6-872641c76914 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:10.269823 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4bfb8-8aae-4187-abff-55b661017aaf admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:10.275129 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba593e5-6539-410c-b85c-1403c705bc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:10.276039 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba593e5-6539-410c-b85c-1403c705bc30 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:10.276310 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba593e5-6539-410c-b85c-1403c705bc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:10.276595 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba593e5-6539-410c-b85c-1403c705bc30 admin admin] PATH_INFO: `/v3/projects/9bc1aa4fa6b34dd2830ec66acea53073/users/135dcf91b4ed41f6889ef16df3bf0a93/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:10.292030 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba593e5-6539-410c-b85c-1403c705bc30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bc1aa4fa6b34dd2830ec66acea53073, user_id=135dcf91b4ed41f6889ef16df3bf0a93, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:10.295129 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba593e5-6539-410c-b85c-1403c705bc30 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:10.308528 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1251/2476] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:12:10 2022] PUT /identity/v3/projects/9bc1aa4fa6b34dd2830ec66acea53073/users/135dcf91b4ed41f6889ef16df3bf0a93/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:12:10.312554 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-bebe3a35-ac6b-42f0-b2d6-872641c76914 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b25ff8c7eca4156a4755c83729be14e'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:10.312689 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba593e5-6539-410c-b85c-1403c705bc30 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:10.313216 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-bebe3a35-ac6b-42f0-b2d6-872641c76914 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b25ff8c7eca4156a4755c83729be14e'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:10.314428 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-cba593e5-6539-410c-b85c-1403c705bc30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:10.325940 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-bebe3a35-ac6b-42f0-b2d6-872641c76914 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b25ff8c7eca4156a4755c83729be14e'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:10.326844 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-bebe3a35-ac6b-42f0-b2d6-872641c76914 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b25ff8c7eca4156a4755c83729be14e'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:10.333588 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-bebe3a35-ac6b-42f0-b2d6-872641c76914 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b25ff8c7eca4156a4755c83729be14e'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:10.348383 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1226/2477] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:12:10 2022] DELETE /identity/v3/users/6b25ff8c7eca4156a4755c83729be14e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:12:10.352895 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410411a-2a9b-458d-bdc8-82450b2a57de None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:10.353172 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410411a-2a9b-458d-bdc8-82450b2a57de None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:10.353442 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410411a-2a9b-458d-bdc8-82450b2a57de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:10.371754 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-f410411a-2a9b-458d-bdc8-82450b2a57de None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:10.373101 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-f410411a-2a9b-458d-bdc8-82450b2a57de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:10.382563 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba593e5-6539-410c-b85c-1403c705bc30 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:10.436842 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1227/2478] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:12:10.442887 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c97424-5235-42d9-9f1b-1eccee5c1caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:10.443626 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c97424-5235-42d9-9f1b-1eccee5c1caf admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:10.443987 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c97424-5235-42d9-9f1b-1eccee5c1caf admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:10.444308 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c97424-5235-42d9-9f1b-1eccee5c1caf admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:10.445080 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c97424-5235-42d9-9f1b-1eccee5c1caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:10.446559 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410411a-2a9b-458d-bdc8-82450b2a57de None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:10.446690 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c97424-5235-42d9-9f1b-1eccee5c1caf admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:10.447940 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-f410411a-2a9b-458d-bdc8-82450b2a57de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:10.458220 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1252/2479] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:12:10.462423 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c97424-5235-42d9-9f1b-1eccee5c1caf admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:10.472498 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c97424-5235-42d9-9f1b-1eccee5c1caf admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:10.477354 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7331708-1d28-4b1f-9dd5-2ad8a757399e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:10.478221 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7331708-1d28-4b1f-9dd5-2ad8a757399e admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:10.478497 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7331708-1d28-4b1f-9dd5-2ad8a757399e admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:10.478763 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7331708-1d28-4b1f-9dd5-2ad8a757399e admin admin] PATH_INFO: `/v3/projects/9bc1aa4fa6b34dd2830ec66acea53073/users/135dcf91b4ed41f6889ef16df3bf0a93/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:10.480916 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7331708-1d28-4b1f-9dd5-2ad8a757399e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bc1aa4fa6b34dd2830ec66acea53073, user_id=135dcf91b4ed41f6889ef16df3bf0a93, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:10.483579 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7331708-1d28-4b1f-9dd5-2ad8a757399e admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:10.493707 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1253/2480] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:12:10 2022] PUT /identity/v3/projects/9bc1aa4fa6b34dd2830ec66acea53073/users/135dcf91b4ed41f6889ef16df3bf0a93/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:12:10.505243 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e969c8-508d-42cd-bd48-611bec920b93 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:10.505517 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e969c8-508d-42cd-bd48-611bec920b93 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:10.505778 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e969c8-508d-42cd-bd48-611bec920b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:10.505926 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410411a-2a9b-458d-bdc8-82450b2a57de None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:10.533071 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-20e969c8-508d-42cd-bd48-611bec920b93 None None] MFA Rules not processed for user `135dcf91b4ed41f6889ef16df3bf0a93`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:10.534369 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-20e969c8-508d-42cd-bd48-611bec920b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:10.557632 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fbcf4a-7508-4319-9fc3-159a5f001411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:10.558277 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbcf4a-7508-4319-9fc3-159a5f001411 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:10.558592 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbcf4a-7508-4319-9fc3-159a5f001411 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:10.558860 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbcf4a-7508-4319-9fc3-159a5f001411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:10.606465 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1254/2481] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:10 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:12:10.614236 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e969c8-508d-42cd-bd48-611bec920b93 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:10.615567 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-20e969c8-508d-42cd-bd48-611bec920b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:10.624428 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fbcf4a-7508-4319-9fc3-159a5f001411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:10.625888 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fbcf4a-7508-4319-9fc3-159a5f001411 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:10.635158 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1228/2482] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:12:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 03:12:10.671958 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e969c8-508d-42cd-bd48-611bec920b93 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:10.676295 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885770a-9b21-47e0-b651-138e3bed06b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:10.676950 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885770a-9b21-47e0-b651-138e3bed06b3 service cinder] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:10.677223 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885770a-9b21-47e0-b651-138e3bed06b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:10.677493 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885770a-9b21-47e0-b651-138e3bed06b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:10.688445 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885770a-9b21-47e0-b651-138e3bed06b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:10.689899 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885770a-9b21-47e0-b651-138e3bed06b3 service cinder] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:10.701121 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1255/2483] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:12:10 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 03:12:10.778784 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fbcf4a-7508-4319-9fc3-159a5f001411 service neutron] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:10.789146 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fbcf4a-7508-4319-9fc3-159a5f001411 service neutron] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:10.792852 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d443a9-53e8-44bc-ac2f-443255a9e127 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:10.793497 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d443a9-53e8-44bc-ac2f-443255a9e127 service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:10.793819 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d443a9-53e8-44bc-ac2f-443255a9e127 service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:10.794085 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d443a9-53e8-44bc-ac2f-443255a9e127 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:10.796425 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-a2d443a9-53e8-44bc-ac2f-443255a9e127 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:10.866459 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d443a9-53e8-44bc-ac2f-443255a9e127 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:10.868298 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d443a9-53e8-44bc-ac2f-443255a9e127 service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:10.878438 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1229/2484] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:12:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:12:10.909772 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885770a-9b21-47e0-b651-138e3bed06b3 service cinder] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:10.911601 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-7885770a-9b21-47e0-b651-138e3bed06b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:10.948856 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885770a-9b21-47e0-b651-138e3bed06b3 service cinder] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:10.964489 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad4444-19d1-47f4-87a9-0a363fceb3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:10.965614 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad4444-19d1-47f4-87a9-0a363fceb3de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:10.965889 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad4444-19d1-47f4-87a9-0a363fceb3de admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:10.966160 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad4444-19d1-47f4-87a9-0a363fceb3de admin admin] PATH_INFO: `/v3/projects/775a43ee917247d19efce4b4abf9c021` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:10.969372 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad4444-19d1-47f4-87a9-0a363fceb3de admin admin] RBAC: Authorizing `identity:delete_project(project_id=775a43ee917247d19efce4b4abf9c021)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:10.973318 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad4444-19d1-47f4-87a9-0a363fceb3de admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:11.039630 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-f4ad4444-19d1-47f4-87a9-0a363fceb3de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '775a43ee917247d19efce4b4abf9c021', 'request_id': 'req-f4ad4444-19d1-47f4-87a9-0a363fceb3de'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:11.049772 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-f4ad4444-19d1-47f4-87a9-0a363fceb3de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '775a43ee917247d19efce4b4abf9c021', 'request_id': 'req-f4ad4444-19d1-47f4-87a9-0a363fceb3de'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:11.058946 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-f4ad4444-19d1-47f4-87a9-0a363fceb3de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '775a43ee917247d19efce4b4abf9c021', 'request_id': 'req-f4ad4444-19d1-47f4-87a9-0a363fceb3de'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:11.072610 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-f4ad4444-19d1-47f4-87a9-0a363fceb3de admin admin] The token cache is being invalidate because project 775a43ee917247d19efce4b4abf9c021 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:12:11.072953 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-f4ad4444-19d1-47f4-87a9-0a363fceb3de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:11.074247 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-f4ad4444-19d1-47f4-87a9-0a363fceb3de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:11.076607 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1256/2485] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:12:10 2022] DELETE /identity/v3/projects/775a43ee917247d19efce4b4abf9c021 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:11.081879 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c1d9d-4674-4fbf-996c-6653471a073b None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:11.082145 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c1d9d-4674-4fbf-996c-6653471a073b None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:11.082438 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c1d9d-4674-4fbf-996c-6653471a073b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:11.106673 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-044c1d9d-4674-4fbf-996c-6653471a073b None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:11.108036 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-044c1d9d-4674-4fbf-996c-6653471a073b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:11.180732 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1230/2486] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:12:11.187705 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae3668-6a21-45f6-873c-5e1c86aae3d4 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:11.188250 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae3668-6a21-45f6-873c-5e1c86aae3d4 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:11.188697 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae3668-6a21-45f6-873c-5e1c86aae3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:11.218445 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-15ae3668-6a21-45f6-873c-5e1c86aae3d4 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:11.220351 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-15ae3668-6a21-45f6-873c-5e1c86aae3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:11.235286 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1257/2487] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:11.239657 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c1d9d-4674-4fbf-996c-6653471a073b None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:11.253600 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c1d9d-4674-4fbf-996c-6653471a073b None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:11.260168 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a703455-797c-4e22-822f-9e1380aa7889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:11.260893 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a703455-797c-4e22-822f-9e1380aa7889 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:11.261170 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a703455-797c-4e22-822f-9e1380aa7889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:11.261542 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a703455-797c-4e22-822f-9e1380aa7889 admin admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:11.268518 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a703455-797c-4e22-822f-9e1380aa7889 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:12:11.269165 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a703455-797c-4e22-822f-9e1380aa7889 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:11.274266 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a703455-797c-4e22-822f-9e1380aa7889 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:11.290147 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1231/2488] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:12:11.294867 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae3668-6a21-45f6-873c-5e1c86aae3d4 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:11.304458 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae3668-6a21-45f6-873c-5e1c86aae3d4 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:11.308892 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4a43e-6bc8-44f6-ac4b-42c7d2ce9f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:11.309899 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4a43e-6bc8-44f6-ac4b-42c7d2ce9f5b admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:11.310409 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4a43e-6bc8-44f6-ac4b-42c7d2ce9f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:11.310932 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4a43e-6bc8-44f6-ac4b-42c7d2ce9f5b admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:11.312194 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4a43e-6bc8-44f6-ac4b-42c7d2ce9f5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:11.315365 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4a43e-6bc8-44f6-ac4b-42c7d2ce9f5b admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:11.342682 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1258/2489] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:12:11 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:12:11.346961 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a703455-797c-4e22-822f-9e1380aa7889 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:11.357291 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a703455-797c-4e22-822f-9e1380aa7889 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:11.416417 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b29ad-8cd1-4d2a-a23e-8c0f464f31c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:11.417074 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b29ad-8cd1-4d2a-a23e-8c0f464f31c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:11.417280 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b29ad-8cd1-4d2a-a23e-8c0f464f31c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:11.417554 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b29ad-8cd1-4d2a-a23e-8c0f464f31c8 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:11.418327 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b29ad-8cd1-4d2a-a23e-8c0f464f31c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:11.420543 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b29ad-8cd1-4d2a-a23e-8c0f464f31c8 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:11.443395 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1232/2490] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:12:11 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:12:11.447591 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4a43e-6bc8-44f6-ac4b-42c7d2ce9f5b admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:11.459107 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4a43e-6bc8-44f6-ac4b-42c7d2ce9f5b admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:11.464403 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2389e82-a5e1-41f2-a82a-3d88fca787dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:11.465868 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2389e82-a5e1-41f2-a82a-3d88fca787dc admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:11.466370 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2389e82-a5e1-41f2-a82a-3d88fca787dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:11.466983 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2389e82-a5e1-41f2-a82a-3d88fca787dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:11.467964 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2389e82-a5e1-41f2-a82a-3d88fca787dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:11.469739 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2389e82-a5e1-41f2-a82a-3d88fca787dc admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:11.481241 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1259/2491] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:12:11.485644 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b29ad-8cd1-4d2a-a23e-8c0f464f31c8 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:11.495736 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b29ad-8cd1-4d2a-a23e-8c0f464f31c8 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:11.501468 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01fa76-1fae-4b13-9f57-a7b366f340af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:11.502388 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01fa76-1fae-4b13-9f57-a7b366f340af admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:11.502781 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01fa76-1fae-4b13-9f57-a7b366f340af admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:11.503054 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01fa76-1fae-4b13-9f57-a7b366f340af admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:11.503881 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01fa76-1fae-4b13-9f57-a7b366f340af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:11.505463 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01fa76-1fae-4b13-9f57-a7b366f340af admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:11.520055 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1233/2492] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:12:11.527150 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2389e82-a5e1-41f2-a82a-3d88fca787dc admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:11.538695 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2389e82-a5e1-41f2-a82a-3d88fca787dc admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:11.543896 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90d49d-e0a5-4bb4-a88d-7c6386827f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:11.545632 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90d49d-e0a5-4bb4-a88d-7c6386827f0e admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:11.546193 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90d49d-e0a5-4bb4-a88d-7c6386827f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:11.547308 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90d49d-e0a5-4bb4-a88d-7c6386827f0e admin admin] PATH_INFO: `/v3/projects/866ae3d20d3c413e8202a5c5110788d2/users/0e8884650cb44adc85cbf232d6e85ff2/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:11.566891 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90d49d-e0a5-4bb4-a88d-7c6386827f0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=866ae3d20d3c413e8202a5c5110788d2, user_id=0e8884650cb44adc85cbf232d6e85ff2, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:11.569650 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90d49d-e0a5-4bb4-a88d-7c6386827f0e admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:11.584922 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1260/2493] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:12:11 2022] PUT /identity/v3/projects/866ae3d20d3c413e8202a5c5110788d2/users/0e8884650cb44adc85cbf232d6e85ff2/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:11.595251 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f9ee1-b4e0-4bcb-8f41-ec42a5569281 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:11.595535 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f9ee1-b4e0-4bcb-8f41-ec42a5569281 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:11.596287 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f9ee1-b4e0-4bcb-8f41-ec42a5569281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:11.631342 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-d99f9ee1-b4e0-4bcb-8f41-ec42a5569281 None None] MFA Rules not processed for user `0e8884650cb44adc85cbf232d6e85ff2`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:11.632653 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-d99f9ee1-b4e0-4bcb-8f41-ec42a5569281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:11.697937 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1234/2494] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:11.702879 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90d49d-e0a5-4bb4-a88d-7c6386827f0e admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:11.765358 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90d49d-e0a5-4bb4-a88d-7c6386827f0e admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:11.770232 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4cc11-1306-4d46-a454-78b2aeb911db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:11.770934 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4cc11-1306-4d46-a454-78b2aeb911db admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:11.771205 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4cc11-1306-4d46-a454-78b2aeb911db admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:11.771471 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4cc11-1306-4d46-a454-78b2aeb911db admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:11.772188 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4cc11-1306-4d46-a454-78b2aeb911db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:11.774123 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4cc11-1306-4d46-a454-78b2aeb911db admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:11.808930 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1261/2495] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:12:11 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:12:11.813121 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f9ee1-b4e0-4bcb-8f41-ec42a5569281 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:11.824523 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f9ee1-b4e0-4bcb-8f41-ec42a5569281 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:11.883432 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6610a5-67ca-4ab6-b650-c4391593e399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:11.884119 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6610a5-67ca-4ab6-b650-c4391593e399 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:11.884389 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6610a5-67ca-4ab6-b650-c4391593e399 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:11.884650 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6610a5-67ca-4ab6-b650-c4391593e399 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:11.885328 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6610a5-67ca-4ab6-b650-c4391593e399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:11.887387 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6610a5-67ca-4ab6-b650-c4391593e399 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:11.909406 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1235/2496] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:12:11 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 03:12:11.915196 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4cc11-1306-4d46-a454-78b2aeb911db admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:11.926156 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4cc11-1306-4d46-a454-78b2aeb911db admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:11.931620 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa61f6c-be12-4257-98e3-912b214960c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:11.932332 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa61f6c-be12-4257-98e3-912b214960c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:11.932583 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa61f6c-be12-4257-98e3-912b214960c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:11.932843 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa61f6c-be12-4257-98e3-912b214960c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:11.934136 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa61f6c-be12-4257-98e3-912b214960c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:11.935762 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa61f6c-be12-4257-98e3-912b214960c8 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:11.946400 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1262/2497] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:12:11.951900 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6610a5-67ca-4ab6-b650-c4391593e399 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:11.968711 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6610a5-67ca-4ab6-b650-c4391593e399 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:11.978325 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c9d90-dc34-44bb-bfdb-d009ccc90e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:11.979583 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c9d90-dc34-44bb-bfdb-d009ccc90e74 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:11.979950 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c9d90-dc34-44bb-bfdb-d009ccc90e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:11.980407 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c9d90-dc34-44bb-bfdb-d009ccc90e74 admin admin] PATH_INFO: `/v3/projects/8342fbe03ccd4ccf888f393d3e7180e3/users/90ca13a5c0f74a1c95006642cd40b811/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:12.004441 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c9d90-dc34-44bb-bfdb-d009ccc90e74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8342fbe03ccd4ccf888f393d3e7180e3, user_id=90ca13a5c0f74a1c95006642cd40b811, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:12.007115 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c9d90-dc34-44bb-bfdb-d009ccc90e74 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:12.022551 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1236/2498] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:12:11 2022] PUT /identity/v3/projects/8342fbe03ccd4ccf888f393d3e7180e3/users/90ca13a5c0f74a1c95006642cd40b811/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:12.027214 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa61f6c-be12-4257-98e3-912b214960c8 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:12.042718 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa61f6c-be12-4257-98e3-912b214960c8 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:12.099868 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffae0c7-03b0-401c-b915-e38530451490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:12.100523 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffae0c7-03b0-401c-b915-e38530451490 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:12.100808 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffae0c7-03b0-401c-b915-e38530451490 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:12.101064 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffae0c7-03b0-401c-b915-e38530451490 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:12.101818 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffae0c7-03b0-401c-b915-e38530451490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:12.103412 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffae0c7-03b0-401c-b915-e38530451490 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:12.113516 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1263/2499] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:12:12.119088 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c9d90-dc34-44bb-bfdb-d009ccc90e74 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:12.130261 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c9d90-dc34-44bb-bfdb-d009ccc90e74 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:12.136446 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761d6f6-3f94-47df-b4ae-b11dd54ed619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:12.137344 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761d6f6-3f94-47df-b4ae-b11dd54ed619 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:12.137642 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761d6f6-3f94-47df-b4ae-b11dd54ed619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:12.137906 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761d6f6-3f94-47df-b4ae-b11dd54ed619 admin admin] PATH_INFO: `/v3/projects/8342fbe03ccd4ccf888f393d3e7180e3/users/90ca13a5c0f74a1c95006642cd40b811/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:12.140168 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a761d6f6-3f94-47df-b4ae-b11dd54ed619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8342fbe03ccd4ccf888f393d3e7180e3, user_id=90ca13a5c0f74a1c95006642cd40b811, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:12.142877 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a761d6f6-3f94-47df-b4ae-b11dd54ed619 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:12.153749 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1237/2500] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:12:12 2022] PUT /identity/v3/projects/8342fbe03ccd4ccf888f393d3e7180e3/users/90ca13a5c0f74a1c95006642cd40b811/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:12.166102 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1a05c-effb-461b-8336-38ae3c0d6f32 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:12.166459 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1a05c-effb-461b-8336-38ae3c0d6f32 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:12.166831 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1a05c-effb-461b-8336-38ae3c0d6f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:12.196325 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-e3c1a05c-effb-461b-8336-38ae3c0d6f32 None None] MFA Rules not processed for user `90ca13a5c0f74a1c95006642cd40b811`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:12.197495 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-e3c1a05c-effb-461b-8336-38ae3c0d6f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:12.280176 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1264/2501] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:12 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:12:12.295536 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761d6f6-3f94-47df-b4ae-b11dd54ed619 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:12.297940 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-a761d6f6-3f94-47df-b4ae-b11dd54ed619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:12.367173 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761d6f6-3f94-47df-b4ae-b11dd54ed619 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:12.371354 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b4bea-f495-44f8-b9d0-845cb3e0c0bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:12.372024 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b4bea-f495-44f8-b9d0-845cb3e0c0bb service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:12.372300 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b4bea-f495-44f8-b9d0-845cb3e0c0bb service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:12.372568 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b4bea-f495-44f8-b9d0-845cb3e0c0bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:12.381580 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690b4bea-f495-44f8-b9d0-845cb3e0c0bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:12.383017 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690b4bea-f495-44f8-b9d0-845cb3e0c0bb service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:12.392757 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1238/2502] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:12:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:12:12.426111 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1a05c-effb-461b-8336-38ae3c0d6f32 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:12.500976 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1a05c-effb-461b-8336-38ae3c0d6f32 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:12.506691 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26056305-507d-429e-94e8-81470fbaf308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:12.507561 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26056305-507d-429e-94e8-81470fbaf308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:12.507934 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26056305-507d-429e-94e8-81470fbaf308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:12.508197 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26056305-507d-429e-94e8-81470fbaf308 admin admin] PATH_INFO: `/v3/users/0e8884650cb44adc85cbf232d6e85ff2` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:12.509462 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26056305-507d-429e-94e8-81470fbaf308 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e8884650cb44adc85cbf232d6e85ff2)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:12.511381 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26056305-507d-429e-94e8-81470fbaf308 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:12.563486 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-26056305-507d-429e-94e8-81470fbaf308 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e8884650cb44adc85cbf232d6e85ff2'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:12.571009 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-26056305-507d-429e-94e8-81470fbaf308 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e8884650cb44adc85cbf232d6e85ff2'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:12.572173 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-26056305-507d-429e-94e8-81470fbaf308 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e8884650cb44adc85cbf232d6e85ff2'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:12.573056 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-26056305-507d-429e-94e8-81470fbaf308 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e8884650cb44adc85cbf232d6e85ff2'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:12.589120 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-26056305-507d-429e-94e8-81470fbaf308 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e8884650cb44adc85cbf232d6e85ff2'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:12.606471 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1265/2503] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:12:12 2022] DELETE /identity/v3/users/0e8884650cb44adc85cbf232d6e85ff2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:12.611028 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912e800-3569-41af-a93a-6f2ff3b9e6dd None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:12.611454 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912e800-3569-41af-a93a-6f2ff3b9e6dd None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:12.611585 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912e800-3569-41af-a93a-6f2ff3b9e6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:12.629434 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-1912e800-3569-41af-a93a-6f2ff3b9e6dd None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:12.630609 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-1912e800-3569-41af-a93a-6f2ff3b9e6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:12.690539 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1239/2504] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:12.701226 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26056305-507d-429e-94e8-81470fbaf308 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:12.702711 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-26056305-507d-429e-94e8-81470fbaf308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:12.769077 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26056305-507d-429e-94e8-81470fbaf308 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:12.773017 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684dffda-20c5-468e-8ec6-9f6c1abc9f84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:12.773648 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684dffda-20c5-468e-8ec6-9f6c1abc9f84 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:12.773918 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684dffda-20c5-468e-8ec6-9f6c1abc9f84 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:12.774183 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684dffda-20c5-468e-8ec6-9f6c1abc9f84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:12.783866 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684dffda-20c5-468e-8ec6-9f6c1abc9f84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:12.785288 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684dffda-20c5-468e-8ec6-9f6c1abc9f84 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:12.795694 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1266/2505] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:12:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 03:12:13.075939 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912e800-3569-41af-a93a-6f2ff3b9e6dd None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:13.078116 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-1912e800-3569-41af-a93a-6f2ff3b9e6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:13.094064 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912e800-3569-41af-a93a-6f2ff3b9e6dd None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:13.098909 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ec29b-af53-472c-8682-db5f6994f407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:13.100495 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ec29b-af53-472c-8682-db5f6994f407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:13.101108 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ec29b-af53-472c-8682-db5f6994f407 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:13.101400 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ec29b-af53-472c-8682-db5f6994f407 admin admin] PATH_INFO: `/v3/projects/866ae3d20d3c413e8202a5c5110788d2` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:13.102569 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ec29b-af53-472c-8682-db5f6994f407 admin admin] RBAC: Authorizing `identity:delete_project(project_id=866ae3d20d3c413e8202a5c5110788d2)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:13.104567 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ec29b-af53-472c-8682-db5f6994f407 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:13.153718 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-fc1ec29b-af53-472c-8682-db5f6994f407 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '866ae3d20d3c413e8202a5c5110788d2', 'request_id': 'req-fc1ec29b-af53-472c-8682-db5f6994f407'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:13.162302 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-fc1ec29b-af53-472c-8682-db5f6994f407 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '866ae3d20d3c413e8202a5c5110788d2', 'request_id': 'req-fc1ec29b-af53-472c-8682-db5f6994f407'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:13.168680 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-fc1ec29b-af53-472c-8682-db5f6994f407 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '866ae3d20d3c413e8202a5c5110788d2', 'request_id': 'req-fc1ec29b-af53-472c-8682-db5f6994f407'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:13.178445 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-fc1ec29b-af53-472c-8682-db5f6994f407 admin admin] The token cache is being invalidate because project 866ae3d20d3c413e8202a5c5110788d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:12:13.178729 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-fc1ec29b-af53-472c-8682-db5f6994f407 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:13.179363 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-fc1ec29b-af53-472c-8682-db5f6994f407 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:13.180909 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1240/2506] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:12:13 2022] DELETE /identity/v3/projects/866ae3d20d3c413e8202a5c5110788d2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:13.185456 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684dffda-20c5-468e-8ec6-9f6c1abc9f84 service neutron] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:13.194780 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684dffda-20c5-468e-8ec6-9f6c1abc9f84 service neutron] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:13.252340 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a1181-b4f3-41b6-b5e0-5a8a698b04e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:13.253517 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a1181-b4f3-41b6-b5e0-5a8a698b04e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:13.253949 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a1181-b4f3-41b6-b5e0-5a8a698b04e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:13.254646 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a1181-b4f3-41b6-b5e0-5a8a698b04e5 admin admin] PATH_INFO: `/v3/users/90ca13a5c0f74a1c95006642cd40b811` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:13.255906 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a1181-b4f3-41b6-b5e0-5a8a698b04e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90ca13a5c0f74a1c95006642cd40b811)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:13.258002 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a1181-b4f3-41b6-b5e0-5a8a698b04e5 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:13.318148 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-db7a1181-b4f3-41b6-b5e0-5a8a698b04e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90ca13a5c0f74a1c95006642cd40b811'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:13.327609 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-db7a1181-b4f3-41b6-b5e0-5a8a698b04e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90ca13a5c0f74a1c95006642cd40b811'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:13.328373 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-db7a1181-b4f3-41b6-b5e0-5a8a698b04e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90ca13a5c0f74a1c95006642cd40b811'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:13.328982 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-db7a1181-b4f3-41b6-b5e0-5a8a698b04e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90ca13a5c0f74a1c95006642cd40b811'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:13.340247 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-db7a1181-b4f3-41b6-b5e0-5a8a698b04e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90ca13a5c0f74a1c95006642cd40b811'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:13.354344 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1267/2507] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:12:13 2022] DELETE /identity/v3/users/90ca13a5c0f74a1c95006642cd40b811 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:13.646777 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ec29b-af53-472c-8682-db5f6994f407 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:13.649259 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-fc1ec29b-af53-472c-8682-db5f6994f407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:13.665159 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ec29b-af53-472c-8682-db5f6994f407 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:13.728973 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b27099-631d-4bcf-b42b-40ec76a6fed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:13.729889 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b27099-631d-4bcf-b42b-40ec76a6fed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:13.730122 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b27099-631d-4bcf-b42b-40ec76a6fed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:13.730384 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b27099-631d-4bcf-b42b-40ec76a6fed9 admin admin] PATH_INFO: `/v3/projects/8342fbe03ccd4ccf888f393d3e7180e3` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:13.731680 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b27099-631d-4bcf-b42b-40ec76a6fed9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8342fbe03ccd4ccf888f393d3e7180e3)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:13.733634 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b27099-631d-4bcf-b42b-40ec76a6fed9 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:13.778860 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-55b27099-631d-4bcf-b42b-40ec76a6fed9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8342fbe03ccd4ccf888f393d3e7180e3', 'request_id': 'req-55b27099-631d-4bcf-b42b-40ec76a6fed9'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:13.785865 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-55b27099-631d-4bcf-b42b-40ec76a6fed9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8342fbe03ccd4ccf888f393d3e7180e3', 'request_id': 'req-55b27099-631d-4bcf-b42b-40ec76a6fed9'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:13.791854 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-55b27099-631d-4bcf-b42b-40ec76a6fed9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8342fbe03ccd4ccf888f393d3e7180e3', 'request_id': 'req-55b27099-631d-4bcf-b42b-40ec76a6fed9'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:13.801628 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-55b27099-631d-4bcf-b42b-40ec76a6fed9 admin admin] The token cache is being invalidate because project 8342fbe03ccd4ccf888f393d3e7180e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:12:13.801909 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-55b27099-631d-4bcf-b42b-40ec76a6fed9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:13.802526 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-55b27099-631d-4bcf-b42b-40ec76a6fed9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:13.804067 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1241/2508] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:12:13 2022] DELETE /identity/v3/projects/8342fbe03ccd4ccf888f393d3e7180e3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:13.809190 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5406ca-7b04-42ec-b2e8-fc3d3fdd0d09 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:13.809787 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5406ca-7b04-42ec-b2e8-fc3d3fdd0d09 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:13.809787 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5406ca-7b04-42ec-b2e8-fc3d3fdd0d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:13.828163 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-bc5406ca-7b04-42ec-b2e8-fc3d3fdd0d09 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:13.829380 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-bc5406ca-7b04-42ec-b2e8-fc3d3fdd0d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:13.887075 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1268/2509] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:13.898192 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dea5c0-81fb-43a2-8d6e-fddadcb51ce4 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:13.898445 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dea5c0-81fb-43a2-8d6e-fddadcb51ce4 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:13.898706 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dea5c0-81fb-43a2-8d6e-fddadcb51ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:13.918947 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-c5dea5c0-81fb-43a2-8d6e-fddadcb51ce4 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:13.920243 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-c5dea5c0-81fb-43a2-8d6e-fddadcb51ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:13.928899 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1242/2510] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:13.933397 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5406ca-7b04-42ec-b2e8-fc3d3fdd0d09 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:13.944290 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5406ca-7b04-42ec-b2e8-fc3d3fdd0d09 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:13.950579 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc62cb-e2e0-4a3a-b542-962f55f38c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:13.951227 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc62cb-e2e0-4a3a-b542-962f55f38c92 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:13.951491 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc62cb-e2e0-4a3a-b542-962f55f38c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:13.951749 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc62cb-e2e0-4a3a-b542-962f55f38c92 admin admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:13.952501 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc62cb-e2e0-4a3a-b542-962f55f38c92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:12:13.952798 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc62cb-e2e0-4a3a-b542-962f55f38c92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:13.954389 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc62cb-e2e0-4a3a-b542-962f55f38c92 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:13.966229 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1269/2511] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:12:13.971113 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dea5c0-81fb-43a2-8d6e-fddadcb51ce4 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:13.984255 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dea5c0-81fb-43a2-8d6e-fddadcb51ce4 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:13.990785 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c5abc-319d-4255-a595-bdb2fc267049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:13.991421 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c5abc-319d-4255-a595-bdb2fc267049 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:13.991690 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c5abc-319d-4255-a595-bdb2fc267049 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:13.991972 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c5abc-319d-4255-a595-bdb2fc267049 admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:13.992660 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c5abc-319d-4255-a595-bdb2fc267049 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:13.994566 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c5abc-319d-4255-a595-bdb2fc267049 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:14.023789 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1243/2512] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:12:13 2022] POST /identity/v3/projects => generated 393 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:12:14.028054 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc62cb-e2e0-4a3a-b542-962f55f38c92 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:14.038150 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc62cb-e2e0-4a3a-b542-962f55f38c92 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:14.097510 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9052e40-16b5-4aa8-a3a3-5765e1fe1a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:14.098166 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9052e40-16b5-4aa8-a3a3-5765e1fe1a88 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:14.098437 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9052e40-16b5-4aa8-a3a3-5765e1fe1a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:14.098698 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9052e40-16b5-4aa8-a3a3-5765e1fe1a88 admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:14.099367 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9052e40-16b5-4aa8-a3a3-5765e1fe1a88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:14.101323 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9052e40-16b5-4aa8-a3a3-5765e1fe1a88 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:14.121064 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1270/2513] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:12:14 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:12:14.125463 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c5abc-319d-4255-a595-bdb2fc267049 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:14.136188 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c5abc-319d-4255-a595-bdb2fc267049 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:14.141874 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf050a-0296-42d6-b089-4a575cd86b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:14.142464 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf050a-0296-42d6-b089-4a575cd86b8f admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:14.142742 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf050a-0296-42d6-b089-4a575cd86b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:14.143032 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf050a-0296-42d6-b089-4a575cd86b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:14.143765 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf050a-0296-42d6-b089-4a575cd86b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:14.145388 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf050a-0296-42d6-b089-4a575cd86b8f admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:14.155468 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1244/2514] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:12:14.159411 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9052e40-16b5-4aa8-a3a3-5765e1fe1a88 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:14.169543 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9052e40-16b5-4aa8-a3a3-5765e1fe1a88 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:14.174273 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a6b8b-ea2a-4290-871f-841081beacab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:14.174917 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a6b8b-ea2a-4290-871f-841081beacab admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:14.175186 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a6b8b-ea2a-4290-871f-841081beacab admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:14.175445 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a6b8b-ea2a-4290-871f-841081beacab admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:14.176222 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a6b8b-ea2a-4290-871f-841081beacab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:14.177797 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a6b8b-ea2a-4290-871f-841081beacab admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:14.188752 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1271/2515] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:12:14.192973 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf050a-0296-42d6-b089-4a575cd86b8f admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:14.203784 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf050a-0296-42d6-b089-4a575cd86b8f admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:14.209912 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccbc331-5a8e-4036-8d72-2cbd900f0cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:14.210833 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbc331-5a8e-4036-8d72-2cbd900f0cec admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:14.211108 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbc331-5a8e-4036-8d72-2cbd900f0cec admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:14.211418 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbc331-5a8e-4036-8d72-2cbd900f0cec admin admin] PATH_INFO: `/v3/projects/af2cb823f00b4aa899470d63a2f23601/users/58b1684cae044ff18e7050ebcc923912/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:14.226574 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccbc331-5a8e-4036-8d72-2cbd900f0cec admin admin] RBAC: Authorizing `identity:create_grant(project_id=af2cb823f00b4aa899470d63a2f23601, user_id=58b1684cae044ff18e7050ebcc923912, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:14.229455 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccbc331-5a8e-4036-8d72-2cbd900f0cec admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:14.243686 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1245/2516] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:12:14 2022] PUT /identity/v3/projects/af2cb823f00b4aa899470d63a2f23601/users/58b1684cae044ff18e7050ebcc923912/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:14.255579 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b18cd-4b15-4b9e-b7a8-46f933d99a5c None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:14.256091 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b18cd-4b15-4b9e-b7a8-46f933d99a5c None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:14.256488 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b18cd-4b15-4b9e-b7a8-46f933d99a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:14.284876 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-949b18cd-4b15-4b9e-b7a8-46f933d99a5c None None] MFA Rules not processed for user `58b1684cae044ff18e7050ebcc923912`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:14.286312 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-949b18cd-4b15-4b9e-b7a8-46f933d99a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:14.355152 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1272/2517] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:12:14.360093 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccbc331-5a8e-4036-8d72-2cbd900f0cec admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:14.423898 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccbc331-5a8e-4036-8d72-2cbd900f0cec admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:14.428540 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a8222-6e13-4474-8c9d-08a60b792b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:14.429199 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a8222-6e13-4474-8c9d-08a60b792b34 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:14.429476 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a8222-6e13-4474-8c9d-08a60b792b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:14.429739 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a8222-6e13-4474-8c9d-08a60b792b34 admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:14.430479 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a8222-6e13-4474-8c9d-08a60b792b34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:14.432448 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a8222-6e13-4474-8c9d-08a60b792b34 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:14.465342 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1246/2518] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:12:14 2022] POST /identity/v3/projects => generated 389 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 03:12:14.469898 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b18cd-4b15-4b9e-b7a8-46f933d99a5c None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:14.481225 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b18cd-4b15-4b9e-b7a8-46f933d99a5c None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:14.541705 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5f2a5-d19b-48ce-a639-db11ece85091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:14.542512 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5f2a5-d19b-48ce-a639-db11ece85091 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:14.542852 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5f2a5-d19b-48ce-a639-db11ece85091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:14.543231 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5f2a5-d19b-48ce-a639-db11ece85091 admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:14.544020 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5f2a5-d19b-48ce-a639-db11ece85091 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:14.546470 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5f2a5-d19b-48ce-a639-db11ece85091 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:14.569860 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1273/2519] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:12:14 2022] POST /identity/v3/users => generated 301 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:12:14.571395 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a8222-6e13-4474-8c9d-08a60b792b34 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:14.583244 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a8222-6e13-4474-8c9d-08a60b792b34 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:14.589419 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80130ad5-3891-47be-bc1e-dfeda7ac1fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:14.590581 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80130ad5-3891-47be-bc1e-dfeda7ac1fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:14.591139 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80130ad5-3891-47be-bc1e-dfeda7ac1fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:14.591428 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80130ad5-3891-47be-bc1e-dfeda7ac1fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:14.592338 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80130ad5-3891-47be-bc1e-dfeda7ac1fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:14.594249 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80130ad5-3891-47be-bc1e-dfeda7ac1fb5 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:14.606966 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1247/2520] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:12:14.613495 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5f2a5-d19b-48ce-a639-db11ece85091 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:14.625566 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5f2a5-d19b-48ce-a639-db11ece85091 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:14.630561 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ffbd5-37f7-4786-80ed-c50ad9a3d8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:14.631443 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ffbd5-37f7-4786-80ed-c50ad9a3d8d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:14.631709 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ffbd5-37f7-4786-80ed-c50ad9a3d8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:14.632006 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ffbd5-37f7-4786-80ed-c50ad9a3d8d6 admin admin] PATH_INFO: `/v3/projects/07256d1aea8045909706ac881a274630/users/d42d059fca5948d1993d7d72d8aced26/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:14.646640 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ffbd5-37f7-4786-80ed-c50ad9a3d8d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07256d1aea8045909706ac881a274630, user_id=d42d059fca5948d1993d7d72d8aced26, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:14.649518 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ffbd5-37f7-4786-80ed-c50ad9a3d8d6 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:14.662984 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1274/2521] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:12:14 2022] PUT /identity/v3/projects/07256d1aea8045909706ac881a274630/users/d42d059fca5948d1993d7d72d8aced26/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:12:14.667294 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80130ad5-3891-47be-bc1e-dfeda7ac1fb5 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:14.677676 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80130ad5-3891-47be-bc1e-dfeda7ac1fb5 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:14.736951 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b9c67-e572-4903-b946-55754bc10308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:14.737774 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b9c67-e572-4903-b946-55754bc10308 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:14.738178 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b9c67-e572-4903-b946-55754bc10308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:14.738413 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b9c67-e572-4903-b946-55754bc10308 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:14.739292 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b9c67-e572-4903-b946-55754bc10308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:14.740713 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b9c67-e572-4903-b946-55754bc10308 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:14.752536 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1248/2522] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:12:14.756753 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ffbd5-37f7-4786-80ed-c50ad9a3d8d6 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:14.769308 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ffbd5-37f7-4786-80ed-c50ad9a3d8d6 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:14.774269 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b98172-8127-4cd4-84f9-e323d8fcc714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:14.775163 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b98172-8127-4cd4-84f9-e323d8fcc714 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:14.775524 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b98172-8127-4cd4-84f9-e323d8fcc714 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:14.775682 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b98172-8127-4cd4-84f9-e323d8fcc714 admin admin] PATH_INFO: `/v3/projects/07256d1aea8045909706ac881a274630/users/d42d059fca5948d1993d7d72d8aced26/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:14.777979 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b98172-8127-4cd4-84f9-e323d8fcc714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07256d1aea8045909706ac881a274630, user_id=d42d059fca5948d1993d7d72d8aced26, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:14.784231 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b98172-8127-4cd4-84f9-e323d8fcc714 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:14.797242 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1275/2523] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:12:14 2022] PUT /identity/v3/projects/07256d1aea8045909706ac881a274630/users/d42d059fca5948d1993d7d72d8aced26/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:14.808729 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cbcf2-4cc9-426e-9ffe-667494906ed5 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:14.809220 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cbcf2-4cc9-426e-9ffe-667494906ed5 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:14.809487 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cbcf2-4cc9-426e-9ffe-667494906ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:14.849000 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-d52cbcf2-4cc9-426e-9ffe-667494906ed5 None None] MFA Rules not processed for user `d42d059fca5948d1993d7d72d8aced26`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:14.850315 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-d52cbcf2-4cc9-426e-9ffe-667494906ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:14.918916 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1249/2524] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:14 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:14.929603 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b98172-8127-4cd4-84f9-e323d8fcc714 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:14.931537 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-a6b98172-8127-4cd4-84f9-e323d8fcc714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:14.990493 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b98172-8127-4cd4-84f9-e323d8fcc714 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:14.994524 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916dd49-0aac-4b60-8be6-bf6cfc296777 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:14.995177 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916dd49-0aac-4b60-8be6-bf6cfc296777 service cinder] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:14.995458 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916dd49-0aac-4b60-8be6-bf6cfc296777 service cinder] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:14.995764 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916dd49-0aac-4b60-8be6-bf6cfc296777 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:15.005634 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916dd49-0aac-4b60-8be6-bf6cfc296777 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:15.007098 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916dd49-0aac-4b60-8be6-bf6cfc296777 service cinder] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:15.018096 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1276/2525] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:12:14 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:12:15.068606 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cbcf2-4cc9-426e-9ffe-667494906ed5 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:15.070256 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-d52cbcf2-4cc9-426e-9ffe-667494906ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:15.084713 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cbcf2-4cc9-426e-9ffe-667494906ed5 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:15.088694 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b380c-c1db-4d36-8191-947dcd3e84d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:15.089342 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b380c-c1db-4d36-8191-947dcd3e84d9 service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:15.089618 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b380c-c1db-4d36-8191-947dcd3e84d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:15.090007 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b380c-c1db-4d36-8191-947dcd3e84d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:15.147198 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b380c-c1db-4d36-8191-947dcd3e84d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:15.148683 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b380c-c1db-4d36-8191-947dcd3e84d9 service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:15.158500 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1250/2526] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:12:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:12:22.025158 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7951fe-7c80-40ed-b541-cbe3f51d29ef None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:22.025661 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7951fe-7c80-40ed-b541-cbe3f51d29ef None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:22.026034 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7951fe-7c80-40ed-b541-cbe3f51d29ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:22.044933 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-af7951fe-7c80-40ed-b541-cbe3f51d29ef None None] MFA Rules not processed for user `5fa9975255bc4bceb902d552f99402bb`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:22.046237 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-af7951fe-7c80-40ed-b541-cbe3f51d29ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:22.102503 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1277/2527] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:22.231104 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b380c-c1db-4d36-8191-947dcd3e84d9 service cinder] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:22.232482 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-7d6b380c-c1db-4d36-8191-947dcd3e84d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:22.308975 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b380c-c1db-4d36-8191-947dcd3e84d9 service cinder] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:22.313850 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45cf74-48a0-429c-8cbb-1448269bf634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:22.314756 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45cf74-48a0-429c-8cbb-1448269bf634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:22.315022 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45cf74-48a0-429c-8cbb-1448269bf634 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:22.315281 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45cf74-48a0-429c-8cbb-1448269bf634 admin admin] PATH_INFO: `/v3/users/dfcb427f0c8749cf9be29a5b921c6e2d` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:22.316477 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af45cf74-48a0-429c-8cbb-1448269bf634 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfcb427f0c8749cf9be29a5b921c6e2d)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:22.318553 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af45cf74-48a0-429c-8cbb-1448269bf634 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:22.370117 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-af45cf74-48a0-429c-8cbb-1448269bf634 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfcb427f0c8749cf9be29a5b921c6e2d'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:22.370869 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-af45cf74-48a0-429c-8cbb-1448269bf634 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfcb427f0c8749cf9be29a5b921c6e2d'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:22.382251 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-af45cf74-48a0-429c-8cbb-1448269bf634 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfcb427f0c8749cf9be29a5b921c6e2d'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:22.382945 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-af45cf74-48a0-429c-8cbb-1448269bf634 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfcb427f0c8749cf9be29a5b921c6e2d'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:22.390476 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-af45cf74-48a0-429c-8cbb-1448269bf634 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfcb427f0c8749cf9be29a5b921c6e2d'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:22.404379 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1251/2528] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:12:22 2022] DELETE /identity/v3/users/dfcb427f0c8749cf9be29a5b921c6e2d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:22.409502 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802b637-c5e1-482b-a550-235f41ba6b1b None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:22.410069 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802b637-c5e1-482b-a550-235f41ba6b1b None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:22.410345 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802b637-c5e1-482b-a550-235f41ba6b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:22.430565 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-a802b637-c5e1-482b-a550-235f41ba6b1b None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:22.431878 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-a802b637-c5e1-482b-a550-235f41ba6b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:22.509332 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1278/2529] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:12:22.518787 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45cf74-48a0-429c-8cbb-1448269bf634 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:22.520357 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-af45cf74-48a0-429c-8cbb-1448269bf634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:22.588096 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45cf74-48a0-429c-8cbb-1448269bf634 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:22.593539 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ca018-a1c8-44cf-a2d4-5d98b2a72131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:22.594524 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ca018-a1c8-44cf-a2d4-5d98b2a72131 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:22.595080 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ca018-a1c8-44cf-a2d4-5d98b2a72131 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:22.595335 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ca018-a1c8-44cf-a2d4-5d98b2a72131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:22.606219 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05ca018-a1c8-44cf-a2d4-5d98b2a72131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:22.607762 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05ca018-a1c8-44cf-a2d4-5d98b2a72131 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:22.618106 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1252/2530] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:12:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:12:22.666224 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a802b637-c5e1-482b-a550-235f41ba6b1b None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:22.668870 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-a802b637-c5e1-482b-a550-235f41ba6b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:22.686295 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a802b637-c5e1-482b-a550-235f41ba6b1b None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:22.694000 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5621c1-b3f4-4478-9ef6-c2c793131df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:22.695012 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5621c1-b3f4-4478-9ef6-c2c793131df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:22.695349 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5621c1-b3f4-4478-9ef6-c2c793131df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:22.695680 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5621c1-b3f4-4478-9ef6-c2c793131df5 admin admin] PATH_INFO: `/v3/users/58b1684cae044ff18e7050ebcc923912` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:22.697345 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5621c1-b3f4-4478-9ef6-c2c793131df5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58b1684cae044ff18e7050ebcc923912)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:22.699606 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5621c1-b3f4-4478-9ef6-c2c793131df5 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:22.756128 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-6c5621c1-b3f4-4478-9ef6-c2c793131df5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58b1684cae044ff18e7050ebcc923912'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:22.763374 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-6c5621c1-b3f4-4478-9ef6-c2c793131df5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58b1684cae044ff18e7050ebcc923912'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:22.764464 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-6c5621c1-b3f4-4478-9ef6-c2c793131df5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58b1684cae044ff18e7050ebcc923912'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:22.765552 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-6c5621c1-b3f4-4478-9ef6-c2c793131df5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58b1684cae044ff18e7050ebcc923912'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:22.782914 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-6c5621c1-b3f4-4478-9ef6-c2c793131df5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58b1684cae044ff18e7050ebcc923912'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:22.797957 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1279/2531] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:12:22 2022] DELETE /identity/v3/users/58b1684cae044ff18e7050ebcc923912 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:22.802334 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec35db-916d-4ab7-a7e0-febfc3f5c50c None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:22.802716 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec35db-916d-4ab7-a7e0-febfc3f5c50c None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:22.803142 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec35db-916d-4ab7-a7e0-febfc3f5c50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:22.821315 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-76ec35db-916d-4ab7-a7e0-febfc3f5c50c None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:22.822756 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-76ec35db-916d-4ab7-a7e0-febfc3f5c50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:22.894364 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1253/2532] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:22.907578 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5621c1-b3f4-4478-9ef6-c2c793131df5 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:22.910129 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-6c5621c1-b3f4-4478-9ef6-c2c793131df5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:22.915652 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec35db-916d-4ab7-a7e0-febfc3f5c50c None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:22.917551 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-76ec35db-916d-4ab7-a7e0-febfc3f5c50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:22.938690 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec35db-916d-4ab7-a7e0-febfc3f5c50c None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:22.943874 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3daa5-c60b-41d7-8f98-a5db5e9a7875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:22.944988 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3daa5-c60b-41d7-8f98-a5db5e9a7875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:22.945333 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3daa5-c60b-41d7-8f98-a5db5e9a7875 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:22.945668 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3daa5-c60b-41d7-8f98-a5db5e9a7875 admin admin] PATH_INFO: `/v3/projects/73f8bed4c0a1456ab85150288aeed5b3` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:22.947256 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3daa5-c60b-41d7-8f98-a5db5e9a7875 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73f8bed4c0a1456ab85150288aeed5b3)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:22.949320 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3daa5-c60b-41d7-8f98-a5db5e9a7875 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:22.994056 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5621c1-b3f4-4478-9ef6-c2c793131df5 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:23.002253 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-25b3daa5-c60b-41d7-8f98-a5db5e9a7875 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73f8bed4c0a1456ab85150288aeed5b3', 'request_id': 'req-25b3daa5-c60b-41d7-8f98-a5db5e9a7875'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:23.013119 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-25b3daa5-c60b-41d7-8f98-a5db5e9a7875 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73f8bed4c0a1456ab85150288aeed5b3', 'request_id': 'req-25b3daa5-c60b-41d7-8f98-a5db5e9a7875'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:23.022493 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-25b3daa5-c60b-41d7-8f98-a5db5e9a7875 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73f8bed4c0a1456ab85150288aeed5b3', 'request_id': 'req-25b3daa5-c60b-41d7-8f98-a5db5e9a7875'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:23.033869 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-25b3daa5-c60b-41d7-8f98-a5db5e9a7875 admin admin] The token cache is being invalidate because project 73f8bed4c0a1456ab85150288aeed5b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:12:23.034161 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-25b3daa5-c60b-41d7-8f98-a5db5e9a7875 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:23.034869 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-25b3daa5-c60b-41d7-8f98-a5db5e9a7875 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:23.039944 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1254/2533] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:12:22 2022] DELETE /identity/v3/projects/73f8bed4c0a1456ab85150288aeed5b3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:23.040864 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3daa5-c60b-41d7-8f98-a5db5e9a7875 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:23.042458 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-25b3daa5-c60b-41d7-8f98-a5db5e9a7875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:23.049740 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b622a-6762-4863-adcc-4704d72b9336 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:23.050420 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b622a-6762-4863-adcc-4704d72b9336 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:23.050584 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b622a-6762-4863-adcc-4704d72b9336 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:23.050857 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b622a-6762-4863-adcc-4704d72b9336 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:23.052879 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-714b622a-6762-4863-adcc-4704d72b9336 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:23.118543 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3daa5-c60b-41d7-8f98-a5db5e9a7875 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:23.121813 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b622a-6762-4863-adcc-4704d72b9336 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:23.123383 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1b139-99a6-4d35-9c71-d65e2ee6d4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:23.123599 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b622a-6762-4863-adcc-4704d72b9336 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:23.124446 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1b139-99a6-4d35-9c71-d65e2ee6d4aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:23.124714 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1b139-99a6-4d35-9c71-d65e2ee6d4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:23.124976 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1b139-99a6-4d35-9c71-d65e2ee6d4aa admin admin] PATH_INFO: `/v3/users/c2828e10d1f243438af92712c3c98f5a` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:23.126214 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1b139-99a6-4d35-9c71-d65e2ee6d4aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2828e10d1f243438af92712c3c98f5a)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:23.128403 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1b139-99a6-4d35-9c71-d65e2ee6d4aa admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:23.134096 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1280/2534] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:12:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 03:12:23.181425 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-b6c1b139-99a6-4d35-9c71-d65e2ee6d4aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2828e10d1f243438af92712c3c98f5a'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:23.184609 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-b6c1b139-99a6-4d35-9c71-d65e2ee6d4aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2828e10d1f243438af92712c3c98f5a'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:23.198875 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-b6c1b139-99a6-4d35-9c71-d65e2ee6d4aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2828e10d1f243438af92712c3c98f5a'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:23.199653 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-b6c1b139-99a6-4d35-9c71-d65e2ee6d4aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2828e10d1f243438af92712c3c98f5a'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:23.208342 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-b6c1b139-99a6-4d35-9c71-d65e2ee6d4aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2828e10d1f243438af92712c3c98f5a'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:23.224202 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1255/2535] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:12:23 2022] DELETE /identity/v3/users/c2828e10d1f243438af92712c3c98f5a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:23.504908 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b622a-6762-4863-adcc-4704d72b9336 service neutron] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:23.506655 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-714b622a-6762-4863-adcc-4704d72b9336 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:23.531957 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b622a-6762-4863-adcc-4704d72b9336 service neutron] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:23.604079 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1b139-99a6-4d35-9c71-d65e2ee6d4aa admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:23.607670 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-b6c1b139-99a6-4d35-9c71-d65e2ee6d4aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:23.660000 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d9c90-315e-40d6-8660-dd34a1653fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:23.662793 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d9c90-315e-40d6-8660-dd34a1653fc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:23.663089 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d9c90-315e-40d6-8660-dd34a1653fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:23.663510 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d9c90-315e-40d6-8660-dd34a1653fc8 admin admin] PATH_INFO: `/v3/projects/af2cb823f00b4aa899470d63a2f23601` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:23.664999 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d9c90-315e-40d6-8660-dd34a1653fc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af2cb823f00b4aa899470d63a2f23601)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:23.669045 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d9c90-315e-40d6-8660-dd34a1653fc8 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:23.710139 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1b139-99a6-4d35-9c71-d65e2ee6d4aa admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:23.720594 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-df8d9c90-315e-40d6-8660-dd34a1653fc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af2cb823f00b4aa899470d63a2f23601', 'request_id': 'req-df8d9c90-315e-40d6-8660-dd34a1653fc8'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:23.728180 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-df8d9c90-315e-40d6-8660-dd34a1653fc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af2cb823f00b4aa899470d63a2f23601', 'request_id': 'req-df8d9c90-315e-40d6-8660-dd34a1653fc8'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:23.734894 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-df8d9c90-315e-40d6-8660-dd34a1653fc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af2cb823f00b4aa899470d63a2f23601', 'request_id': 'req-df8d9c90-315e-40d6-8660-dd34a1653fc8'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:23.744892 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-df8d9c90-315e-40d6-8660-dd34a1653fc8 admin admin] The token cache is being invalidate because project af2cb823f00b4aa899470d63a2f23601 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:12:23.745246 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-df8d9c90-315e-40d6-8660-dd34a1653fc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:23.745883 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-df8d9c90-315e-40d6-8660-dd34a1653fc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:23.747442 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1281/2536] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:12:23 2022] DELETE /identity/v3/projects/af2cb823f00b4aa899470d63a2f23601 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:23.751574 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d9c90-315e-40d6-8660-dd34a1653fc8 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:23.753001 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-df8d9c90-315e-40d6-8660-dd34a1653fc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:23.766810 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e14e0-ef96-4f64-872d-d271c6f49166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:23.767747 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e14e0-ef96-4f64-872d-d271c6f49166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:23.768039 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e14e0-ef96-4f64-872d-d271c6f49166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:23.768312 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e14e0-ef96-4f64-872d-d271c6f49166 admin admin] PATH_INFO: `/v3/projects/258357e7f74b4cc285a187d755a31b59` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:23.769484 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e14e0-ef96-4f64-872d-d271c6f49166 admin admin] RBAC: Authorizing `identity:delete_project(project_id=258357e7f74b4cc285a187d755a31b59)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:23.771408 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e14e0-ef96-4f64-872d-d271c6f49166 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:23.815877 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-2b7e14e0-ef96-4f64-872d-d271c6f49166 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '258357e7f74b4cc285a187d755a31b59', 'request_id': 'req-2b7e14e0-ef96-4f64-872d-d271c6f49166'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:23.816185 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d9c90-315e-40d6-8660-dd34a1653fc8 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:23.823536 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-2b7e14e0-ef96-4f64-872d-d271c6f49166 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '258357e7f74b4cc285a187d755a31b59', 'request_id': 'req-2b7e14e0-ef96-4f64-872d-d271c6f49166'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:23.831392 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-2b7e14e0-ef96-4f64-872d-d271c6f49166 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '258357e7f74b4cc285a187d755a31b59', 'request_id': 'req-2b7e14e0-ef96-4f64-872d-d271c6f49166'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:23.842092 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-2b7e14e0-ef96-4f64-872d-d271c6f49166 admin admin] The token cache is being invalidate because project 258357e7f74b4cc285a187d755a31b59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:12:23.842435 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-2b7e14e0-ef96-4f64-872d-d271c6f49166 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:23.843102 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-2b7e14e0-ef96-4f64-872d-d271c6f49166 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:23.844756 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1256/2537] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:12:23 2022] DELETE /identity/v3/projects/258357e7f74b4cc285a187d755a31b59 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:12:23.849570 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c9c5d-f06b-4b5d-b207-364ac13834ad None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:23.849848 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c9c5d-f06b-4b5d-b207-364ac13834ad None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:23.850119 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c9c5d-f06b-4b5d-b207-364ac13834ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:23.868023 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-166c9c5d-f06b-4b5d-b207-364ac13834ad None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:23.869210 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-166c9c5d-f06b-4b5d-b207-364ac13834ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:23.877338 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76b3c3-047d-4fc4-98a0-64cabcd880ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:23.878242 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76b3c3-047d-4fc4-98a0-64cabcd880ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:23.878512 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76b3c3-047d-4fc4-98a0-64cabcd880ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:23.878776 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76b3c3-047d-4fc4-98a0-64cabcd880ea admin admin] PATH_INFO: `/v3/users/d42d059fca5948d1993d7d72d8aced26` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:23.879999 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76b3c3-047d-4fc4-98a0-64cabcd880ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=d42d059fca5948d1993d7d72d8aced26)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:23.881919 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76b3c3-047d-4fc4-98a0-64cabcd880ea admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:23.926946 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-6b76b3c3-047d-4fc4-98a0-64cabcd880ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd42d059fca5948d1993d7d72d8aced26'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:23.928358 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1257/2538] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:12:23.933883 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-6b76b3c3-047d-4fc4-98a0-64cabcd880ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd42d059fca5948d1993d7d72d8aced26'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:23.934573 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-6b76b3c3-047d-4fc4-98a0-64cabcd880ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd42d059fca5948d1993d7d72d8aced26'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:23.935430 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-6b76b3c3-047d-4fc4-98a0-64cabcd880ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd42d059fca5948d1993d7d72d8aced26'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:23.937380 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c426839-836d-4275-8f47-b21eb10f0b42 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:23.937904 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c426839-836d-4275-8f47-b21eb10f0b42 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:23.938379 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c426839-836d-4275-8f47-b21eb10f0b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:23.947636 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-6b76b3c3-047d-4fc4-98a0-64cabcd880ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd42d059fca5948d1993d7d72d8aced26'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:23.962023 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-1c426839-836d-4275-8f47-b21eb10f0b42 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:23.963235 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-1c426839-836d-4275-8f47-b21eb10f0b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:23.963823 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1282/2539] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:12:23 2022] DELETE /identity/v3/users/d42d059fca5948d1993d7d72d8aced26 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:12:24.034091 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1258/2540] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:24.038625 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76b3c3-047d-4fc4-98a0-64cabcd880ea admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:24.048953 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76b3c3-047d-4fc4-98a0-64cabcd880ea admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:24.054993 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa6944-f14e-4b9f-a628-015733ab1412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:24.055785 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa6944-f14e-4b9f-a628-015733ab1412 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:24.056233 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa6944-f14e-4b9f-a628-015733ab1412 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:24.056586 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa6944-f14e-4b9f-a628-015733ab1412 admin admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:24.057362 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fa6944-f14e-4b9f-a628-015733ab1412 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:12:24.057859 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fa6944-f14e-4b9f-a628-015733ab1412 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:24.059542 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fa6944-f14e-4b9f-a628-015733ab1412 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:24.077159 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1283/2541] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 03:12:24.082264 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c426839-836d-4275-8f47-b21eb10f0b42 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:24.093659 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c426839-836d-4275-8f47-b21eb10f0b42 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:24.100101 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edbad3-a2ba-4c84-be8f-0b629ca92111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:24.100774 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edbad3-a2ba-4c84-be8f-0b629ca92111 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:24.101050 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edbad3-a2ba-4c84-be8f-0b629ca92111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:24.103870 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edbad3-a2ba-4c84-be8f-0b629ca92111 admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:24.104941 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edbad3-a2ba-4c84-be8f-0b629ca92111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:24.107610 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edbad3-a2ba-4c84-be8f-0b629ca92111 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:24.147949 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1259/2542] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:12:24 2022] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 03:12:24.148517 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa6944-f14e-4b9f-a628-015733ab1412 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:24.161301 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa6944-f14e-4b9f-a628-015733ab1412 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:24.230899 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052f99e-49ea-4bf4-a421-a21531165e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:24.231622 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052f99e-49ea-4bf4-a421-a21531165e57 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:24.231940 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052f99e-49ea-4bf4-a421-a21531165e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:24.232205 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052f99e-49ea-4bf4-a421-a21531165e57 admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:24.232986 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052f99e-49ea-4bf4-a421-a21531165e57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:24.235048 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052f99e-49ea-4bf4-a421-a21531165e57 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:24.264015 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1284/2543] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:12:24 2022] POST /identity/v3/users => generated 286 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:12:24.268790 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edbad3-a2ba-4c84-be8f-0b629ca92111 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:24.282681 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edbad3-a2ba-4c84-be8f-0b629ca92111 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:24.287998 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c26a8c-73b5-496e-b283-dfaf9d650dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:24.288790 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c26a8c-73b5-496e-b283-dfaf9d650dac admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:24.289126 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c26a8c-73b5-496e-b283-dfaf9d650dac admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:24.289489 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c26a8c-73b5-496e-b283-dfaf9d650dac admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:24.290502 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c26a8c-73b5-496e-b283-dfaf9d650dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:24.292195 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c26a8c-73b5-496e-b283-dfaf9d650dac admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:24.303757 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1260/2544] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:12:24.308351 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052f99e-49ea-4bf4-a421-a21531165e57 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:24.318472 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052f99e-49ea-4bf4-a421-a21531165e57 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:24.323473 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8dae55-696f-4b8a-9ad1-6bf7a9d19a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:24.324285 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8dae55-696f-4b8a-9ad1-6bf7a9d19a38 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:24.324658 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8dae55-696f-4b8a-9ad1-6bf7a9d19a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:24.325367 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8dae55-696f-4b8a-9ad1-6bf7a9d19a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:24.326213 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8dae55-696f-4b8a-9ad1-6bf7a9d19a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:24.328666 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8dae55-696f-4b8a-9ad1-6bf7a9d19a38 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:24.339953 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1285/2545] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:12:24.345162 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c26a8c-73b5-496e-b283-dfaf9d650dac admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:24.356038 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c26a8c-73b5-496e-b283-dfaf9d650dac admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:24.362058 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb4e61-234e-4475-a872-32609cb95173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:24.363165 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb4e61-234e-4475-a872-32609cb95173 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:24.363473 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb4e61-234e-4475-a872-32609cb95173 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:24.363695 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb4e61-234e-4475-a872-32609cb95173 admin admin] PATH_INFO: `/v3/projects/a323680ea87f4de481b5d98c0320d851/users/bd750a57e51a4b908c78568d08cba1f1/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:24.380957 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb4e61-234e-4475-a872-32609cb95173 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a323680ea87f4de481b5d98c0320d851, user_id=bd750a57e51a4b908c78568d08cba1f1, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:24.383693 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb4e61-234e-4475-a872-32609cb95173 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:24.390453 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8dae55-696f-4b8a-9ad1-6bf7a9d19a38 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:24.392363 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-ad8dae55-696f-4b8a-9ad1-6bf7a9d19a38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:24.406371 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1261/2546] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:12:24 2022] PUT /identity/v3/projects/a323680ea87f4de481b5d98c0320d851/users/bd750a57e51a4b908c78568d08cba1f1/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:24.407031 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8dae55-696f-4b8a-9ad1-6bf7a9d19a38 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:24.419459 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbbf71-391d-4e93-b518-69c8e61e8506 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:24.419804 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbbf71-391d-4e93-b518-69c8e61e8506 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:24.420426 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbbf71-391d-4e93-b518-69c8e61e8506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:24.452841 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-f0cbbf71-391d-4e93-b518-69c8e61e8506 None None] MFA Rules not processed for user `bd750a57e51a4b908c78568d08cba1f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:24.454343 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-f0cbbf71-391d-4e93-b518-69c8e61e8506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:24.484585 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8437f4a-bbc6-4613-a5bb-4c8ed6d0477e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:24.485600 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8437f4a-bbc6-4613-a5bb-4c8ed6d0477e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:24.485930 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8437f4a-bbc6-4613-a5bb-4c8ed6d0477e admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:24.486270 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8437f4a-bbc6-4613-a5bb-4c8ed6d0477e admin admin] PATH_INFO: `/v3/projects/07256d1aea8045909706ac881a274630` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:24.487546 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8437f4a-bbc6-4613-a5bb-4c8ed6d0477e admin admin] RBAC: Authorizing `identity:delete_project(project_id=07256d1aea8045909706ac881a274630)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:24.489603 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8437f4a-bbc6-4613-a5bb-4c8ed6d0477e admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:24.531138 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1262/2547] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:24.543391 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-b8437f4a-bbc6-4613-a5bb-4c8ed6d0477e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07256d1aea8045909706ac881a274630', 'request_id': 'req-b8437f4a-bbc6-4613-a5bb-4c8ed6d0477e'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:24.543715 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbbf71-391d-4e93-b518-69c8e61e8506 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:24.545156 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-f0cbbf71-391d-4e93-b518-69c8e61e8506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:24.553488 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-b8437f4a-bbc6-4613-a5bb-4c8ed6d0477e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07256d1aea8045909706ac881a274630', 'request_id': 'req-b8437f4a-bbc6-4613-a5bb-4c8ed6d0477e'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:24.559988 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-b8437f4a-bbc6-4613-a5bb-4c8ed6d0477e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07256d1aea8045909706ac881a274630', 'request_id': 'req-b8437f4a-bbc6-4613-a5bb-4c8ed6d0477e'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:24.570909 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-b8437f4a-bbc6-4613-a5bb-4c8ed6d0477e admin admin] The token cache is being invalidate because project 07256d1aea8045909706ac881a274630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:12:24.571191 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-b8437f4a-bbc6-4613-a5bb-4c8ed6d0477e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:24.571883 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-b8437f4a-bbc6-4613-a5bb-4c8ed6d0477e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:24.577132 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1286/2548] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:12:24 2022] DELETE /identity/v3/projects/07256d1aea8045909706ac881a274630 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:24.578794 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93a577-b0d2-4fd9-ad41-a2f9bdf037be None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:24.579014 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93a577-b0d2-4fd9-ad41-a2f9bdf037be None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:24.579288 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93a577-b0d2-4fd9-ad41-a2f9bdf037be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:24.602685 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-0a93a577-b0d2-4fd9-ad41-a2f9bdf037be None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:24.603947 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-0a93a577-b0d2-4fd9-ad41-a2f9bdf037be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:24.612787 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbbf71-391d-4e93-b518-69c8e61e8506 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:24.665099 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1287/2549] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:24.673958 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf0280-1920-4f71-80ef-2a4b0eb776b5 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:24.674863 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf0280-1920-4f71-80ef-2a4b0eb776b5 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:24.675149 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf0280-1920-4f71-80ef-2a4b0eb776b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:24.681733 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39004456-4617-492a-a53b-3eb8d9d0bd84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:24.682341 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39004456-4617-492a-a53b-3eb8d9d0bd84 service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:24.682767 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39004456-4617-492a-a53b-3eb8d9d0bd84 service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:24.683343 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39004456-4617-492a-a53b-3eb8d9d0bd84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:24.689027 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-39004456-4617-492a-a53b-3eb8d9d0bd84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:24.701798 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-2fdf0280-1920-4f71-80ef-2a4b0eb776b5 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:24.703555 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-2fdf0280-1920-4f71-80ef-2a4b0eb776b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:24.715398 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1288/2550] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:24.720912 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf0280-1920-4f71-80ef-2a4b0eb776b5 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:24.733449 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf0280-1920-4f71-80ef-2a4b0eb776b5 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:24.739497 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9793255-1e1e-4342-a2ba-7565c8c88b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:24.740400 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9793255-1e1e-4342-a2ba-7565c8c88b9f admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:24.740744 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9793255-1e1e-4342-a2ba-7565c8c88b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:24.741073 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9793255-1e1e-4342-a2ba-7565c8c88b9f admin admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:24.741905 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9793255-1e1e-4342-a2ba-7565c8c88b9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:12:24.742259 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9793255-1e1e-4342-a2ba-7565c8c88b9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:24.744274 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9793255-1e1e-4342-a2ba-7565c8c88b9f admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:24.757143 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1289/2551] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 03:12:24.762398 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9793255-1e1e-4342-a2ba-7565c8c88b9f admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:24.764044 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39004456-4617-492a-a53b-3eb8d9d0bd84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:24.768049 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39004456-4617-492a-a53b-3eb8d9d0bd84 service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:24.775488 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9793255-1e1e-4342-a2ba-7565c8c88b9f admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:24.782008 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110cce4-0869-44ff-af2f-54b61a407007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:24.783315 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110cce4-0869-44ff-af2f-54b61a407007 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:24.783908 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110cce4-0869-44ff-af2f-54b61a407007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:24.784363 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110cce4-0869-44ff-af2f-54b61a407007 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:24.785100 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e110cce4-0869-44ff-af2f-54b61a407007 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:24.786813 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1263/2552] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:12:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 03:12:24.787786 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e110cce4-0869-44ff-af2f-54b61a407007 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:24.809599 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39004456-4617-492a-a53b-3eb8d9d0bd84 service cinder] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:24.811245 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-39004456-4617-492a-a53b-3eb8d9d0bd84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:24.832076 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39004456-4617-492a-a53b-3eb8d9d0bd84 service cinder] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:24.843623 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a9be5-34fa-4f71-997e-4e34fb4fb9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:24.844564 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a9be5-34fa-4f71-997e-4e34fb4fb9cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:24.844823 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a9be5-34fa-4f71-997e-4e34fb4fb9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:24.845076 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1290/2553] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:12:24 2022] POST /identity/v3/projects => generated 371 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:12:24.846227 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a9be5-34fa-4f71-997e-4e34fb4fb9cd admin admin] PATH_INFO: `/v3/users/bd750a57e51a4b908c78568d08cba1f1` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:24.847502 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a9be5-34fa-4f71-997e-4e34fb4fb9cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd750a57e51a4b908c78568d08cba1f1)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:24.849510 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a9be5-34fa-4f71-997e-4e34fb4fb9cd admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:24.850294 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110cce4-0869-44ff-af2f-54b61a407007 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:24.915026 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-912a9be5-34fa-4f71-997e-4e34fb4fb9cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd750a57e51a4b908c78568d08cba1f1'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:24.916406 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-912a9be5-34fa-4f71-997e-4e34fb4fb9cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd750a57e51a4b908c78568d08cba1f1'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:24.933290 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-912a9be5-34fa-4f71-997e-4e34fb4fb9cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd750a57e51a4b908c78568d08cba1f1'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:24.937787 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110cce4-0869-44ff-af2f-54b61a407007 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:24.938014 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-912a9be5-34fa-4f71-997e-4e34fb4fb9cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd750a57e51a4b908c78568d08cba1f1'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:24.944168 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e4f28-d2ec-4ec2-9e6e-fa871a9fafa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:24.944896 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e4f28-d2ec-4ec2-9e6e-fa871a9fafa6 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:24.945198 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e4f28-d2ec-4ec2-9e6e-fa871a9fafa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:24.945534 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e4f28-d2ec-4ec2-9e6e-fa871a9fafa6 admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:24.946233 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e4f28-d2ec-4ec2-9e6e-fa871a9fafa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:24.948713 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e4f28-d2ec-4ec2-9e6e-fa871a9fafa6 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:24.957227 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-912a9be5-34fa-4f71-997e-4e34fb4fb9cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd750a57e51a4b908c78568d08cba1f1'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:24.973572 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1291/2554] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:12:24 2022] POST /identity/v3/users => generated 286 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:12:24.977730 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e4f28-d2ec-4ec2-9e6e-fa871a9fafa6 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:24.981048 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-170e4f28-d2ec-4ec2-9e6e-fa871a9fafa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:24.985228 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1264/2555] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:12:24 2022] DELETE /identity/v3/users/bd750a57e51a4b908c78568d08cba1f1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:12:24.987330 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6be826-fc78-4d74-857f-0c8a31d7e64f None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:24.987611 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6be826-fc78-4d74-857f-0c8a31d7e64f None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:24.987914 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6be826-fc78-4d74-857f-0c8a31d7e64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:25.002287 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e4f28-d2ec-4ec2-9e6e-fa871a9fafa6 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:25.006563 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-5d6be826-fc78-4d74-857f-0c8a31d7e64f None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:25.007797 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-5d6be826-fc78-4d74-857f-0c8a31d7e64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:25.067803 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d46de-a99a-4a16-97aa-9bf3e64f4791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:25.068533 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d46de-a99a-4a16-97aa-9bf3e64f4791 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:25.068813 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d46de-a99a-4a16-97aa-9bf3e64f4791 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:25.069080 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d46de-a99a-4a16-97aa-9bf3e64f4791 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:25.069810 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d46de-a99a-4a16-97aa-9bf3e64f4791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:25.071442 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d46de-a99a-4a16-97aa-9bf3e64f4791 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:25.073383 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1265/2556] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:12:25.083890 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1292/2557] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:12:25.085915 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6be826-fc78-4d74-857f-0c8a31d7e64f None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:25.086520 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-5d6be826-fc78-4d74-857f-0c8a31d7e64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:25.087292 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d46de-a99a-4a16-97aa-9bf3e64f4791 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:25.101743 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d46de-a99a-4a16-97aa-9bf3e64f4791 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:25.111425 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfd4c6-54bf-41a3-9711-7fdaf76bd2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:25.112945 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfd4c6-54bf-41a3-9711-7fdaf76bd2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:25.113379 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfd4c6-54bf-41a3-9711-7fdaf76bd2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:25.114267 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfd4c6-54bf-41a3-9711-7fdaf76bd2f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:25.115180 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfd4c6-54bf-41a3-9711-7fdaf76bd2f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:25.117360 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfd4c6-54bf-41a3-9711-7fdaf76bd2f2 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:25.131764 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1293/2558] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:12:25.134059 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfd4c6-54bf-41a3-9711-7fdaf76bd2f2 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:25.147981 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfd4c6-54bf-41a3-9711-7fdaf76bd2f2 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:25.153659 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811bd7fb-057b-4050-a0e8-e6a233c06dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:25.154637 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bd7fb-057b-4050-a0e8-e6a233c06dc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:25.155050 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bd7fb-057b-4050-a0e8-e6a233c06dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:25.155533 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bd7fb-057b-4050-a0e8-e6a233c06dc5 admin admin] PATH_INFO: `/v3/projects/eeea45d6403e440a93d21a4b68091572/users/1007ee9de6814cfaa9e6ffe506cfb58b/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:25.161905 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6be826-fc78-4d74-857f-0c8a31d7e64f None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:25.167075 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9afeb-d342-4741-8987-8f32e630f656 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:25.167233 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9afeb-d342-4741-8987-8f32e630f656 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:25.167586 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9afeb-d342-4741-8987-8f32e630f656 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:25.168178 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9afeb-d342-4741-8987-8f32e630f656 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:25.174992 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811bd7fb-057b-4050-a0e8-e6a233c06dc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeea45d6403e440a93d21a4b68091572, user_id=1007ee9de6814cfaa9e6ffe506cfb58b, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:25.178079 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811bd7fb-057b-4050-a0e8-e6a233c06dc5 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:25.181056 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9afeb-d342-4741-8987-8f32e630f656 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:25.182716 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9afeb-d342-4741-8987-8f32e630f656 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:25.197665 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1266/2559] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:12:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:12:25.202478 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1294/2560] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:12:25 2022] PUT /identity/v3/projects/eeea45d6403e440a93d21a4b68091572/users/1007ee9de6814cfaa9e6ffe506cfb58b/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:12:25.207439 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66927bb-f717-4cb0-8af1-2d1403f3e850 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:25.211994 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66927bb-f717-4cb0-8af1-2d1403f3e850 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:25.212292 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66927bb-f717-4cb0-8af1-2d1403f3e850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:25.242236 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-e66927bb-f717-4cb0-8af1-2d1403f3e850 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:25.243668 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-e66927bb-f717-4cb0-8af1-2d1403f3e850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:25.318524 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1267/2561] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:25.331423 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811bd7fb-057b-4050-a0e8-e6a233c06dc5 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:25.333957 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-811bd7fb-057b-4050-a0e8-e6a233c06dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:25.397828 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811bd7fb-057b-4050-a0e8-e6a233c06dc5 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:25.401618 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08afbd47-5683-4f14-9f90-98bef07036f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:25.402335 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08afbd47-5683-4f14-9f90-98bef07036f2 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:25.402673 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08afbd47-5683-4f14-9f90-98bef07036f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:25.402999 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08afbd47-5683-4f14-9f90-98bef07036f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:25.412843 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08afbd47-5683-4f14-9f90-98bef07036f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:25.414393 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08afbd47-5683-4f14-9f90-98bef07036f2 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:25.425713 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1295/2562] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:12:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:12:25.700309 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66927bb-f717-4cb0-8af1-2d1403f3e850 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:25.701973 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-e66927bb-f717-4cb0-8af1-2d1403f3e850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:25.713912 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66927bb-f717-4cb0-8af1-2d1403f3e850 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:25.719828 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a1991-4810-4bc1-b9a1-1685525ee8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:25.720702 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a1991-4810-4bc1-b9a1-1685525ee8d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:25.720973 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a1991-4810-4bc1-b9a1-1685525ee8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:25.721239 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a1991-4810-4bc1-b9a1-1685525ee8d8 admin admin] PATH_INFO: `/v3/projects/a323680ea87f4de481b5d98c0320d851` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:25.722513 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a1991-4810-4bc1-b9a1-1685525ee8d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a323680ea87f4de481b5d98c0320d851)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:25.724501 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a1991-4810-4bc1-b9a1-1685525ee8d8 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:25.776059 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-327a1991-4810-4bc1-b9a1-1685525ee8d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a323680ea87f4de481b5d98c0320d851', 'request_id': 'req-327a1991-4810-4bc1-b9a1-1685525ee8d8'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:25.784817 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-327a1991-4810-4bc1-b9a1-1685525ee8d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a323680ea87f4de481b5d98c0320d851', 'request_id': 'req-327a1991-4810-4bc1-b9a1-1685525ee8d8'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:25.792405 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-327a1991-4810-4bc1-b9a1-1685525ee8d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a323680ea87f4de481b5d98c0320d851', 'request_id': 'req-327a1991-4810-4bc1-b9a1-1685525ee8d8'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:25.804052 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-327a1991-4810-4bc1-b9a1-1685525ee8d8 admin admin] The token cache is being invalidate because project a323680ea87f4de481b5d98c0320d851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:12:25.804325 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-327a1991-4810-4bc1-b9a1-1685525ee8d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:25.804968 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-327a1991-4810-4bc1-b9a1-1685525ee8d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:25.806818 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1268/2563] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:12:25 2022] DELETE /identity/v3/projects/a323680ea87f4de481b5d98c0320d851 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:25.812236 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c3fb6-a107-43d7-8654-453c413e91dd None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:25.812518 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c3fb6-a107-43d7-8654-453c413e91dd None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:25.812789 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c3fb6-a107-43d7-8654-453c413e91dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:25.836724 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-268c3fb6-a107-43d7-8654-453c413e91dd None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:25.838416 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-268c3fb6-a107-43d7-8654-453c413e91dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:25.901694 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1296/2564] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:25.909932 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e78fb-fbae-494c-9733-5c8092fe87fa None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:25.910206 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e78fb-fbae-494c-9733-5c8092fe87fa None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:25.910469 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e78fb-fbae-494c-9733-5c8092fe87fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:25.930452 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-916e78fb-fbae-494c-9733-5c8092fe87fa None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:25.931731 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-916e78fb-fbae-494c-9733-5c8092fe87fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:25.943057 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1269/2565] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:25.947190 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c3fb6-a107-43d7-8654-453c413e91dd None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:25.961756 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c3fb6-a107-43d7-8654-453c413e91dd None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:25.979120 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfca240-e5d5-4a96-85b8-6d3207fd868b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:25.979898 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfca240-e5d5-4a96-85b8-6d3207fd868b admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:25.980177 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfca240-e5d5-4a96-85b8-6d3207fd868b admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:25.980449 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfca240-e5d5-4a96-85b8-6d3207fd868b admin admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:25.981230 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfca240-e5d5-4a96-85b8-6d3207fd868b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:12:25.982121 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfca240-e5d5-4a96-85b8-6d3207fd868b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:25.983396 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfca240-e5d5-4a96-85b8-6d3207fd868b admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:25.999654 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1297/2566] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 03:12:26.000991 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e78fb-fbae-494c-9733-5c8092fe87fa None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:26.010809 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e78fb-fbae-494c-9733-5c8092fe87fa None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:26.016808 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768abcbb-0847-4a10-86ef-13ee3f74a95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:26.017577 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768abcbb-0847-4a10-86ef-13ee3f74a95e admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:26.017856 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768abcbb-0847-4a10-86ef-13ee3f74a95e admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:26.018120 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768abcbb-0847-4a10-86ef-13ee3f74a95e admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:26.018850 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768abcbb-0847-4a10-86ef-13ee3f74a95e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:26.020879 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768abcbb-0847-4a10-86ef-13ee3f74a95e admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:26.057381 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1270/2567] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:12:25 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:12:26.061554 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfca240-e5d5-4a96-85b8-6d3207fd868b admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:26.078095 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfca240-e5d5-4a96-85b8-6d3207fd868b admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:26.160599 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a907af2-fe69-4698-8af0-d7ec1eae1458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:26.161459 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a907af2-fe69-4698-8af0-d7ec1eae1458 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:26.161843 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a907af2-fe69-4698-8af0-d7ec1eae1458 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:26.162177 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a907af2-fe69-4698-8af0-d7ec1eae1458 admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:26.162960 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a907af2-fe69-4698-8af0-d7ec1eae1458 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:26.165013 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a907af2-fe69-4698-8af0-d7ec1eae1458 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:26.194152 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1298/2568] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:12:26 2022] POST /identity/v3/users => generated 286 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:12:26.198352 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768abcbb-0847-4a10-86ef-13ee3f74a95e admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:26.211248 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768abcbb-0847-4a10-86ef-13ee3f74a95e admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:26.237552 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8303699-ed91-4d41-88f0-d54f4654a9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:26.238244 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8303699-ed91-4d41-88f0-d54f4654a9da admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:26.238521 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8303699-ed91-4d41-88f0-d54f4654a9da admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:26.238797 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8303699-ed91-4d41-88f0-d54f4654a9da admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:26.239560 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8303699-ed91-4d41-88f0-d54f4654a9da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:26.241223 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8303699-ed91-4d41-88f0-d54f4654a9da admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:26.263904 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1271/2569] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:12:26.266126 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a907af2-fe69-4698-8af0-d7ec1eae1458 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:26.279775 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a907af2-fe69-4698-8af0-d7ec1eae1458 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:26.288508 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2764ef6a-dac4-4ff8-a90a-d6146d55ab29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:26.289928 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764ef6a-dac4-4ff8-a90a-d6146d55ab29 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:26.290259 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764ef6a-dac4-4ff8-a90a-d6146d55ab29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:26.291560 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764ef6a-dac4-4ff8-a90a-d6146d55ab29 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:26.294085 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2764ef6a-dac4-4ff8-a90a-d6146d55ab29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:26.296400 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2764ef6a-dac4-4ff8-a90a-d6146d55ab29 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:26.312410 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1299/2570] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:12:26.314561 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8303699-ed91-4d41-88f0-d54f4654a9da admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:26.327044 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8303699-ed91-4d41-88f0-d54f4654a9da admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:26.353451 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2e8dd-bd51-40c6-92c8-c4134461a10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:26.354378 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2e8dd-bd51-40c6-92c8-c4134461a10b admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:26.354656 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2e8dd-bd51-40c6-92c8-c4134461a10b admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:26.354992 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2e8dd-bd51-40c6-92c8-c4134461a10b admin admin] PATH_INFO: `/v3/projects/729edaa2a27a40f897ddba50391dd29f/users/d034574e907f4903a7af70cab219f9cc/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:26.374089 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2e8dd-bd51-40c6-92c8-c4134461a10b admin admin] RBAC: Authorizing `identity:create_grant(project_id=729edaa2a27a40f897ddba50391dd29f, user_id=d034574e907f4903a7af70cab219f9cc, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:26.377344 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2e8dd-bd51-40c6-92c8-c4134461a10b admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:26.395607 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1272/2571] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:12:26 2022] PUT /identity/v3/projects/729edaa2a27a40f897ddba50391dd29f/users/d034574e907f4903a7af70cab219f9cc/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:12:26.401515 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6a434-7710-47f5-b9d8-bb239d8084ef None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:26.402190 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6a434-7710-47f5-b9d8-bb239d8084ef None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:26.402362 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6a434-7710-47f5-b9d8-bb239d8084ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:26.425724 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-a8f6a434-7710-47f5-b9d8-bb239d8084ef None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:26.426949 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-a8f6a434-7710-47f5-b9d8-bb239d8084ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:26.498910 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1300/2572] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:26.512500 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2e8dd-bd51-40c6-92c8-c4134461a10b admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:26.514910 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-1ac2e8dd-bd51-40c6-92c8-c4134461a10b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:26.518905 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcf162-7562-49c4-a300-1f480fffc758 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:26.519165 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcf162-7562-49c4-a300-1f480fffc758 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:26.521158 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcf162-7562-49c4-a300-1f480fffc758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:26.551566 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-d7fcf162-7562-49c4-a300-1f480fffc758 None None] MFA Rules not processed for user `1007ee9de6814cfaa9e6ffe506cfb58b`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:26.552109 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-d7fcf162-7562-49c4-a300-1f480fffc758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:26.606358 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2e8dd-bd51-40c6-92c8-c4134461a10b admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:26.612306 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929938c-b7df-49d9-9afa-700966533107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:26.612973 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929938c-b7df-49d9-9afa-700966533107 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:26.613280 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929938c-b7df-49d9-9afa-700966533107 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:26.613513 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929938c-b7df-49d9-9afa-700966533107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:26.633664 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929938c-b7df-49d9-9afa-700966533107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:26.635351 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929938c-b7df-49d9-9afa-700966533107 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:26.635852 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1301/2573] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:26.640993 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fcf162-7562-49c4-a300-1f480fffc758 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:26.642833 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-d7fcf162-7562-49c4-a300-1f480fffc758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:26.649152 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1273/2574] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:12:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:12:26.659637 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fcf162-7562-49c4-a300-1f480fffc758 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:26.665873 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28963275-6232-4136-8986-eaa348d36459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:26.666159 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28963275-6232-4136-8986-eaa348d36459 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:26.666396 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28963275-6232-4136-8986-eaa348d36459 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:26.666660 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28963275-6232-4136-8986-eaa348d36459 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:26.667446 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28963275-6232-4136-8986-eaa348d36459 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:26.669924 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28963275-6232-4136-8986-eaa348d36459 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:26.711924 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1302/2575] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:12:26 2022] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:12:26.716809 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929938c-b7df-49d9-9afa-700966533107 service neutron] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:26.727440 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929938c-b7df-49d9-9afa-700966533107 service neutron] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:26.790775 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d17b3-546f-4a75-b161-84a8320d3d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:26.791423 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d17b3-546f-4a75-b161-84a8320d3d90 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:26.791698 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d17b3-546f-4a75-b161-84a8320d3d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:26.791998 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d17b3-546f-4a75-b161-84a8320d3d90 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:26.792680 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d17b3-546f-4a75-b161-84a8320d3d90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:26.794684 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d17b3-546f-4a75-b161-84a8320d3d90 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:26.819181 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1274/2576] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:12:26 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 03:12:26.820409 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28963275-6232-4136-8986-eaa348d36459 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:26.832525 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28963275-6232-4136-8986-eaa348d36459 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:26.849993 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697da49-ef64-4e11-850c-303f86706782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:26.850684 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697da49-ef64-4e11-850c-303f86706782 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:26.850960 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697da49-ef64-4e11-850c-303f86706782 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:26.851226 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697da49-ef64-4e11-850c-303f86706782 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:26.852002 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697da49-ef64-4e11-850c-303f86706782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:26.853619 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697da49-ef64-4e11-850c-303f86706782 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:26.868650 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1303/2577] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:12:26.870164 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d17b3-546f-4a75-b161-84a8320d3d90 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:26.881152 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d17b3-546f-4a75-b161-84a8320d3d90 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:26.886047 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4221e2a-b682-4c59-90a2-62d02c826c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:26.886941 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4221e2a-b682-4c59-90a2-62d02c826c74 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:26.887237 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4221e2a-b682-4c59-90a2-62d02c826c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:26.887505 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4221e2a-b682-4c59-90a2-62d02c826c74 admin admin] PATH_INFO: `/v3/projects/9a93d530627e4723a0826f7f4783cdef/users/98fd46c56f464bdaa7f5d7e2c41f9c95/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:26.902955 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4221e2a-b682-4c59-90a2-62d02c826c74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a93d530627e4723a0826f7f4783cdef, user_id=98fd46c56f464bdaa7f5d7e2c41f9c95, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:26.905739 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4221e2a-b682-4c59-90a2-62d02c826c74 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:26.920108 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1275/2578] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:12:26 2022] PUT /identity/v3/projects/9a93d530627e4723a0826f7f4783cdef/users/98fd46c56f464bdaa7f5d7e2c41f9c95/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:26.924384 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697da49-ef64-4e11-850c-303f86706782 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:26.936309 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697da49-ef64-4e11-850c-303f86706782 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:27.001647 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a5f56-6e50-46dc-bd0d-4889283beafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:27.002324 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a5f56-6e50-46dc-bd0d-4889283beafc admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:27.002599 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a5f56-6e50-46dc-bd0d-4889283beafc admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:27.003340 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a5f56-6e50-46dc-bd0d-4889283beafc admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:27.003948 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a5f56-6e50-46dc-bd0d-4889283beafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:27.006176 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a5f56-6e50-46dc-bd0d-4889283beafc admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:27.016720 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1304/2579] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:12:27.020843 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4221e2a-b682-4c59-90a2-62d02c826c74 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:27.033494 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4221e2a-b682-4c59-90a2-62d02c826c74 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:27.040267 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447570d2-99f6-4474-bec3-6bb56d723235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:27.040962 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447570d2-99f6-4474-bec3-6bb56d723235 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:27.041238 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447570d2-99f6-4474-bec3-6bb56d723235 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:27.041503 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447570d2-99f6-4474-bec3-6bb56d723235 admin admin] PATH_INFO: `/v3/projects/9a93d530627e4723a0826f7f4783cdef/users/98fd46c56f464bdaa7f5d7e2c41f9c95/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:27.044852 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447570d2-99f6-4474-bec3-6bb56d723235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a93d530627e4723a0826f7f4783cdef, user_id=98fd46c56f464bdaa7f5d7e2c41f9c95, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:27.047801 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447570d2-99f6-4474-bec3-6bb56d723235 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:27.060676 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1276/2580] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:12:27 2022] PUT /identity/v3/projects/9a93d530627e4723a0826f7f4783cdef/users/98fd46c56f464bdaa7f5d7e2c41f9c95/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:27.296305 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25311b6-f53c-43a1-aa44-76a24b130b93 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:27.296902 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25311b6-f53c-43a1-aa44-76a24b130b93 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:27.296902 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25311b6-f53c-43a1-aa44-76a24b130b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:27.324517 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-f25311b6-f53c-43a1-aa44-76a24b130b93 None None] MFA Rules not processed for user `d034574e907f4903a7af70cab219f9cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:27.326181 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-f25311b6-f53c-43a1-aa44-76a24b130b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:27.427941 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447570d2-99f6-4474-bec3-6bb56d723235 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:27.429736 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-447570d2-99f6-4474-bec3-6bb56d723235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:27.436047 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1305/2581] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:27.538659 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447570d2-99f6-4474-bec3-6bb56d723235 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:27.544889 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c1137-3c3b-4d51-959b-aa94569cd7bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:27.546294 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c1137-3c3b-4d51-959b-aa94569cd7bb service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:27.546776 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c1137-3c3b-4d51-959b-aa94569cd7bb service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:27.547054 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c1137-3c3b-4d51-959b-aa94569cd7bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:27.558178 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c1137-3c3b-4d51-959b-aa94569cd7bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:27.559651 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c1137-3c3b-4d51-959b-aa94569cd7bb service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:27.578020 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1277/2582] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:12:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:12:28.014490 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f751e-d774-4ad5-b253-006918678344 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:28.014973 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f751e-d774-4ad5-b253-006918678344 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:28.015423 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f751e-d774-4ad5-b253-006918678344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:28.072758 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-081f751e-d774-4ad5-b253-006918678344 None None] MFA Rules not processed for user `98fd46c56f464bdaa7f5d7e2c41f9c95`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:28.074055 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-081f751e-d774-4ad5-b253-006918678344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:28.157996 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1306/2583] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:28.170658 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c1137-3c3b-4d51-959b-aa94569cd7bb service cinder] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:28.179276 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c1137-3c3b-4d51-959b-aa94569cd7bb service cinder] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:28.183871 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d1d33-cd93-43eb-93c7-c4ab97851830 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:28.184512 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d1d33-cd93-43eb-93c7-c4ab97851830 service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:28.184785 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d1d33-cd93-43eb-93c7-c4ab97851830 service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:28.185035 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d1d33-cd93-43eb-93c7-c4ab97851830 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:28.251823 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d1d33-cd93-43eb-93c7-c4ab97851830 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:28.254094 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d1d33-cd93-43eb-93c7-c4ab97851830 service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:28.265955 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1278/2584] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:12:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:12:29.140512 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0076353-4a1b-4829-904e-1fc8ea451e32 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:29.141662 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0076353-4a1b-4829-904e-1fc8ea451e32 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:29.142190 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0076353-4a1b-4829-904e-1fc8ea451e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:29.162461 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-e0076353-4a1b-4829-904e-1fc8ea451e32 None None] MFA Rules not processed for user `d034574e907f4903a7af70cab219f9cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:29.163684 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-e0076353-4a1b-4829-904e-1fc8ea451e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:29.172386 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1307/2585] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:29.623457 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d1d33-cd93-43eb-93c7-c4ab97851830 service cinder] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:29.634657 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d1d33-cd93-43eb-93c7-c4ab97851830 service cinder] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:29.638880 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef32b4-c946-4d13-b2cd-bc270436bf7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:29.639940 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef32b4-c946-4d13-b2cd-bc270436bf7d service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:29.640432 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef32b4-c946-4d13-b2cd-bc270436bf7d service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:29.640725 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef32b4-c946-4d13-b2cd-bc270436bf7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:29.650966 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef32b4-c946-4d13-b2cd-bc270436bf7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:29.652469 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef32b4-c946-4d13-b2cd-bc270436bf7d service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:29.662372 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1279/2586] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:12:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:12:48.103042 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0076353-4a1b-4829-904e-1fc8ea451e32 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:48.166659 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abac43-b5a8-4492-8e5d-56224cd42a27 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:48.167217 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abac43-b5a8-4492-8e5d-56224cd42a27 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:48.167319 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abac43-b5a8-4492-8e5d-56224cd42a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:48.171902 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0076353-4a1b-4829-904e-1fc8ea451e32 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:48.176781 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd8351-a627-47fd-9241-c8916cd9af23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:48.177721 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd8351-a627-47fd-9241-c8916cd9af23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:48.178061 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd8351-a627-47fd-9241-c8916cd9af23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:48.178390 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd8351-a627-47fd-9241-c8916cd9af23 admin admin] PATH_INFO: `/v3/users/1007ee9de6814cfaa9e6ffe506cfb58b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:48.179623 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd8351-a627-47fd-9241-c8916cd9af23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1007ee9de6814cfaa9e6ffe506cfb58b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:48.181621 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd8351-a627-47fd-9241-c8916cd9af23 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:48.185726 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-75abac43-b5a8-4492-8e5d-56224cd42a27 None None] MFA Rules not processed for user `d034574e907f4903a7af70cab219f9cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:48.186924 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-75abac43-b5a8-4492-8e5d-56224cd42a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:48.194947 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1280/2587] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:48.230408 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-8efd8351-a627-47fd-9241-c8916cd9af23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1007ee9de6814cfaa9e6ffe506cfb58b'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:48.237559 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-8efd8351-a627-47fd-9241-c8916cd9af23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1007ee9de6814cfaa9e6ffe506cfb58b'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:48.238354 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-8efd8351-a627-47fd-9241-c8916cd9af23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1007ee9de6814cfaa9e6ffe506cfb58b'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:48.239085 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-8efd8351-a627-47fd-9241-c8916cd9af23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1007ee9de6814cfaa9e6ffe506cfb58b'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:48.251920 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-8efd8351-a627-47fd-9241-c8916cd9af23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1007ee9de6814cfaa9e6ffe506cfb58b'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:48.266664 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1308/2588] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:12:48 2022] DELETE /identity/v3/users/1007ee9de6814cfaa9e6ffe506cfb58b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:48.445257 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abac43-b5a8-4492-8e5d-56224cd42a27 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:48.457403 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abac43-b5a8-4492-8e5d-56224cd42a27 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:48.516528 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d2ada-3e14-4e25-9d6d-5ee456fd501a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:48.517447 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d2ada-3e14-4e25-9d6d-5ee456fd501a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:48.517749 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d2ada-3e14-4e25-9d6d-5ee456fd501a admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:48.518148 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d2ada-3e14-4e25-9d6d-5ee456fd501a admin admin] PATH_INFO: `/v3/projects/eeea45d6403e440a93d21a4b68091572` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:48.522203 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d2ada-3e14-4e25-9d6d-5ee456fd501a admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeea45d6403e440a93d21a4b68091572)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:48.524294 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d2ada-3e14-4e25-9d6d-5ee456fd501a admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:48.571836 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-4c4d2ada-3e14-4e25-9d6d-5ee456fd501a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeea45d6403e440a93d21a4b68091572', 'request_id': 'req-4c4d2ada-3e14-4e25-9d6d-5ee456fd501a'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:48.580193 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-4c4d2ada-3e14-4e25-9d6d-5ee456fd501a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeea45d6403e440a93d21a4b68091572', 'request_id': 'req-4c4d2ada-3e14-4e25-9d6d-5ee456fd501a'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:48.586413 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-4c4d2ada-3e14-4e25-9d6d-5ee456fd501a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeea45d6403e440a93d21a4b68091572', 'request_id': 'req-4c4d2ada-3e14-4e25-9d6d-5ee456fd501a'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:48.596993 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-4c4d2ada-3e14-4e25-9d6d-5ee456fd501a admin admin] The token cache is being invalidate because project eeea45d6403e440a93d21a4b68091572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:12:48.597503 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-4c4d2ada-3e14-4e25-9d6d-5ee456fd501a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:48.598448 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-4c4d2ada-3e14-4e25-9d6d-5ee456fd501a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:48.600279 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1281/2589] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:12:48 2022] DELETE /identity/v3/projects/eeea45d6403e440a93d21a4b68091572 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:48.604304 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd8351-a627-47fd-9241-c8916cd9af23 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:48.605793 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-8efd8351-a627-47fd-9241-c8916cd9af23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:48.619151 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd8351-a627-47fd-9241-c8916cd9af23 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:48.676595 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5901e77-12bb-4335-b3a0-d8f2e2a097b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:48.677534 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5901e77-12bb-4335-b3a0-d8f2e2a097b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:48.677815 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5901e77-12bb-4335-b3a0-d8f2e2a097b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:48.678389 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5901e77-12bb-4335-b3a0-d8f2e2a097b6 admin admin] PATH_INFO: `/v3/users/98fd46c56f464bdaa7f5d7e2c41f9c95` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:48.679864 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5901e77-12bb-4335-b3a0-d8f2e2a097b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98fd46c56f464bdaa7f5d7e2c41f9c95)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:48.682041 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5901e77-12bb-4335-b3a0-d8f2e2a097b6 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:48.739928 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a5901e77-12bb-4335-b3a0-d8f2e2a097b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98fd46c56f464bdaa7f5d7e2c41f9c95'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:48.747426 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a5901e77-12bb-4335-b3a0-d8f2e2a097b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98fd46c56f464bdaa7f5d7e2c41f9c95'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:48.748248 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a5901e77-12bb-4335-b3a0-d8f2e2a097b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98fd46c56f464bdaa7f5d7e2c41f9c95'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:48.748932 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a5901e77-12bb-4335-b3a0-d8f2e2a097b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98fd46c56f464bdaa7f5d7e2c41f9c95'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:48.762667 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a5901e77-12bb-4335-b3a0-d8f2e2a097b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98fd46c56f464bdaa7f5d7e2c41f9c95'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:48.788406 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1309/2590] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:12:48 2022] DELETE /identity/v3/users/98fd46c56f464bdaa7f5d7e2c41f9c95 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:48.974968 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d2ada-3e14-4e25-9d6d-5ee456fd501a admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:48.977019 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-4c4d2ada-3e14-4e25-9d6d-5ee456fd501a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:48.998568 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d2ada-3e14-4e25-9d6d-5ee456fd501a admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:49.092552 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eac7eb-ec79-4998-8e14-df826cac13a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:49.093421 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eac7eb-ec79-4998-8e14-df826cac13a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:49.093690 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eac7eb-ec79-4998-8e14-df826cac13a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:49.093951 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eac7eb-ec79-4998-8e14-df826cac13a5 admin admin] PATH_INFO: `/v3/projects/9a93d530627e4723a0826f7f4783cdef` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:49.095327 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eac7eb-ec79-4998-8e14-df826cac13a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a93d530627e4723a0826f7f4783cdef)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:49.097500 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eac7eb-ec79-4998-8e14-df826cac13a5 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:49.155526 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-91eac7eb-ec79-4998-8e14-df826cac13a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a93d530627e4723a0826f7f4783cdef', 'request_id': 'req-91eac7eb-ec79-4998-8e14-df826cac13a5'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:49.163074 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-91eac7eb-ec79-4998-8e14-df826cac13a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a93d530627e4723a0826f7f4783cdef', 'request_id': 'req-91eac7eb-ec79-4998-8e14-df826cac13a5'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:49.175917 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-91eac7eb-ec79-4998-8e14-df826cac13a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a93d530627e4723a0826f7f4783cdef', 'request_id': 'req-91eac7eb-ec79-4998-8e14-df826cac13a5'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:49.180511 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-91eac7eb-ec79-4998-8e14-df826cac13a5 admin admin] The token cache is being invalidate because project 9a93d530627e4723a0826f7f4783cdef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:12:49.180796 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-91eac7eb-ec79-4998-8e14-df826cac13a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:49.181443 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-91eac7eb-ec79-4998-8e14-df826cac13a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:49.183029 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1282/2591] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:12:48 2022] DELETE /identity/v3/projects/9a93d530627e4723a0826f7f4783cdef => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:49.188966 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0cd00-2c42-45b7-873e-6ee30d5885a5 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:49.189442 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0cd00-2c42-45b7-873e-6ee30d5885a5 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:49.189707 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0cd00-2c42-45b7-873e-6ee30d5885a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:49.207575 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-0da0cd00-2c42-45b7-873e-6ee30d5885a5 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:49.208722 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-0da0cd00-2c42-45b7-873e-6ee30d5885a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:49.273725 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1310/2592] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:49.285817 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48564b-4851-42b3-9450-92a0557d7334 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:49.286188 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48564b-4851-42b3-9450-92a0557d7334 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:49.286657 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48564b-4851-42b3-9450-92a0557d7334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:49.315955 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-0e48564b-4851-42b3-9450-92a0557d7334 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:49.317168 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-0e48564b-4851-42b3-9450-92a0557d7334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:49.326495 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1283/2593] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:49.331046 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0cd00-2c42-45b7-873e-6ee30d5885a5 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:49.341288 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0cd00-2c42-45b7-873e-6ee30d5885a5 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:49.347186 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54102c-31ad-4bed-86c4-5de888e896dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:49.347891 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54102c-31ad-4bed-86c4-5de888e896dc admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:49.348147 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54102c-31ad-4bed-86c4-5de888e896dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:49.348427 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54102c-31ad-4bed-86c4-5de888e896dc admin admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:49.349136 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54102c-31ad-4bed-86c4-5de888e896dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:12:49.349436 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54102c-31ad-4bed-86c4-5de888e896dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:49.351028 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54102c-31ad-4bed-86c4-5de888e896dc admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:49.363021 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1311/2594] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:12:49.367382 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48564b-4851-42b3-9450-92a0557d7334 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:49.377223 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48564b-4851-42b3-9450-92a0557d7334 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:49.383128 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58f96c-c6a9-4a96-bdbd-1a6878d6a995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:49.383791 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58f96c-c6a9-4a96-bdbd-1a6878d6a995 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:49.384063 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58f96c-c6a9-4a96-bdbd-1a6878d6a995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:49.384322 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58f96c-c6a9-4a96-bdbd-1a6878d6a995 admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:49.384998 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d58f96c-c6a9-4a96-bdbd-1a6878d6a995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:49.386929 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d58f96c-c6a9-4a96-bdbd-1a6878d6a995 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:49.414611 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1284/2595] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:12:49 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 03:12:49.418766 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54102c-31ad-4bed-86c4-5de888e896dc admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:49.430368 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54102c-31ad-4bed-86c4-5de888e896dc admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:49.494644 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8368d-34f8-4ee5-abd3-714472680f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:49.495214 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8368d-34f8-4ee5-abd3-714472680f64 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:49.495484 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8368d-34f8-4ee5-abd3-714472680f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:49.495779 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8368d-34f8-4ee5-abd3-714472680f64 admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:49.496449 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8368d-34f8-4ee5-abd3-714472680f64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:49.498350 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8368d-34f8-4ee5-abd3-714472680f64 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:49.519201 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1312/2596] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:12:49 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:12:49.523305 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58f96c-c6a9-4a96-bdbd-1a6878d6a995 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:49.533980 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58f96c-c6a9-4a96-bdbd-1a6878d6a995 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:49.539980 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abb715-5f52-43f0-bae4-1854b8144fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:49.540643 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abb715-5f52-43f0-bae4-1854b8144fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:49.540916 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abb715-5f52-43f0-bae4-1854b8144fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:49.541182 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abb715-5f52-43f0-bae4-1854b8144fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:49.541904 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2abb715-5f52-43f0-bae4-1854b8144fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:49.543516 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2abb715-5f52-43f0-bae4-1854b8144fa5 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:49.554236 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1285/2597] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:12:49.558375 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8368d-34f8-4ee5-abd3-714472680f64 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:49.569545 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8368d-34f8-4ee5-abd3-714472680f64 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:49.575471 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6aa8e2-efdb-4eaa-a41d-7466f16fc804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:49.576173 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6aa8e2-efdb-4eaa-a41d-7466f16fc804 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:49.576449 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6aa8e2-efdb-4eaa-a41d-7466f16fc804 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:49.576718 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6aa8e2-efdb-4eaa-a41d-7466f16fc804 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:49.577438 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6aa8e2-efdb-4eaa-a41d-7466f16fc804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:49.579029 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6aa8e2-efdb-4eaa-a41d-7466f16fc804 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:49.589091 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1313/2598] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:12:49.595070 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abb715-5f52-43f0-bae4-1854b8144fa5 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:49.606722 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abb715-5f52-43f0-bae4-1854b8144fa5 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:49.611898 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f737142-7743-4f6b-9b96-70f884b80bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:49.612781 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f737142-7743-4f6b-9b96-70f884b80bf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:49.613047 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f737142-7743-4f6b-9b96-70f884b80bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:49.613304 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f737142-7743-4f6b-9b96-70f884b80bf6 admin admin] PATH_INFO: `/v3/projects/4761d617cc4f4501820d996218b8f0ad/users/cc09c24e45b54206b430ec946560002a/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:49.628358 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f737142-7743-4f6b-9b96-70f884b80bf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4761d617cc4f4501820d996218b8f0ad, user_id=cc09c24e45b54206b430ec946560002a, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:49.631049 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f737142-7743-4f6b-9b96-70f884b80bf6 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:49.646470 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1286/2599] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:12:49 2022] PUT /identity/v3/projects/4761d617cc4f4501820d996218b8f0ad/users/cc09c24e45b54206b430ec946560002a/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:49.657802 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1095f5-e81e-4cbe-a3f7-9243ee34ce2d None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:49.658087 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1095f5-e81e-4cbe-a3f7-9243ee34ce2d None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:49.658362 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1095f5-e81e-4cbe-a3f7-9243ee34ce2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:49.685137 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-1b1095f5-e81e-4cbe-a3f7-9243ee34ce2d None None] MFA Rules not processed for user `cc09c24e45b54206b430ec946560002a`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:49.686331 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-1b1095f5-e81e-4cbe-a3f7-9243ee34ce2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:49.758461 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1314/2600] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:12:49.774422 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f737142-7743-4f6b-9b96-70f884b80bf6 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:49.777010 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-6f737142-7743-4f6b-9b96-70f884b80bf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:49.844853 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f737142-7743-4f6b-9b96-70f884b80bf6 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:49.850101 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b13a8-511d-4868-91b4-310e092e7cdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:49.851056 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b13a8-511d-4868-91b4-310e092e7cdf service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:49.851362 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b13a8-511d-4868-91b4-310e092e7cdf service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:49.851702 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b13a8-511d-4868-91b4-310e092e7cdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:49.865707 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b13a8-511d-4868-91b4-310e092e7cdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:49.867919 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b13a8-511d-4868-91b4-310e092e7cdf service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:49.878464 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1287/2601] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:12:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:12:49.898193 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1095f5-e81e-4cbe-a3f7-9243ee34ce2d None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:49.959352 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1095f5-e81e-4cbe-a3f7-9243ee34ce2d None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:49.964525 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b2817-5f0c-4849-bf53-7691db98e170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:49.965358 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b2817-5f0c-4849-bf53-7691db98e170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:49.965630 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b2817-5f0c-4849-bf53-7691db98e170 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:49.965893 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b2817-5f0c-4849-bf53-7691db98e170 admin admin] PATH_INFO: `/v3/users/cc09c24e45b54206b430ec946560002a` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:49.967070 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b2817-5f0c-4849-bf53-7691db98e170 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc09c24e45b54206b430ec946560002a)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:49.969014 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b2817-5f0c-4849-bf53-7691db98e170 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:50.020223 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a81b2817-5f0c-4849-bf53-7691db98e170 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc09c24e45b54206b430ec946560002a'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:50.026885 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a81b2817-5f0c-4849-bf53-7691db98e170 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc09c24e45b54206b430ec946560002a'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:50.027574 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a81b2817-5f0c-4849-bf53-7691db98e170 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc09c24e45b54206b430ec946560002a'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:50.028216 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a81b2817-5f0c-4849-bf53-7691db98e170 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc09c24e45b54206b430ec946560002a'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:50.040144 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a81b2817-5f0c-4849-bf53-7691db98e170 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc09c24e45b54206b430ec946560002a'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:50.054456 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1315/2602] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:12:49 2022] DELETE /identity/v3/users/cc09c24e45b54206b430ec946560002a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:50.059281 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afef90c-da50-4369-8090-4c46298419f5 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:50.059562 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afef90c-da50-4369-8090-4c46298419f5 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:50.059873 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afef90c-da50-4369-8090-4c46298419f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:50.089841 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-8afef90c-da50-4369-8090-4c46298419f5 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:50.091562 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-8afef90c-da50-4369-8090-4c46298419f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:50.168585 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1288/2603] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:50.178796 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b2817-5f0c-4849-bf53-7691db98e170 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:50.180454 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-a81b2817-5f0c-4849-bf53-7691db98e170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:50.239219 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b2817-5f0c-4849-bf53-7691db98e170 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:50.243027 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59387e29-5ec5-46fc-993c-1f208c5c0b06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:50.243683 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59387e29-5ec5-46fc-993c-1f208c5c0b06 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:50.243994 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59387e29-5ec5-46fc-993c-1f208c5c0b06 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:50.244268 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59387e29-5ec5-46fc-993c-1f208c5c0b06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:50.254486 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59387e29-5ec5-46fc-993c-1f208c5c0b06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:50.256343 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59387e29-5ec5-46fc-993c-1f208c5c0b06 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:50.266426 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1316/2604] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:12:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:12:50.564096 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afef90c-da50-4369-8090-4c46298419f5 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:50.565630 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-8afef90c-da50-4369-8090-4c46298419f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:50.580239 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afef90c-da50-4369-8090-4c46298419f5 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:50.585964 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae8a99-a11f-4dd6-9ed2-5ca63abcabd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:50.586836 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae8a99-a11f-4dd6-9ed2-5ca63abcabd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:50.587108 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae8a99-a11f-4dd6-9ed2-5ca63abcabd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:50.587366 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae8a99-a11f-4dd6-9ed2-5ca63abcabd1 admin admin] PATH_INFO: `/v3/projects/4761d617cc4f4501820d996218b8f0ad` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:50.588626 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cae8a99-a11f-4dd6-9ed2-5ca63abcabd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4761d617cc4f4501820d996218b8f0ad)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:50.590533 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cae8a99-a11f-4dd6-9ed2-5ca63abcabd1 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:50.643538 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3cae8a99-a11f-4dd6-9ed2-5ca63abcabd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4761d617cc4f4501820d996218b8f0ad', 'request_id': 'req-3cae8a99-a11f-4dd6-9ed2-5ca63abcabd1'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:50.653633 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3cae8a99-a11f-4dd6-9ed2-5ca63abcabd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4761d617cc4f4501820d996218b8f0ad', 'request_id': 'req-3cae8a99-a11f-4dd6-9ed2-5ca63abcabd1'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:50.660789 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3cae8a99-a11f-4dd6-9ed2-5ca63abcabd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4761d617cc4f4501820d996218b8f0ad', 'request_id': 'req-3cae8a99-a11f-4dd6-9ed2-5ca63abcabd1'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:50.670813 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3cae8a99-a11f-4dd6-9ed2-5ca63abcabd1 admin admin] The token cache is being invalidate because project 4761d617cc4f4501820d996218b8f0ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:12:50.671088 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3cae8a99-a11f-4dd6-9ed2-5ca63abcabd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:50.671745 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3cae8a99-a11f-4dd6-9ed2-5ca63abcabd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:50.673310 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1289/2605] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:12:50 2022] DELETE /identity/v3/projects/4761d617cc4f4501820d996218b8f0ad => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:50.678564 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545e3a7-6f7a-4050-9714-75f8f644399f None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:50.678842 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545e3a7-6f7a-4050-9714-75f8f644399f None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:50.679111 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545e3a7-6f7a-4050-9714-75f8f644399f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:50.697453 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-a545e3a7-6f7a-4050-9714-75f8f644399f None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:50.698629 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-a545e3a7-6f7a-4050-9714-75f8f644399f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:50.760788 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1317/2606] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:50.769007 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262120a-6445-42c2-9ce0-ff18482cc010 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:50.769285 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262120a-6445-42c2-9ce0-ff18482cc010 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:50.769554 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262120a-6445-42c2-9ce0-ff18482cc010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:50.787093 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545e3a7-6f7a-4050-9714-75f8f644399f None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:50.788621 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-a545e3a7-6f7a-4050-9714-75f8f644399f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:50.788763 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-3262120a-6445-42c2-9ce0-ff18482cc010 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:50.789753 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-3262120a-6445-42c2-9ce0-ff18482cc010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:50.798868 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1290/2607] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:12:50.803004 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262120a-6445-42c2-9ce0-ff18482cc010 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:50.812039 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262120a-6445-42c2-9ce0-ff18482cc010 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:50.817146 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27472cd-18cb-4197-97cf-2c55a937cece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:50.817783 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27472cd-18cb-4197-97cf-2c55a937cece admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:50.818058 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27472cd-18cb-4197-97cf-2c55a937cece admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:50.818331 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27472cd-18cb-4197-97cf-2c55a937cece admin admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:50.819053 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27472cd-18cb-4197-97cf-2c55a937cece admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:12:50.819320 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27472cd-18cb-4197-97cf-2c55a937cece admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:50.820971 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27472cd-18cb-4197-97cf-2c55a937cece admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:50.833273 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1291/2608] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 03:12:50.837494 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27472cd-18cb-4197-97cf-2c55a937cece admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:50.849326 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27472cd-18cb-4197-97cf-2c55a937cece admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:50.854666 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1c33c-77ae-4c7a-9515-9d609ca1a74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:50.855315 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1c33c-77ae-4c7a-9515-9d609ca1a74c admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:50.855602 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1c33c-77ae-4c7a-9515-9d609ca1a74c admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:50.855878 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1c33c-77ae-4c7a-9515-9d609ca1a74c admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:50.856556 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d1c33c-77ae-4c7a-9515-9d609ca1a74c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:50.858473 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d1c33c-77ae-4c7a-9515-9d609ca1a74c admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:50.862188 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545e3a7-6f7a-4050-9714-75f8f644399f None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:50.867108 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a5039-956d-4a78-a92b-40a5bd66b7ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a88ae51543497382d34573afc2bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:50.867875 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a5039-956d-4a78-a92b-40a5bd66b7ab service placement] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:50.868155 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a5039-956d-4a78-a92b-40a5bd66b7ab service placement] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:50.868426 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a5039-956d-4a78-a92b-40a5bd66b7ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:50.870171 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-047a5039-956d-4a78-a92b-40a5bd66b7ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:50.883074 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a5039-956d-4a78-a92b-40a5bd66b7ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:50.884783 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a5039-956d-4a78-a92b-40a5bd66b7ab service placement] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:50.884936 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1292/2609] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:12:50 2022] POST /identity/v3/projects => generated 361 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:12:50.888782 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1c33c-77ae-4c7a-9515-9d609ca1a74c admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:50.895326 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1318/2610] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:12:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 03:12:50.956771 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1c33c-77ae-4c7a-9515-9d609ca1a74c admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:50.962671 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723af65c-0bb9-46d2-985f-b116aa90acf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:50.963541 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723af65c-0bb9-46d2-985f-b116aa90acf2 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:50.963850 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723af65c-0bb9-46d2-985f-b116aa90acf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:50.964288 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723af65c-0bb9-46d2-985f-b116aa90acf2 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:50.964983 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723af65c-0bb9-46d2-985f-b116aa90acf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:50.967021 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723af65c-0bb9-46d2-985f-b116aa90acf2 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:50.990803 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1293/2611] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:12:50 2022] POST /identity/v3/users => generated 281 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:12:50.992172 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a5039-956d-4a78-a92b-40a5bd66b7ab service placement] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:51.005045 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a5039-956d-4a78-a92b-40a5bd66b7ab service placement] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:51.010139 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8ad77-3973-4cd0-8546-20fc4a41a424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:51.010807 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8ad77-3973-4cd0-8546-20fc4a41a424 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:51.011079 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8ad77-3973-4cd0-8546-20fc4a41a424 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:51.011343 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8ad77-3973-4cd0-8546-20fc4a41a424 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:51.012668 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8ad77-3973-4cd0-8546-20fc4a41a424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:51.014394 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8ad77-3973-4cd0-8546-20fc4a41a424 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:51.030886 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1319/2612] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:12:51.032487 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723af65c-0bb9-46d2-985f-b116aa90acf2 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:51.042903 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723af65c-0bb9-46d2-985f-b116aa90acf2 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:51.047413 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1587de-3af0-4559-a1e4-29b09525ebd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:51.048360 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1587de-3af0-4559-a1e4-29b09525ebd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:51.048633 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1587de-3af0-4559-a1e4-29b09525ebd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:51.048894 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1587de-3af0-4559-a1e4-29b09525ebd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:51.049601 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1587de-3af0-4559-a1e4-29b09525ebd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:51.051181 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1587de-3af0-4559-a1e4-29b09525ebd0 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:51.060755 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1294/2613] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:12:51.065023 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8ad77-3973-4cd0-8546-20fc4a41a424 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:51.075369 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8ad77-3973-4cd0-8546-20fc4a41a424 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:51.080412 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf6b0d-43a4-4ee0-a7dc-cdcf93af23f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:51.081293 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf6b0d-43a4-4ee0-a7dc-cdcf93af23f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:51.081569 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf6b0d-43a4-4ee0-a7dc-cdcf93af23f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:51.081837 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf6b0d-43a4-4ee0-a7dc-cdcf93af23f1 admin admin] PATH_INFO: `/v3/projects/e1818b7bc8104e40a77b197be8c91cd3/users/1e87df13b931486f89292726bd365ae7/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:51.097034 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf6b0d-43a4-4ee0-a7dc-cdcf93af23f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1818b7bc8104e40a77b197be8c91cd3, user_id=1e87df13b931486f89292726bd365ae7, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:51.099671 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf6b0d-43a4-4ee0-a7dc-cdcf93af23f1 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:51.114273 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1320/2614] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:12:51 2022] PUT /identity/v3/projects/e1818b7bc8104e40a77b197be8c91cd3/users/1e87df13b931486f89292726bd365ae7/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:51.124674 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c975d-25a7-4aed-adb2-d24c38c35a93 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:51.124959 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c975d-25a7-4aed-adb2-d24c38c35a93 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:51.125228 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c975d-25a7-4aed-adb2-d24c38c35a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:51.151621 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-5e1c975d-25a7-4aed-adb2-d24c38c35a93 None None] MFA Rules not processed for user `1e87df13b931486f89292726bd365ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:51.152873 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-5e1c975d-25a7-4aed-adb2-d24c38c35a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:51.219045 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1295/2615] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:51 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:51.257111 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf6b0d-43a4-4ee0-a7dc-cdcf93af23f1 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:51.259077 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-61bf6b0d-43a4-4ee0-a7dc-cdcf93af23f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:51.337642 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf6b0d-43a4-4ee0-a7dc-cdcf93af23f1 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:51.341482 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea6f28-0a3d-4f1a-a20f-8baf6104ce97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:51.352043 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea6f28-0a3d-4f1a-a20f-8baf6104ce97 service cinder] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:51.352337 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea6f28-0a3d-4f1a-a20f-8baf6104ce97 service cinder] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:51.352593 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea6f28-0a3d-4f1a-a20f-8baf6104ce97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:51.366673 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea6f28-0a3d-4f1a-a20f-8baf6104ce97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:51.366673 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea6f28-0a3d-4f1a-a20f-8baf6104ce97 service cinder] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:51.377374 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1321/2616] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:12:51 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:12:51.392588 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c975d-25a7-4aed-adb2-d24c38c35a93 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:51.470960 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c975d-25a7-4aed-adb2-d24c38c35a93 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:51.477431 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2367f-f543-4f4d-8bc5-f641de213e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:51.479114 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2367f-f543-4f4d-8bc5-f641de213e64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:51.479488 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2367f-f543-4f4d-8bc5-f641de213e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:51.479901 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2367f-f543-4f4d-8bc5-f641de213e64 admin admin] PATH_INFO: `/v3/users/1e87df13b931486f89292726bd365ae7` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:51.481294 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2367f-f543-4f4d-8bc5-f641de213e64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e87df13b931486f89292726bd365ae7)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:51.484586 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2367f-f543-4f4d-8bc5-f641de213e64 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:51.546806 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-cea2367f-f543-4f4d-8bc5-f641de213e64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e87df13b931486f89292726bd365ae7'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:51.547473 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-cea2367f-f543-4f4d-8bc5-f641de213e64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e87df13b931486f89292726bd365ae7'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:51.558906 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-cea2367f-f543-4f4d-8bc5-f641de213e64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e87df13b931486f89292726bd365ae7'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:51.559550 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-cea2367f-f543-4f4d-8bc5-f641de213e64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e87df13b931486f89292726bd365ae7'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:51.566648 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-cea2367f-f543-4f4d-8bc5-f641de213e64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e87df13b931486f89292726bd365ae7'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:51.580570 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1296/2617] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:12:51 2022] DELETE /identity/v3/users/1e87df13b931486f89292726bd365ae7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:51.585086 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a7b5c-d14b-4c00-a7ba-ece20dc7db62 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:51.585580 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a7b5c-d14b-4c00-a7ba-ece20dc7db62 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:51.585855 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a7b5c-d14b-4c00-a7ba-ece20dc7db62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:51.603567 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-fa9a7b5c-d14b-4c00-a7ba-ece20dc7db62 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:51.604628 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-fa9a7b5c-d14b-4c00-a7ba-ece20dc7db62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:51.662615 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1322/2618] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:12:51.676146 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2367f-f543-4f4d-8bc5-f641de213e64 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:51.679326 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-cea2367f-f543-4f4d-8bc5-f641de213e64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:51.736733 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2367f-f543-4f4d-8bc5-f641de213e64 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:51.740315 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdae3a9-a872-4d92-b1de-7c796ce8f420 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:51.740942 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdae3a9-a872-4d92-b1de-7c796ce8f420 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:51.741214 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdae3a9-a872-4d92-b1de-7c796ce8f420 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:51.741480 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdae3a9-a872-4d92-b1de-7c796ce8f420 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:51.750383 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdae3a9-a872-4d92-b1de-7c796ce8f420 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:51.751904 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdae3a9-a872-4d92-b1de-7c796ce8f420 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:51.761141 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1297/2619] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:12:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:12:52.074474 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a7b5c-d14b-4c00-a7ba-ece20dc7db62 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:52.076708 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-fa9a7b5c-d14b-4c00-a7ba-ece20dc7db62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:52.089330 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a7b5c-d14b-4c00-a7ba-ece20dc7db62 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:52.103019 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d7d1e-b679-42fe-ba0f-2e84253698e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:52.104526 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d7d1e-b679-42fe-ba0f-2e84253698e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:52.104881 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d7d1e-b679-42fe-ba0f-2e84253698e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:52.105211 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d7d1e-b679-42fe-ba0f-2e84253698e1 admin admin] PATH_INFO: `/v3/projects/e1818b7bc8104e40a77b197be8c91cd3` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:52.107273 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d7d1e-b679-42fe-ba0f-2e84253698e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1818b7bc8104e40a77b197be8c91cd3)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:52.110952 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d7d1e-b679-42fe-ba0f-2e84253698e1 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:52.161635 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-f66d7d1e-b679-42fe-ba0f-2e84253698e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1818b7bc8104e40a77b197be8c91cd3', 'request_id': 'req-f66d7d1e-b679-42fe-ba0f-2e84253698e1'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:52.170466 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-f66d7d1e-b679-42fe-ba0f-2e84253698e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1818b7bc8104e40a77b197be8c91cd3', 'request_id': 'req-f66d7d1e-b679-42fe-ba0f-2e84253698e1'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:52.177349 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-f66d7d1e-b679-42fe-ba0f-2e84253698e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1818b7bc8104e40a77b197be8c91cd3', 'request_id': 'req-f66d7d1e-b679-42fe-ba0f-2e84253698e1'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:52.187937 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-f66d7d1e-b679-42fe-ba0f-2e84253698e1 admin admin] The token cache is being invalidate because project e1818b7bc8104e40a77b197be8c91cd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:12:52.188196 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-f66d7d1e-b679-42fe-ba0f-2e84253698e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:52.189005 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-f66d7d1e-b679-42fe-ba0f-2e84253698e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:52.190686 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1323/2620] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:12:52 2022] DELETE /identity/v3/projects/e1818b7bc8104e40a77b197be8c91cd3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:52.195747 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e4e03-7ea5-4283-a5cf-804c4e824ac7 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:52.196045 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e4e03-7ea5-4283-a5cf-804c4e824ac7 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:52.196321 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e4e03-7ea5-4283-a5cf-804c4e824ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:52.217032 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-5a1e4e03-7ea5-4283-a5cf-804c4e824ac7 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:52.219027 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-5a1e4e03-7ea5-4283-a5cf-804c4e824ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:52.293647 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1298/2621] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:52.304146 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518bfcd-c648-446d-ad52-d531754c4e10 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:52.304702 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518bfcd-c648-446d-ad52-d531754c4e10 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:52.304702 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518bfcd-c648-446d-ad52-d531754c4e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:52.324575 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-2518bfcd-c648-446d-ad52-d531754c4e10 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:52.326174 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-2518bfcd-c648-446d-ad52-d531754c4e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:52.335138 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1324/2622] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:52.340419 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e4e03-7ea5-4283-a5cf-804c4e824ac7 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:52.352958 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e4e03-7ea5-4283-a5cf-804c4e824ac7 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:52.358864 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68174e-445b-4841-baac-5d194171834b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:52.360601 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68174e-445b-4841-baac-5d194171834b admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:52.360885 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68174e-445b-4841-baac-5d194171834b admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:52.361152 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68174e-445b-4841-baac-5d194171834b admin admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:52.361913 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e68174e-445b-4841-baac-5d194171834b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:12:52.362220 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e68174e-445b-4841-baac-5d194171834b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:52.363924 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e68174e-445b-4841-baac-5d194171834b admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:52.381435 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1299/2623] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:12:52.386371 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518bfcd-c648-446d-ad52-d531754c4e10 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:52.399140 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518bfcd-c648-446d-ad52-d531754c4e10 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:52.405258 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0909fc-b416-4450-8c80-371dfdc1dc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:52.405960 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0909fc-b416-4450-8c80-371dfdc1dc95 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:52.406237 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0909fc-b416-4450-8c80-371dfdc1dc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:52.406495 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0909fc-b416-4450-8c80-371dfdc1dc95 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:52.407187 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0909fc-b416-4450-8c80-371dfdc1dc95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:52.409414 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0909fc-b416-4450-8c80-371dfdc1dc95 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:52.440695 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1325/2624] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:12:52 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:12:52.445129 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68174e-445b-4841-baac-5d194171834b admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:52.455809 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68174e-445b-4841-baac-5d194171834b admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:52.517837 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9818757-e177-41ff-b824-3d9f971b7a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:52.518661 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9818757-e177-41ff-b824-3d9f971b7a3f admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:52.519043 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9818757-e177-41ff-b824-3d9f971b7a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:52.519384 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9818757-e177-41ff-b824-3d9f971b7a3f admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:52.520415 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9818757-e177-41ff-b824-3d9f971b7a3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:52.523800 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9818757-e177-41ff-b824-3d9f971b7a3f admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:52.556186 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1300/2625] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:12:52 2022] POST /identity/v3/users => generated 285 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:12:52.559972 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0909fc-b416-4450-8c80-371dfdc1dc95 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:52.574629 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0909fc-b416-4450-8c80-371dfdc1dc95 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:52.581358 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a162b-458b-4e58-9d9a-165ae1ee566c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:52.582073 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a162b-458b-4e58-9d9a-165ae1ee566c admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:52.582352 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a162b-458b-4e58-9d9a-165ae1ee566c admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:52.582625 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a162b-458b-4e58-9d9a-165ae1ee566c admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:52.583473 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a162b-458b-4e58-9d9a-165ae1ee566c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:52.585095 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a162b-458b-4e58-9d9a-165ae1ee566c admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:52.599859 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1326/2626] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:12:52.604470 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9818757-e177-41ff-b824-3d9f971b7a3f admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:52.615410 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9818757-e177-41ff-b824-3d9f971b7a3f admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:52.622106 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6ba9d-d6f8-40d2-8cc6-35766ad376b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:52.622843 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6ba9d-d6f8-40d2-8cc6-35766ad376b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:52.623147 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6ba9d-d6f8-40d2-8cc6-35766ad376b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:52.623440 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6ba9d-d6f8-40d2-8cc6-35766ad376b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:52.624236 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe6ba9d-d6f8-40d2-8cc6-35766ad376b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:52.626013 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe6ba9d-d6f8-40d2-8cc6-35766ad376b4 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:52.636688 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1301/2627] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:12:52.641996 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a162b-458b-4e58-9d9a-165ae1ee566c admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:52.655129 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a162b-458b-4e58-9d9a-165ae1ee566c admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:52.660925 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c480db-fb57-4619-9a17-a452163daca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:52.661816 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c480db-fb57-4619-9a17-a452163daca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:52.662090 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c480db-fb57-4619-9a17-a452163daca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:52.662354 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c480db-fb57-4619-9a17-a452163daca5 admin admin] PATH_INFO: `/v3/projects/f9d49841c16043088f0ceb8dd141867f/users/b25155bdbda64a7487a8b8ad5a08e991/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:52.680690 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c480db-fb57-4619-9a17-a452163daca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9d49841c16043088f0ceb8dd141867f, user_id=b25155bdbda64a7487a8b8ad5a08e991, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:52.684143 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c480db-fb57-4619-9a17-a452163daca5 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:52.703139 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1327/2628] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:12:52 2022] PUT /identity/v3/projects/f9d49841c16043088f0ceb8dd141867f/users/b25155bdbda64a7487a8b8ad5a08e991/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:52.714124 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00b08b-92fc-4dc4-888c-705c759aca75 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:52.714402 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00b08b-92fc-4dc4-888c-705c759aca75 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:52.714669 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00b08b-92fc-4dc4-888c-705c759aca75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:52.743331 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-bf00b08b-92fc-4dc4-888c-705c759aca75 None None] MFA Rules not processed for user `b25155bdbda64a7487a8b8ad5a08e991`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:52.744669 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-bf00b08b-92fc-4dc4-888c-705c759aca75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:52.817747 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1302/2629] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:52.833419 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c480db-fb57-4619-9a17-a452163daca5 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:52.836113 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-62c480db-fb57-4619-9a17-a452163daca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:52.904914 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c480db-fb57-4619-9a17-a452163daca5 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:52.909803 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c10f0-ebe4-4da6-9983-752d20d38ad7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a6cffa8af470388d4b063c3c49849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:52.910458 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c10f0-ebe4-4da6-9983-752d20d38ad7 service glance] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:52.910726 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c10f0-ebe4-4da6-9983-752d20d38ad7 service glance] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:52.910983 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c10f0-ebe4-4da6-9983-752d20d38ad7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:52.920763 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c10f0-ebe4-4da6-9983-752d20d38ad7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:52.922241 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c10f0-ebe4-4da6-9983-752d20d38ad7 service glance] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:52.932312 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1328/2630] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:12:52 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:12:57.774568 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00b08b-92fc-4dc4-888c-705c759aca75 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:57.776087 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-bf00b08b-92fc-4dc4-888c-705c759aca75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:57.853153 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00b08b-92fc-4dc4-888c-705c759aca75 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:57.858333 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddbd595-8a3c-4c6a-a243-118a78d6bae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:57.859233 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddbd595-8a3c-4c6a-a243-118a78d6bae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:57.859539 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddbd595-8a3c-4c6a-a243-118a78d6bae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:57.859842 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddbd595-8a3c-4c6a-a243-118a78d6bae0 admin admin] PATH_INFO: `/v3/users/60813282c8024606a322652d047880e3` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:57.861131 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddbd595-8a3c-4c6a-a243-118a78d6bae0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60813282c8024606a322652d047880e3)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:57.863081 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddbd595-8a3c-4c6a-a243-118a78d6bae0 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:57.911509 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-6ddbd595-8a3c-4c6a-a243-118a78d6bae0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60813282c8024606a322652d047880e3'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:57.912185 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-6ddbd595-8a3c-4c6a-a243-118a78d6bae0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60813282c8024606a322652d047880e3'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:57.923355 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-6ddbd595-8a3c-4c6a-a243-118a78d6bae0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60813282c8024606a322652d047880e3'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:57.923931 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-6ddbd595-8a3c-4c6a-a243-118a78d6bae0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60813282c8024606a322652d047880e3'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:57.931546 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-6ddbd595-8a3c-4c6a-a243-118a78d6bae0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60813282c8024606a322652d047880e3'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:57.947125 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1303/2631] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:12:57 2022] DELETE /identity/v3/users/60813282c8024606a322652d047880e3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:57.954721 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89754dbe-a32f-4291-9db9-091aead80461 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:57.955284 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89754dbe-a32f-4291-9db9-091aead80461 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:57.955284 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89754dbe-a32f-4291-9db9-091aead80461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:57.973923 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-89754dbe-a32f-4291-9db9-091aead80461 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:57.975107 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-89754dbe-a32f-4291-9db9-091aead80461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:58.046648 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1329/2632] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:12:58.056375 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddbd595-8a3c-4c6a-a243-118a78d6bae0 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:58.057873 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-6ddbd595-8a3c-4c6a-a243-118a78d6bae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:58.116213 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddbd595-8a3c-4c6a-a243-118a78d6bae0 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:58.120339 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b5492-96be-4305-9b77-7d93c4afec6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:58.120992 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b5492-96be-4305-9b77-7d93c4afec6b service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:58.121267 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b5492-96be-4305-9b77-7d93c4afec6b service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:58.121534 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b5492-96be-4305-9b77-7d93c4afec6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:58.130860 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b5492-96be-4305-9b77-7d93c4afec6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:58.132363 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b5492-96be-4305-9b77-7d93c4afec6b service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:58.142526 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1304/2633] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:12:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:12:58.442060 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89754dbe-a32f-4291-9db9-091aead80461 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:58.443490 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-89754dbe-a32f-4291-9db9-091aead80461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:58.458026 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89754dbe-a32f-4291-9db9-091aead80461 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:58.462563 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71258f2-a47f-4671-b7d7-eabd0b44c684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:58.463474 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71258f2-a47f-4671-b7d7-eabd0b44c684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:58.463819 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71258f2-a47f-4671-b7d7-eabd0b44c684 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:58.464144 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71258f2-a47f-4671-b7d7-eabd0b44c684 admin admin] PATH_INFO: `/v3/projects/d15f4baf317d4241bc5a20077afede7c` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:58.465320 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71258f2-a47f-4671-b7d7-eabd0b44c684 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d15f4baf317d4241bc5a20077afede7c)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:58.467236 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71258f2-a47f-4671-b7d7-eabd0b44c684 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:58.514828 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-f71258f2-a47f-4671-b7d7-eabd0b44c684 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd15f4baf317d4241bc5a20077afede7c', 'request_id': 'req-f71258f2-a47f-4671-b7d7-eabd0b44c684'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:58.524839 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-f71258f2-a47f-4671-b7d7-eabd0b44c684 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd15f4baf317d4241bc5a20077afede7c', 'request_id': 'req-f71258f2-a47f-4671-b7d7-eabd0b44c684'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:58.531382 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-f71258f2-a47f-4671-b7d7-eabd0b44c684 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd15f4baf317d4241bc5a20077afede7c', 'request_id': 'req-f71258f2-a47f-4671-b7d7-eabd0b44c684'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:58.542592 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-f71258f2-a47f-4671-b7d7-eabd0b44c684 admin admin] The token cache is being invalidate because project d15f4baf317d4241bc5a20077afede7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:12:58.542592 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-f71258f2-a47f-4671-b7d7-eabd0b44c684 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:58.542950 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-f71258f2-a47f-4671-b7d7-eabd0b44c684 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:58.544992 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1330/2634] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:12:58 2022] DELETE /identity/v3/projects/d15f4baf317d4241bc5a20077afede7c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:58.549348 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b5492-96be-4305-9b77-7d93c4afec6b service neutron] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:58.559873 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b5492-96be-4305-9b77-7d93c4afec6b service neutron] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:58.620142 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cc510-e73c-4c9e-bb0b-0d84a9fc56b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:58.621064 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cc510-e73c-4c9e-bb0b-0d84a9fc56b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:58.621386 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cc510-e73c-4c9e-bb0b-0d84a9fc56b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:58.621617 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cc510-e73c-4c9e-bb0b-0d84a9fc56b5 admin admin] PATH_INFO: `/v3/users/135dcf91b4ed41f6889ef16df3bf0a93` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:58.628667 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6cc510-e73c-4c9e-bb0b-0d84a9fc56b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=135dcf91b4ed41f6889ef16df3bf0a93)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:58.630748 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6cc510-e73c-4c9e-bb0b-0d84a9fc56b5 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:58.684533 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-bf6cc510-e73c-4c9e-bb0b-0d84a9fc56b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '135dcf91b4ed41f6889ef16df3bf0a93'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:58.685131 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-bf6cc510-e73c-4c9e-bb0b-0d84a9fc56b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '135dcf91b4ed41f6889ef16df3bf0a93'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:58.697327 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-bf6cc510-e73c-4c9e-bb0b-0d84a9fc56b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '135dcf91b4ed41f6889ef16df3bf0a93'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:58.698010 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-bf6cc510-e73c-4c9e-bb0b-0d84a9fc56b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '135dcf91b4ed41f6889ef16df3bf0a93'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:58.705465 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-bf6cc510-e73c-4c9e-bb0b-0d84a9fc56b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '135dcf91b4ed41f6889ef16df3bf0a93'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:58.720019 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1305/2635] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:12:58 2022] DELETE /identity/v3/users/135dcf91b4ed41f6889ef16df3bf0a93 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:59.369528 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71258f2-a47f-4671-b7d7-eabd0b44c684 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:59.371059 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-f71258f2-a47f-4671-b7d7-eabd0b44c684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:59.384731 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71258f2-a47f-4671-b7d7-eabd0b44c684 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:59.449121 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a902736-c0fd-4654-9226-57dac823ce15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:59.450346 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a902736-c0fd-4654-9226-57dac823ce15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:59.450618 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a902736-c0fd-4654-9226-57dac823ce15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:59.450882 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a902736-c0fd-4654-9226-57dac823ce15 admin admin] PATH_INFO: `/v3/projects/9bc1aa4fa6b34dd2830ec66acea53073` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:59.452201 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a902736-c0fd-4654-9226-57dac823ce15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bc1aa4fa6b34dd2830ec66acea53073)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:59.454161 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a902736-c0fd-4654-9226-57dac823ce15 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:59.502092 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-7a902736-c0fd-4654-9226-57dac823ce15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bc1aa4fa6b34dd2830ec66acea53073', 'request_id': 'req-7a902736-c0fd-4654-9226-57dac823ce15'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:59.510969 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-7a902736-c0fd-4654-9226-57dac823ce15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bc1aa4fa6b34dd2830ec66acea53073', 'request_id': 'req-7a902736-c0fd-4654-9226-57dac823ce15'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:59.517113 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-7a902736-c0fd-4654-9226-57dac823ce15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bc1aa4fa6b34dd2830ec66acea53073', 'request_id': 'req-7a902736-c0fd-4654-9226-57dac823ce15'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:59.529699 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-7a902736-c0fd-4654-9226-57dac823ce15 admin admin] The token cache is being invalidate because project 9bc1aa4fa6b34dd2830ec66acea53073 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:12:59.529977 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-7a902736-c0fd-4654-9226-57dac823ce15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:59.530692 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-7a902736-c0fd-4654-9226-57dac823ce15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:12:59.532358 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1331/2636] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:12:59 2022] DELETE /identity/v3/projects/9bc1aa4fa6b34dd2830ec66acea53073 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:12:59.538640 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0bad9-6281-400b-a1e6-911858eb1c44 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:59.539129 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0bad9-6281-400b-a1e6-911858eb1c44 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:59.539129 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0bad9-6281-400b-a1e6-911858eb1c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:59.559505 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-36b0bad9-6281-400b-a1e6-911858eb1c44 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:59.561185 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-36b0bad9-6281-400b-a1e6-911858eb1c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:59.623093 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1306/2637] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:59.631385 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68b54d-c07a-4934-b911-c231c5e63efd None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:59.631670 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68b54d-c07a-4934-b911-c231c5e63efd None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:59.631981 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68b54d-c07a-4934-b911-c231c5e63efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:59.651452 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-0b68b54d-c07a-4934-b911-c231c5e63efd None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:12:59.652697 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-0b68b54d-c07a-4934-b911-c231c5e63efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:12:59.661450 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1332/2638] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:12:59.665792 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0bad9-6281-400b-a1e6-911858eb1c44 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:59.675219 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0bad9-6281-400b-a1e6-911858eb1c44 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:59.680311 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa562657-6e4a-49a5-8a0a-b74a3c75bcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:59.680952 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa562657-6e4a-49a5-8a0a-b74a3c75bcaa admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:59.681363 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa562657-6e4a-49a5-8a0a-b74a3c75bcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:59.681623 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa562657-6e4a-49a5-8a0a-b74a3c75bcaa admin admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:59.682327 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa562657-6e4a-49a5-8a0a-b74a3c75bcaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:12:59.682763 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa562657-6e4a-49a5-8a0a-b74a3c75bcaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:59.684497 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa562657-6e4a-49a5-8a0a-b74a3c75bcaa admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:59.698832 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1307/2639] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:12:59.704229 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68b54d-c07a-4934-b911-c231c5e63efd None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:59.714132 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68b54d-c07a-4934-b911-c231c5e63efd None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:59.719243 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8edead-b36f-4a8c-985f-b06fbce4bd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:59.719943 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8edead-b36f-4a8c-985f-b06fbce4bd41 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:59.720212 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8edead-b36f-4a8c-985f-b06fbce4bd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:59.720506 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8edead-b36f-4a8c-985f-b06fbce4bd41 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:59.721200 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8edead-b36f-4a8c-985f-b06fbce4bd41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:59.723296 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8edead-b36f-4a8c-985f-b06fbce4bd41 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:59.753480 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1333/2640] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:12:59 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:12:59.754819 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa562657-6e4a-49a5-8a0a-b74a3c75bcaa admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:59.765256 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa562657-6e4a-49a5-8a0a-b74a3c75bcaa admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:59.823364 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b18284b-93ac-4522-af31-8f518fce4585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:59.824334 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18284b-93ac-4522-af31-8f518fce4585 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:59.824674 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18284b-93ac-4522-af31-8f518fce4585 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:59.825409 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18284b-93ac-4522-af31-8f518fce4585 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:59.826694 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b18284b-93ac-4522-af31-8f518fce4585 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:59.829929 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b18284b-93ac-4522-af31-8f518fce4585 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:59.858672 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1308/2641] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:12:59 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:12:59.862999 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8edead-b36f-4a8c-985f-b06fbce4bd41 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:59.874411 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8edead-b36f-4a8c-985f-b06fbce4bd41 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:59.879962 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88de5c-df5f-4181-a972-2c13c971107d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:59.880637 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88de5c-df5f-4181-a972-2c13c971107d admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:59.880910 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88de5c-df5f-4181-a972-2c13c971107d admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:59.881174 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88de5c-df5f-4181-a972-2c13c971107d admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:59.881889 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88de5c-df5f-4181-a972-2c13c971107d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:59.883484 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88de5c-df5f-4181-a972-2c13c971107d admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:59.895483 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1334/2642] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:12:59.902669 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b18284b-93ac-4522-af31-8f518fce4585 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:59.911772 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b18284b-93ac-4522-af31-8f518fce4585 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:59.919498 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcafba-9b2a-476b-b934-7b375549f39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:59.920047 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcafba-9b2a-476b-b934-7b375549f39c admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:59.920583 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcafba-9b2a-476b-b934-7b375549f39c admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:59.921289 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcafba-9b2a-476b-b934-7b375549f39c admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:59.922358 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fcafba-9b2a-476b-b934-7b375549f39c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:59.924804 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fcafba-9b2a-476b-b934-7b375549f39c admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:59.935775 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1309/2643] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:12:59.940275 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88de5c-df5f-4181-a972-2c13c971107d admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:12:59.951110 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88de5c-df5f-4181-a972-2c13c971107d admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:12:59.956851 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42d95f-8944-4e0e-a458-5cf37cd33f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:12:59.957804 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42d95f-8944-4e0e-a458-5cf37cd33f94 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:12:59.958080 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42d95f-8944-4e0e-a458-5cf37cd33f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:12:59.958349 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42d95f-8944-4e0e-a458-5cf37cd33f94 admin admin] PATH_INFO: `/v3/projects/09b7a7037b78430294f634198dd31f40/users/89d01b25a8974bbc902de251fddb1647/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:12:59.973100 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c42d95f-8944-4e0e-a458-5cf37cd33f94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09b7a7037b78430294f634198dd31f40, user_id=89d01b25a8974bbc902de251fddb1647, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:12:59.975902 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c42d95f-8944-4e0e-a458-5cf37cd33f94 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:12:59.993127 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1335/2644] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:12:59 2022] PUT /identity/v3/projects/09b7a7037b78430294f634198dd31f40/users/89d01b25a8974bbc902de251fddb1647/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:00.004392 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d0cfd-5018-4599-a283-9d177642b95c None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:00.004681 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d0cfd-5018-4599-a283-9d177642b95c None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:00.004988 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d0cfd-5018-4599-a283-9d177642b95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:00.032007 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-9e5d0cfd-5018-4599-a283-9d177642b95c None None] MFA Rules not processed for user `89d01b25a8974bbc902de251fddb1647`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:00.033196 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-9e5d0cfd-5018-4599-a283-9d177642b95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:00.109878 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1310/2645] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:13:00.116005 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42d95f-8944-4e0e-a458-5cf37cd33f94 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:00.184285 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42d95f-8944-4e0e-a458-5cf37cd33f94 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:00.189554 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c9af9-554d-48db-936d-90cd2c7fbafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:00.190222 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c9af9-554d-48db-936d-90cd2c7fbafc admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:00.190498 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c9af9-554d-48db-936d-90cd2c7fbafc admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:00.190762 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c9af9-554d-48db-936d-90cd2c7fbafc admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:00.191458 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c9af9-554d-48db-936d-90cd2c7fbafc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:00.193756 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c9af9-554d-48db-936d-90cd2c7fbafc admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:00.227777 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1336/2646] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:13:00 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:13:00.229677 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d0cfd-5018-4599-a283-9d177642b95c None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:00.242340 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d0cfd-5018-4599-a283-9d177642b95c None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:00.305872 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a8147-c1a6-4e78-98d9-27d305129b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:00.306578 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a8147-c1a6-4e78-98d9-27d305129b5f admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:00.306856 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a8147-c1a6-4e78-98d9-27d305129b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:00.307133 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a8147-c1a6-4e78-98d9-27d305129b5f admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:00.307847 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a8147-c1a6-4e78-98d9-27d305129b5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:00.309936 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a8147-c1a6-4e78-98d9-27d305129b5f admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:00.331275 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1311/2647] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:13:00 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:13:00.335491 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c9af9-554d-48db-936d-90cd2c7fbafc admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:00.346493 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c9af9-554d-48db-936d-90cd2c7fbafc admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:00.352037 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda7c5f-d6bd-4939-8456-3b04444196da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:00.352731 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda7c5f-d6bd-4939-8456-3b04444196da admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:00.353009 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda7c5f-d6bd-4939-8456-3b04444196da admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:00.353277 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda7c5f-d6bd-4939-8456-3b04444196da admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:00.354027 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda7c5f-d6bd-4939-8456-3b04444196da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:00.355665 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda7c5f-d6bd-4939-8456-3b04444196da admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:00.366850 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1337/2648] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:13:00.371189 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a8147-c1a6-4e78-98d9-27d305129b5f admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:00.382007 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a8147-c1a6-4e78-98d9-27d305129b5f admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:00.387189 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d4b45-7479-4a33-9924-ac8763b2040d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:00.388321 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d4b45-7479-4a33-9924-ac8763b2040d admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:00.388758 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d4b45-7479-4a33-9924-ac8763b2040d admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:00.389093 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d4b45-7479-4a33-9924-ac8763b2040d admin admin] PATH_INFO: `/v3/projects/023ca2d1b99a420fa7f6c42a5fe73fa7/users/e35e6803ac8848a2a169cc74b4199471/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:00.411474 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d4b45-7479-4a33-9924-ac8763b2040d admin admin] RBAC: Authorizing `identity:create_grant(project_id=023ca2d1b99a420fa7f6c42a5fe73fa7, user_id=e35e6803ac8848a2a169cc74b4199471, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:00.414136 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d4b45-7479-4a33-9924-ac8763b2040d admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:00.435424 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1312/2649] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:13:00 2022] PUT /identity/v3/projects/023ca2d1b99a420fa7f6c42a5fe73fa7/users/e35e6803ac8848a2a169cc74b4199471/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:00.439758 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda7c5f-d6bd-4939-8456-3b04444196da admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:00.456882 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda7c5f-d6bd-4939-8456-3b04444196da admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:00.543192 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6b7a5-5a88-4368-aa72-89817c3f5fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:00.544054 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6b7a5-5a88-4368-aa72-89817c3f5fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:00.544328 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6b7a5-5a88-4368-aa72-89817c3f5fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:00.544592 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6b7a5-5a88-4368-aa72-89817c3f5fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:00.545324 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b6b7a5-5a88-4368-aa72-89817c3f5fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:00.547157 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b6b7a5-5a88-4368-aa72-89817c3f5fa5 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:00.581707 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1338/2650] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:13:00.585843 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d4b45-7479-4a33-9924-ac8763b2040d admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:00.602567 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d4b45-7479-4a33-9924-ac8763b2040d admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:00.612392 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a4874-99ae-4344-b2e4-6a53554ab0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:00.613840 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a4874-99ae-4344-b2e4-6a53554ab0a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:00.614265 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a4874-99ae-4344-b2e4-6a53554ab0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:00.614685 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a4874-99ae-4344-b2e4-6a53554ab0a0 admin admin] PATH_INFO: `/v3/projects/023ca2d1b99a420fa7f6c42a5fe73fa7/users/e35e6803ac8848a2a169cc74b4199471/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:00.617031 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a4874-99ae-4344-b2e4-6a53554ab0a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=023ca2d1b99a420fa7f6c42a5fe73fa7, user_id=e35e6803ac8848a2a169cc74b4199471, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:00.620433 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a4874-99ae-4344-b2e4-6a53554ab0a0 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:00.633511 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1313/2651] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:13:00 2022] PUT /identity/v3/projects/023ca2d1b99a420fa7f6c42a5fe73fa7/users/e35e6803ac8848a2a169cc74b4199471/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:00.644616 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed8b9b-58c1-41cb-bb1c-8041c72f4a4d None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:00.649839 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed8b9b-58c1-41cb-bb1c-8041c72f4a4d None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:00.650548 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed8b9b-58c1-41cb-bb1c-8041c72f4a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:00.682886 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-e4ed8b9b-58c1-41cb-bb1c-8041c72f4a4d None None] MFA Rules not processed for user `e35e6803ac8848a2a169cc74b4199471`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:00.684136 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-e4ed8b9b-58c1-41cb-bb1c-8041c72f4a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:00.797942 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1339/2652] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:13:00.810339 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a4874-99ae-4344-b2e4-6a53554ab0a0 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:00.812146 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-7c0a4874-99ae-4344-b2e4-6a53554ab0a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:00.881587 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a4874-99ae-4344-b2e4-6a53554ab0a0 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:00.885706 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c493a9-cad9-462a-84af-a01ab37988f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:00.886362 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c493a9-cad9-462a-84af-a01ab37988f6 service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:00.886635 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c493a9-cad9-462a-84af-a01ab37988f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:00.886900 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c493a9-cad9-462a-84af-a01ab37988f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:00.897396 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c493a9-cad9-462a-84af-a01ab37988f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:00.898915 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c493a9-cad9-462a-84af-a01ab37988f6 service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:00.908915 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1314/2653] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:13:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:13:01.041040 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed8b9b-58c1-41cb-bb1c-8041c72f4a4d None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:01.113369 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed8b9b-58c1-41cb-bb1c-8041c72f4a4d None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:01.118123 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736015a-43ee-47a9-a2ed-449ecfc6307f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:01.118970 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736015a-43ee-47a9-a2ed-449ecfc6307f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:01.119273 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736015a-43ee-47a9-a2ed-449ecfc6307f admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:01.119537 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736015a-43ee-47a9-a2ed-449ecfc6307f admin admin] PATH_INFO: `/v3/users/89d01b25a8974bbc902de251fddb1647` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:01.120799 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5736015a-43ee-47a9-a2ed-449ecfc6307f admin admin] RBAC: Authorizing `identity:delete_user(user_id=89d01b25a8974bbc902de251fddb1647)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:01.122767 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5736015a-43ee-47a9-a2ed-449ecfc6307f admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:01.169672 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-5736015a-43ee-47a9-a2ed-449ecfc6307f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89d01b25a8974bbc902de251fddb1647'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:01.176560 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-5736015a-43ee-47a9-a2ed-449ecfc6307f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89d01b25a8974bbc902de251fddb1647'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:01.177401 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-5736015a-43ee-47a9-a2ed-449ecfc6307f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89d01b25a8974bbc902de251fddb1647'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:01.178011 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-5736015a-43ee-47a9-a2ed-449ecfc6307f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89d01b25a8974bbc902de251fddb1647'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:01.191588 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-5736015a-43ee-47a9-a2ed-449ecfc6307f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89d01b25a8974bbc902de251fddb1647'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:01.209681 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1340/2654] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:13:01 2022] DELETE /identity/v3/users/89d01b25a8974bbc902de251fddb1647 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:01.214980 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08e608-005f-4979-87b8-cd8c61c05792 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:01.215271 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08e608-005f-4979-87b8-cd8c61c05792 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:01.215572 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08e608-005f-4979-87b8-cd8c61c05792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:01.234454 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-6e08e608-005f-4979-87b8-cd8c61c05792 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:01.235662 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-6e08e608-005f-4979-87b8-cd8c61c05792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:01.297238 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1315/2655] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:13:01.308515 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736015a-43ee-47a9-a2ed-449ecfc6307f admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:01.310478 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-5736015a-43ee-47a9-a2ed-449ecfc6307f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:01.368234 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736015a-43ee-47a9-a2ed-449ecfc6307f admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:01.371815 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7344e8-cac6-4bb3-8c6d-4f3edd3e88f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:01.372392 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7344e8-cac6-4bb3-8c6d-4f3edd3e88f9 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:01.372663 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7344e8-cac6-4bb3-8c6d-4f3edd3e88f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:01.372926 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7344e8-cac6-4bb3-8c6d-4f3edd3e88f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:01.381813 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7344e8-cac6-4bb3-8c6d-4f3edd3e88f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:01.383365 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7344e8-cac6-4bb3-8c6d-4f3edd3e88f9 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:01.392770 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1341/2656] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:13:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 03:13:01.710924 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08e608-005f-4979-87b8-cd8c61c05792 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:01.712473 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-6e08e608-005f-4979-87b8-cd8c61c05792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:01.724418 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08e608-005f-4979-87b8-cd8c61c05792 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:01.729307 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159760a-a0e4-48dd-a04b-7176c3deecca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:01.730263 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159760a-a0e4-48dd-a04b-7176c3deecca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:01.730603 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159760a-a0e4-48dd-a04b-7176c3deecca admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:01.730975 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159760a-a0e4-48dd-a04b-7176c3deecca admin admin] PATH_INFO: `/v3/projects/09b7a7037b78430294f634198dd31f40` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:01.732369 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159760a-a0e4-48dd-a04b-7176c3deecca admin admin] RBAC: Authorizing `identity:delete_project(project_id=09b7a7037b78430294f634198dd31f40)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:01.734492 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159760a-a0e4-48dd-a04b-7176c3deecca admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:01.790084 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-b159760a-a0e4-48dd-a04b-7176c3deecca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09b7a7037b78430294f634198dd31f40', 'request_id': 'req-b159760a-a0e4-48dd-a04b-7176c3deecca'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:01.798839 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-b159760a-a0e4-48dd-a04b-7176c3deecca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09b7a7037b78430294f634198dd31f40', 'request_id': 'req-b159760a-a0e4-48dd-a04b-7176c3deecca'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:01.805636 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-b159760a-a0e4-48dd-a04b-7176c3deecca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09b7a7037b78430294f634198dd31f40', 'request_id': 'req-b159760a-a0e4-48dd-a04b-7176c3deecca'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:01.816049 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-b159760a-a0e4-48dd-a04b-7176c3deecca admin admin] The token cache is being invalidate because project 09b7a7037b78430294f634198dd31f40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:13:01.816334 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-b159760a-a0e4-48dd-a04b-7176c3deecca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:01.817484 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-b159760a-a0e4-48dd-a04b-7176c3deecca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:01.819409 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1316/2657] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:13:01 2022] DELETE /identity/v3/projects/09b7a7037b78430294f634198dd31f40 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:01.823398 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7344e8-cac6-4bb3-8c6d-4f3edd3e88f9 service neutron] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:01.834214 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7344e8-cac6-4bb3-8c6d-4f3edd3e88f9 service neutron] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:01.905440 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42eb154-450f-4586-b290-8be080827640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:01.906472 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42eb154-450f-4586-b290-8be080827640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:01.906826 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42eb154-450f-4586-b290-8be080827640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:01.907170 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42eb154-450f-4586-b290-8be080827640 admin admin] PATH_INFO: `/v3/users/e35e6803ac8848a2a169cc74b4199471` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:01.908578 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42eb154-450f-4586-b290-8be080827640 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e35e6803ac8848a2a169cc74b4199471)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:01.910865 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42eb154-450f-4586-b290-8be080827640 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:01.959266 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-e42eb154-450f-4586-b290-8be080827640 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e35e6803ac8848a2a169cc74b4199471'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:01.965882 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-e42eb154-450f-4586-b290-8be080827640 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e35e6803ac8848a2a169cc74b4199471'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:01.966532 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-e42eb154-450f-4586-b290-8be080827640 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e35e6803ac8848a2a169cc74b4199471'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:01.967120 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-e42eb154-450f-4586-b290-8be080827640 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e35e6803ac8848a2a169cc74b4199471'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:01.979394 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-e42eb154-450f-4586-b290-8be080827640 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e35e6803ac8848a2a169cc74b4199471'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:01.994292 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1342/2658] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:13:01 2022] DELETE /identity/v3/users/e35e6803ac8848a2a169cc74b4199471 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:02.276556 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159760a-a0e4-48dd-a04b-7176c3deecca admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:02.277995 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-b159760a-a0e4-48dd-a04b-7176c3deecca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:02.291960 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159760a-a0e4-48dd-a04b-7176c3deecca admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:02.357172 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc956bb-36a7-43fb-b296-71e07f6c7668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:02.358039 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc956bb-36a7-43fb-b296-71e07f6c7668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:02.358307 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc956bb-36a7-43fb-b296-71e07f6c7668 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:02.358565 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc956bb-36a7-43fb-b296-71e07f6c7668 admin admin] PATH_INFO: `/v3/projects/023ca2d1b99a420fa7f6c42a5fe73fa7` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:02.359752 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc956bb-36a7-43fb-b296-71e07f6c7668 admin admin] RBAC: Authorizing `identity:delete_project(project_id=023ca2d1b99a420fa7f6c42a5fe73fa7)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:02.361672 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc956bb-36a7-43fb-b296-71e07f6c7668 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:02.409359 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-bcc956bb-36a7-43fb-b296-71e07f6c7668 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '023ca2d1b99a420fa7f6c42a5fe73fa7', 'request_id': 'req-bcc956bb-36a7-43fb-b296-71e07f6c7668'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:02.422260 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-bcc956bb-36a7-43fb-b296-71e07f6c7668 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '023ca2d1b99a420fa7f6c42a5fe73fa7', 'request_id': 'req-bcc956bb-36a7-43fb-b296-71e07f6c7668'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:02.429769 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-bcc956bb-36a7-43fb-b296-71e07f6c7668 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '023ca2d1b99a420fa7f6c42a5fe73fa7', 'request_id': 'req-bcc956bb-36a7-43fb-b296-71e07f6c7668'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:02.439832 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-bcc956bb-36a7-43fb-b296-71e07f6c7668 admin admin] The token cache is being invalidate because project 023ca2d1b99a420fa7f6c42a5fe73fa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:13:02.440107 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-bcc956bb-36a7-43fb-b296-71e07f6c7668 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:02.440726 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-bcc956bb-36a7-43fb-b296-71e07f6c7668 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:02.442395 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1317/2659] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:13:02 2022] DELETE /identity/v3/projects/023ca2d1b99a420fa7f6c42a5fe73fa7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:02.447475 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e514a-e863-4c96-ba0f-26dd88dfc3e5 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:02.447751 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e514a-e863-4c96-ba0f-26dd88dfc3e5 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:02.448038 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e514a-e863-4c96-ba0f-26dd88dfc3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:02.470107 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-911e514a-e863-4c96-ba0f-26dd88dfc3e5 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:02.471288 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-911e514a-e863-4c96-ba0f-26dd88dfc3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:02.531884 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1343/2660] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:13:02.539256 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e389b-df8a-4471-8c84-ced3564a00cc None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:02.539512 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e389b-df8a-4471-8c84-ced3564a00cc None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:02.539782 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e389b-df8a-4471-8c84-ced3564a00cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:02.563763 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-3a4e389b-df8a-4471-8c84-ced3564a00cc None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:02.565129 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-3a4e389b-df8a-4471-8c84-ced3564a00cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:02.576757 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1318/2661] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:13:02.580812 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e514a-e863-4c96-ba0f-26dd88dfc3e5 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:02.591646 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e514a-e863-4c96-ba0f-26dd88dfc3e5 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:02.599780 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a70482-0d3e-484a-9f13-b7d4be1f59a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:02.599780 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a70482-0d3e-484a-9f13-b7d4be1f59a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:02.599780 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a70482-0d3e-484a-9f13-b7d4be1f59a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:02.599780 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a70482-0d3e-484a-9f13-b7d4be1f59a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:02.600203 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a70482-0d3e-484a-9f13-b7d4be1f59a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:13:02.600203 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a70482-0d3e-484a-9f13-b7d4be1f59a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:02.600737 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a70482-0d3e-484a-9f13-b7d4be1f59a6 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:02.613895 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1344/2662] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:13:02.617790 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e389b-df8a-4471-8c84-ced3564a00cc None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:02.626715 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e389b-df8a-4471-8c84-ced3564a00cc None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:02.631500 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab38798-1e99-42a2-b7c4-c7c248bd5925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:02.632273 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab38798-1e99-42a2-b7c4-c7c248bd5925 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:02.632553 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab38798-1e99-42a2-b7c4-c7c248bd5925 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:02.632812 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab38798-1e99-42a2-b7c4-c7c248bd5925 admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:02.633488 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab38798-1e99-42a2-b7c4-c7c248bd5925 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:02.635392 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab38798-1e99-42a2-b7c4-c7c248bd5925 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:02.663638 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1319/2663] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:13:02 2022] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:13:02.664935 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a70482-0d3e-484a-9f13-b7d4be1f59a6 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:02.675592 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a70482-0d3e-484a-9f13-b7d4be1f59a6 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:02.734858 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8f3f0-06e9-4377-a25a-7934cb34fdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:02.735551 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8f3f0-06e9-4377-a25a-7934cb34fdc3 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:02.735964 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8f3f0-06e9-4377-a25a-7934cb34fdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:02.736231 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8f3f0-06e9-4377-a25a-7934cb34fdc3 admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:02.736918 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c8f3f0-06e9-4377-a25a-7934cb34fdc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:02.739482 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c8f3f0-06e9-4377-a25a-7934cb34fdc3 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:02.764013 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1345/2664] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:13:02 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:13:02.765968 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab38798-1e99-42a2-b7c4-c7c248bd5925 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:02.778221 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab38798-1e99-42a2-b7c4-c7c248bd5925 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:02.784215 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3da0d-0211-4c26-886f-087a95f45091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:02.785069 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3da0d-0211-4c26-886f-087a95f45091 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:02.785426 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3da0d-0211-4c26-886f-087a95f45091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:02.785668 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3da0d-0211-4c26-886f-087a95f45091 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:02.786380 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3da0d-0211-4c26-886f-087a95f45091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:02.788003 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3da0d-0211-4c26-886f-087a95f45091 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:02.806341 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1320/2665] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:13:02.810724 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8f3f0-06e9-4377-a25a-7934cb34fdc3 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:02.822403 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8f3f0-06e9-4377-a25a-7934cb34fdc3 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:02.828919 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db4ae9-d284-4585-a369-fed82df19c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:02.829587 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db4ae9-d284-4585-a369-fed82df19c94 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:02.829860 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db4ae9-d284-4585-a369-fed82df19c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:02.830184 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db4ae9-d284-4585-a369-fed82df19c94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:02.830895 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db4ae9-d284-4585-a369-fed82df19c94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:02.833342 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db4ae9-d284-4585-a369-fed82df19c94 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:02.848200 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1346/2666] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:13:02.849587 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3da0d-0211-4c26-886f-087a95f45091 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:02.860263 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3da0d-0211-4c26-886f-087a95f45091 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:02.865996 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911f861-c65a-4cf6-989a-ebf95eaeb3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:02.867032 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911f861-c65a-4cf6-989a-ebf95eaeb3b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:02.867338 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911f861-c65a-4cf6-989a-ebf95eaeb3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:02.867777 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911f861-c65a-4cf6-989a-ebf95eaeb3b4 admin admin] PATH_INFO: `/v3/projects/ebebcc8ceb56470daef15adf628de7cd/users/4a333536342c471588b65744f29084b7/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:02.883125 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b911f861-c65a-4cf6-989a-ebf95eaeb3b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebebcc8ceb56470daef15adf628de7cd, user_id=4a333536342c471588b65744f29084b7, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:02.886138 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b911f861-c65a-4cf6-989a-ebf95eaeb3b4 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:02.903777 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1321/2667] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:13:02 2022] PUT /identity/v3/projects/ebebcc8ceb56470daef15adf628de7cd/users/4a333536342c471588b65744f29084b7/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:02.912258 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491709ee-57cf-4f26-ae6d-a8cb1187811a None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:02.912533 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491709ee-57cf-4f26-ae6d-a8cb1187811a None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:02.912801 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491709ee-57cf-4f26-ae6d-a8cb1187811a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:02.954850 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-491709ee-57cf-4f26-ae6d-a8cb1187811a None None] MFA Rules not processed for user `4a333536342c471588b65744f29084b7`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:02.956170 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-491709ee-57cf-4f26-ae6d-a8cb1187811a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:03.025622 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1347/2668] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:13:03.030140 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911f861-c65a-4cf6-989a-ebf95eaeb3b4 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:03.103021 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911f861-c65a-4cf6-989a-ebf95eaeb3b4 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:03.108044 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b7a47-9a37-4416-9000-a95bf09fcdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:03.108700 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b7a47-9a37-4416-9000-a95bf09fcdd9 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:03.109001 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b7a47-9a37-4416-9000-a95bf09fcdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:03.109338 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b7a47-9a37-4416-9000-a95bf09fcdd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:03.110116 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b7a47-9a37-4416-9000-a95bf09fcdd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:03.112220 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b7a47-9a37-4416-9000-a95bf09fcdd9 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:03.138685 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1322/2669] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:13:03 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:13:03.143057 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491709ee-57cf-4f26-ae6d-a8cb1187811a None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:03.154866 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491709ee-57cf-4f26-ae6d-a8cb1187811a None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:03.214973 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7dfcbc-fa45-4b06-8a59-7ee6ece1214e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:03.215659 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7dfcbc-fa45-4b06-8a59-7ee6ece1214e admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:03.215960 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7dfcbc-fa45-4b06-8a59-7ee6ece1214e admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:03.216233 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7dfcbc-fa45-4b06-8a59-7ee6ece1214e admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:03.216916 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7dfcbc-fa45-4b06-8a59-7ee6ece1214e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:03.218903 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7dfcbc-fa45-4b06-8a59-7ee6ece1214e admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:03.240524 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1348/2670] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:13:03 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:13:03.244682 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b7a47-9a37-4416-9000-a95bf09fcdd9 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:03.255927 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b7a47-9a37-4416-9000-a95bf09fcdd9 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:03.261208 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cce0eb-3922-42ae-ba15-8ef1ac8aa3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:03.262032 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cce0eb-3922-42ae-ba15-8ef1ac8aa3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:03.262460 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cce0eb-3922-42ae-ba15-8ef1ac8aa3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:03.262628 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cce0eb-3922-42ae-ba15-8ef1ac8aa3c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:03.263460 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cce0eb-3922-42ae-ba15-8ef1ac8aa3c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:03.265361 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cce0eb-3922-42ae-ba15-8ef1ac8aa3c3 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:03.277898 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1323/2671] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:13:03.282202 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7dfcbc-fa45-4b06-8a59-7ee6ece1214e admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:03.292700 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7dfcbc-fa45-4b06-8a59-7ee6ece1214e admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:03.298281 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79162534-2300-4305-a413-9666cfbdd2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:03.298943 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79162534-2300-4305-a413-9666cfbdd2e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:03.299218 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79162534-2300-4305-a413-9666cfbdd2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:03.299483 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79162534-2300-4305-a413-9666cfbdd2e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:03.300233 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79162534-2300-4305-a413-9666cfbdd2e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:03.301868 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79162534-2300-4305-a413-9666cfbdd2e0 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:03.319399 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1349/2672] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:13:03.324516 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cce0eb-3922-42ae-ba15-8ef1ac8aa3c3 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:03.335374 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cce0eb-3922-42ae-ba15-8ef1ac8aa3c3 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:03.341154 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28944bcf-e606-4ba4-b3cd-4cacc5ae0190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:03.342382 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28944bcf-e606-4ba4-b3cd-4cacc5ae0190 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:03.342801 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28944bcf-e606-4ba4-b3cd-4cacc5ae0190 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:03.343064 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28944bcf-e606-4ba4-b3cd-4cacc5ae0190 admin admin] PATH_INFO: `/v3/projects/f17ec208d53441a5a7655d9e90c73c67/users/35b99ce001ff47c89b027ba5fde1b12e/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:03.360785 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28944bcf-e606-4ba4-b3cd-4cacc5ae0190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f17ec208d53441a5a7655d9e90c73c67, user_id=35b99ce001ff47c89b027ba5fde1b12e, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:03.363464 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28944bcf-e606-4ba4-b3cd-4cacc5ae0190 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:03.377706 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1324/2673] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:13:03 2022] PUT /identity/v3/projects/f17ec208d53441a5a7655d9e90c73c67/users/35b99ce001ff47c89b027ba5fde1b12e/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:03.388901 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5a035-2a22-4e55-ad43-2cb72160a88c None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:03.389195 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5a035-2a22-4e55-ad43-2cb72160a88c None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:03.389444 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5a035-2a22-4e55-ad43-2cb72160a88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:03.417765 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-eca5a035-2a22-4e55-ad43-2cb72160a88c None None] MFA Rules not processed for user `35b99ce001ff47c89b027ba5fde1b12e`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:03.419158 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-eca5a035-2a22-4e55-ad43-2cb72160a88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:03.486760 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1350/2674] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:13:03.491484 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28944bcf-e606-4ba4-b3cd-4cacc5ae0190 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:03.554303 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28944bcf-e606-4ba4-b3cd-4cacc5ae0190 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:03.561731 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88162a2-a633-41f5-be96-c64253cf8c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:03.563596 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88162a2-a633-41f5-be96-c64253cf8c35 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:03.563973 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88162a2-a633-41f5-be96-c64253cf8c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:03.564342 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88162a2-a633-41f5-be96-c64253cf8c35 admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:03.565029 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88162a2-a633-41f5-be96-c64253cf8c35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:03.567473 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88162a2-a633-41f5-be96-c64253cf8c35 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:03.596253 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1325/2675] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:13:03 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:13:03.601489 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5a035-2a22-4e55-ad43-2cb72160a88c None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:03.614625 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5a035-2a22-4e55-ad43-2cb72160a88c None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:03.684846 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f7e78-e6c2-46bf-8ea5-e6ce48c827b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:03.685758 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f7e78-e6c2-46bf-8ea5-e6ce48c827b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:03.686173 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f7e78-e6c2-46bf-8ea5-e6ce48c827b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:03.686440 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f7e78-e6c2-46bf-8ea5-e6ce48c827b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:03.687374 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f7e78-e6c2-46bf-8ea5-e6ce48c827b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:03.689639 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f7e78-e6c2-46bf-8ea5-e6ce48c827b3 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:03.715870 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1351/2676] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:13:03 2022] POST /identity/v3/users => generated 295 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:13:03.717110 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88162a2-a633-41f5-be96-c64253cf8c35 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:03.727268 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88162a2-a633-41f5-be96-c64253cf8c35 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:03.731905 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddeebea-db1b-4bd9-a4f5-8a9d5f87b787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:03.732554 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddeebea-db1b-4bd9-a4f5-8a9d5f87b787 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:03.732823 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddeebea-db1b-4bd9-a4f5-8a9d5f87b787 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:03.733104 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddeebea-db1b-4bd9-a4f5-8a9d5f87b787 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:03.733793 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddeebea-db1b-4bd9-a4f5-8a9d5f87b787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:03.735371 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddeebea-db1b-4bd9-a4f5-8a9d5f87b787 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:03.746092 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1326/2677] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:13:03.750274 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f7e78-e6c2-46bf-8ea5-e6ce48c827b3 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:03.760626 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f7e78-e6c2-46bf-8ea5-e6ce48c827b3 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:03.765383 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d5166-3c8f-4883-99fc-94f2a11178fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:03.766279 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d5166-3c8f-4883-99fc-94f2a11178fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:03.766558 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d5166-3c8f-4883-99fc-94f2a11178fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:03.766828 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d5166-3c8f-4883-99fc-94f2a11178fa admin admin] PATH_INFO: `/v3/projects/fe4d9c2b6c874957bdf1c38dcec03f8b/users/fbae94835fca4b478687e97b61643eb3/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:03.781606 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d5166-3c8f-4883-99fc-94f2a11178fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe4d9c2b6c874957bdf1c38dcec03f8b, user_id=fbae94835fca4b478687e97b61643eb3, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:03.784286 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d5166-3c8f-4883-99fc-94f2a11178fa admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:03.799002 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1352/2678] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:13:03 2022] PUT /identity/v3/projects/fe4d9c2b6c874957bdf1c38dcec03f8b/users/fbae94835fca4b478687e97b61643eb3/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:03.804096 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddeebea-db1b-4bd9-a4f5-8a9d5f87b787 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:03.815397 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddeebea-db1b-4bd9-a4f5-8a9d5f87b787 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:03.877614 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8410f-add3-4430-898d-5cf7657639f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:03.888052 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8410f-add3-4430-898d-5cf7657639f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:03.888052 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8410f-add3-4430-898d-5cf7657639f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:03.888052 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8410f-add3-4430-898d-5cf7657639f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:03.888052 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8410f-add3-4430-898d-5cf7657639f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:03.888052 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8410f-add3-4430-898d-5cf7657639f9 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:03.897685 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1327/2679] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:13:03.901992 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d5166-3c8f-4883-99fc-94f2a11178fa admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:03.912324 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d5166-3c8f-4883-99fc-94f2a11178fa admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:03.917050 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c589422-10e7-40f9-9adb-556acfee3491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:03.917931 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c589422-10e7-40f9-9adb-556acfee3491 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:03.918207 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c589422-10e7-40f9-9adb-556acfee3491 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:03.918471 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c589422-10e7-40f9-9adb-556acfee3491 admin admin] PATH_INFO: `/v3/projects/fe4d9c2b6c874957bdf1c38dcec03f8b/users/fbae94835fca4b478687e97b61643eb3/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:03.920471 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c589422-10e7-40f9-9adb-556acfee3491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe4d9c2b6c874957bdf1c38dcec03f8b, user_id=fbae94835fca4b478687e97b61643eb3, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:03.923106 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c589422-10e7-40f9-9adb-556acfee3491 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:03.936359 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1353/2680] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:13:03 2022] PUT /identity/v3/projects/fe4d9c2b6c874957bdf1c38dcec03f8b/users/fbae94835fca4b478687e97b61643eb3/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:03.948286 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f497995-b1cb-4566-9aab-9c9321d63fd3 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:03.948568 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f497995-b1cb-4566-9aab-9c9321d63fd3 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:03.948839 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f497995-b1cb-4566-9aab-9c9321d63fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:03.979217 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-3f497995-b1cb-4566-9aab-9c9321d63fd3 None None] MFA Rules not processed for user `fbae94835fca4b478687e97b61643eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:03.980444 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-3f497995-b1cb-4566-9aab-9c9321d63fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:04.059041 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1328/2681] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:03 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:13:04.071602 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c589422-10e7-40f9-9adb-556acfee3491 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:04.073367 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-0c589422-10e7-40f9-9adb-556acfee3491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:04.132138 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c589422-10e7-40f9-9adb-556acfee3491 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:04.136008 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcafff8-ba86-4bf5-ac98-db694fed7e6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:04.136788 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcafff8-ba86-4bf5-ac98-db694fed7e6f service cinder] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:04.137074 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcafff8-ba86-4bf5-ac98-db694fed7e6f service cinder] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:04.137366 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcafff8-ba86-4bf5-ac98-db694fed7e6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:04.146836 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcafff8-ba86-4bf5-ac98-db694fed7e6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:04.148301 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcafff8-ba86-4bf5-ac98-db694fed7e6f service cinder] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:04.157726 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1354/2682] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:13:04 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:13:04.205123 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f497995-b1cb-4566-9aab-9c9321d63fd3 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:04.206598 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-3f497995-b1cb-4566-9aab-9c9321d63fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:04.218844 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f497995-b1cb-4566-9aab-9c9321d63fd3 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:04.222652 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94a5e7-532d-4029-9498-537d041de073 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:04.223632 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94a5e7-532d-4029-9498-537d041de073 service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:04.223945 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94a5e7-532d-4029-9498-537d041de073 service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:04.224213 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94a5e7-532d-4029-9498-537d041de073 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:04.287972 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94a5e7-532d-4029-9498-537d041de073 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:04.289425 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94a5e7-532d-4029-9498-537d041de073 service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:04.301922 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1329/2683] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:13:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:13:09.322874 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcafff8-ba86-4bf5-ac98-db694fed7e6f service cinder] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:09.388293 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcafff8-ba86-4bf5-ac98-db694fed7e6f service cinder] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:09.393846 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b2d8b-a44e-4d7c-8b04-492e7c5d0da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:09.394705 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b2d8b-a44e-4d7c-8b04-492e7c5d0da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:09.395153 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b2d8b-a44e-4d7c-8b04-492e7c5d0da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:09.395423 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b2d8b-a44e-4d7c-8b04-492e7c5d0da1 admin admin] PATH_INFO: `/v3/users/4a333536342c471588b65744f29084b7` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:09.396841 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b2d8b-a44e-4d7c-8b04-492e7c5d0da1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a333536342c471588b65744f29084b7)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:09.398826 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b2d8b-a44e-4d7c-8b04-492e7c5d0da1 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:09.448235 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-067b2d8b-a44e-4d7c-8b04-492e7c5d0da1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a333536342c471588b65744f29084b7'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:09.455895 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-067b2d8b-a44e-4d7c-8b04-492e7c5d0da1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a333536342c471588b65744f29084b7'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:09.456837 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-067b2d8b-a44e-4d7c-8b04-492e7c5d0da1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a333536342c471588b65744f29084b7'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:09.457740 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-067b2d8b-a44e-4d7c-8b04-492e7c5d0da1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a333536342c471588b65744f29084b7'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:09.471539 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-067b2d8b-a44e-4d7c-8b04-492e7c5d0da1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a333536342c471588b65744f29084b7'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:09.489434 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1355/2684] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:13:09 2022] DELETE /identity/v3/users/4a333536342c471588b65744f29084b7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:09.494267 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5a95a-8c1e-4fd5-af66-e29d3c836bea None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:09.494818 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5a95a-8c1e-4fd5-af66-e29d3c836bea None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:09.494818 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5a95a-8c1e-4fd5-af66-e29d3c836bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:09.513658 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-38d5a95a-8c1e-4fd5-af66-e29d3c836bea None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:09.514856 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-38d5a95a-8c1e-4fd5-af66-e29d3c836bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:09.586627 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1330/2685] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:13:09.593475 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b2d8b-a44e-4d7c-8b04-492e7c5d0da1 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:09.595006 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-067b2d8b-a44e-4d7c-8b04-492e7c5d0da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:09.657171 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b2d8b-a44e-4d7c-8b04-492e7c5d0da1 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:09.664099 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b1788-9691-4490-85ad-41cdbf20fd69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:09.665038 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b1788-9691-4490-85ad-41cdbf20fd69 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:09.665406 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b1788-9691-4490-85ad-41cdbf20fd69 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:09.665680 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b1788-9691-4490-85ad-41cdbf20fd69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:09.675856 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b1788-9691-4490-85ad-41cdbf20fd69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:09.677323 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b1788-9691-4490-85ad-41cdbf20fd69 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:09.687662 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1356/2686] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:13:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:13:10.015983 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d5a95a-8c1e-4fd5-af66-e29d3c836bea None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:10.017381 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-38d5a95a-8c1e-4fd5-af66-e29d3c836bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:10.040775 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d5a95a-8c1e-4fd5-af66-e29d3c836bea None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:10.046778 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653a6a0-ad03-41f4-b423-6234ae691336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:10.047632 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653a6a0-ad03-41f4-b423-6234ae691336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:10.047938 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653a6a0-ad03-41f4-b423-6234ae691336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:10.048199 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653a6a0-ad03-41f4-b423-6234ae691336 admin admin] PATH_INFO: `/v3/projects/ebebcc8ceb56470daef15adf628de7cd` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:10.049486 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653a6a0-ad03-41f4-b423-6234ae691336 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebebcc8ceb56470daef15adf628de7cd)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:10.051546 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653a6a0-ad03-41f4-b423-6234ae691336 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:10.106943 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-f653a6a0-ad03-41f4-b423-6234ae691336 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebebcc8ceb56470daef15adf628de7cd', 'request_id': 'req-f653a6a0-ad03-41f4-b423-6234ae691336'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:10.114638 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-f653a6a0-ad03-41f4-b423-6234ae691336 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebebcc8ceb56470daef15adf628de7cd', 'request_id': 'req-f653a6a0-ad03-41f4-b423-6234ae691336'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:10.121193 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-f653a6a0-ad03-41f4-b423-6234ae691336 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebebcc8ceb56470daef15adf628de7cd', 'request_id': 'req-f653a6a0-ad03-41f4-b423-6234ae691336'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:10.132182 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-f653a6a0-ad03-41f4-b423-6234ae691336 admin admin] The token cache is being invalidate because project ebebcc8ceb56470daef15adf628de7cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:13:10.132465 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-f653a6a0-ad03-41f4-b423-6234ae691336 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:10.133161 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-f653a6a0-ad03-41f4-b423-6234ae691336 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:10.134709 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1331/2687] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:13:10 2022] DELETE /identity/v3/projects/ebebcc8ceb56470daef15adf628de7cd => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:10.138688 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b1788-9691-4490-85ad-41cdbf20fd69 service neutron] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:10.148412 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b1788-9691-4490-85ad-41cdbf20fd69 service neutron] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:10.204593 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40826d4b-65b1-449d-9f79-ad4ad91b564a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:10.205472 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40826d4b-65b1-449d-9f79-ad4ad91b564a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:10.205748 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40826d4b-65b1-449d-9f79-ad4ad91b564a admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:10.206016 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40826d4b-65b1-449d-9f79-ad4ad91b564a admin admin] PATH_INFO: `/v3/users/35b99ce001ff47c89b027ba5fde1b12e` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:10.207298 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40826d4b-65b1-449d-9f79-ad4ad91b564a admin admin] RBAC: Authorizing `identity:delete_user(user_id=35b99ce001ff47c89b027ba5fde1b12e)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:10.209300 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40826d4b-65b1-449d-9f79-ad4ad91b564a admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:10.255534 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-40826d4b-65b1-449d-9f79-ad4ad91b564a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35b99ce001ff47c89b027ba5fde1b12e'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:10.262757 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-40826d4b-65b1-449d-9f79-ad4ad91b564a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35b99ce001ff47c89b027ba5fde1b12e'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:10.263426 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-40826d4b-65b1-449d-9f79-ad4ad91b564a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35b99ce001ff47c89b027ba5fde1b12e'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:10.264034 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-40826d4b-65b1-449d-9f79-ad4ad91b564a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35b99ce001ff47c89b027ba5fde1b12e'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:10.275620 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-40826d4b-65b1-449d-9f79-ad4ad91b564a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35b99ce001ff47c89b027ba5fde1b12e'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:10.289136 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1357/2688] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:13:10 2022] DELETE /identity/v3/users/35b99ce001ff47c89b027ba5fde1b12e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:10.562398 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653a6a0-ad03-41f4-b423-6234ae691336 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:10.563947 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-f653a6a0-ad03-41f4-b423-6234ae691336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:10.580072 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653a6a0-ad03-41f4-b423-6234ae691336 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:10.636965 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e663bb-d428-40ec-85d3-93ed3967bad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:10.637824 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e663bb-d428-40ec-85d3-93ed3967bad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:10.638096 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e663bb-d428-40ec-85d3-93ed3967bad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:10.638360 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e663bb-d428-40ec-85d3-93ed3967bad3 admin admin] PATH_INFO: `/v3/projects/f17ec208d53441a5a7655d9e90c73c67` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:10.639533 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e663bb-d428-40ec-85d3-93ed3967bad3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f17ec208d53441a5a7655d9e90c73c67)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:10.641476 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e663bb-d428-40ec-85d3-93ed3967bad3 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:10.688361 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-04e663bb-d428-40ec-85d3-93ed3967bad3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f17ec208d53441a5a7655d9e90c73c67', 'request_id': 'req-04e663bb-d428-40ec-85d3-93ed3967bad3'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:10.697311 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-04e663bb-d428-40ec-85d3-93ed3967bad3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f17ec208d53441a5a7655d9e90c73c67', 'request_id': 'req-04e663bb-d428-40ec-85d3-93ed3967bad3'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:10.703535 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-04e663bb-d428-40ec-85d3-93ed3967bad3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f17ec208d53441a5a7655d9e90c73c67', 'request_id': 'req-04e663bb-d428-40ec-85d3-93ed3967bad3'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:10.713159 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-04e663bb-d428-40ec-85d3-93ed3967bad3 admin admin] The token cache is being invalidate because project f17ec208d53441a5a7655d9e90c73c67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:13:10.713432 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-04e663bb-d428-40ec-85d3-93ed3967bad3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:10.714036 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-04e663bb-d428-40ec-85d3-93ed3967bad3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:10.715558 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1332/2689] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:13:10 2022] DELETE /identity/v3/projects/f17ec208d53441a5a7655d9e90c73c67 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:10.719802 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40826d4b-65b1-449d-9f79-ad4ad91b564a admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:10.721284 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-40826d4b-65b1-449d-9f79-ad4ad91b564a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:10.734671 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40826d4b-65b1-449d-9f79-ad4ad91b564a admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:10.793800 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a2dbc-3d5c-40a8-a764-2bdd007be572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:10.794661 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a2dbc-3d5c-40a8-a764-2bdd007be572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:10.794926 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a2dbc-3d5c-40a8-a764-2bdd007be572 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:10.795204 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a2dbc-3d5c-40a8-a764-2bdd007be572 admin admin] PATH_INFO: `/v3/users/fbae94835fca4b478687e97b61643eb3` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:10.796402 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a2dbc-3d5c-40a8-a764-2bdd007be572 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbae94835fca4b478687e97b61643eb3)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:10.798532 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a2dbc-3d5c-40a8-a764-2bdd007be572 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:10.846819 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-550a2dbc-3d5c-40a8-a764-2bdd007be572 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbae94835fca4b478687e97b61643eb3'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:10.854174 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-550a2dbc-3d5c-40a8-a764-2bdd007be572 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbae94835fca4b478687e97b61643eb3'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:10.854964 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-550a2dbc-3d5c-40a8-a764-2bdd007be572 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbae94835fca4b478687e97b61643eb3'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:10.855705 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-550a2dbc-3d5c-40a8-a764-2bdd007be572 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbae94835fca4b478687e97b61643eb3'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:10.868159 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-550a2dbc-3d5c-40a8-a764-2bdd007be572 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbae94835fca4b478687e97b61643eb3'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:10.881509 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1358/2690] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:13:10 2022] DELETE /identity/v3/users/fbae94835fca4b478687e97b61643eb3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:11.164346 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e663bb-d428-40ec-85d3-93ed3967bad3 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:11.165849 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-04e663bb-d428-40ec-85d3-93ed3967bad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:11.179825 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e663bb-d428-40ec-85d3-93ed3967bad3 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:11.237069 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3463deb4-5b6f-411a-903b-6c276bc75a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:11.237845 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463deb4-5b6f-411a-903b-6c276bc75a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:11.238192 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463deb4-5b6f-411a-903b-6c276bc75a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:11.238629 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463deb4-5b6f-411a-903b-6c276bc75a0a admin admin] PATH_INFO: `/v3/projects/fe4d9c2b6c874957bdf1c38dcec03f8b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:11.239821 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3463deb4-5b6f-411a-903b-6c276bc75a0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe4d9c2b6c874957bdf1c38dcec03f8b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:11.241795 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3463deb4-5b6f-411a-903b-6c276bc75a0a admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:11.290989 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3463deb4-5b6f-411a-903b-6c276bc75a0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe4d9c2b6c874957bdf1c38dcec03f8b', 'request_id': 'req-3463deb4-5b6f-411a-903b-6c276bc75a0a'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:11.300387 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3463deb4-5b6f-411a-903b-6c276bc75a0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe4d9c2b6c874957bdf1c38dcec03f8b', 'request_id': 'req-3463deb4-5b6f-411a-903b-6c276bc75a0a'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:11.306895 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3463deb4-5b6f-411a-903b-6c276bc75a0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe4d9c2b6c874957bdf1c38dcec03f8b', 'request_id': 'req-3463deb4-5b6f-411a-903b-6c276bc75a0a'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:11.317991 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3463deb4-5b6f-411a-903b-6c276bc75a0a admin admin] The token cache is being invalidate because project fe4d9c2b6c874957bdf1c38dcec03f8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:13:11.318274 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3463deb4-5b6f-411a-903b-6c276bc75a0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:11.318984 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3463deb4-5b6f-411a-903b-6c276bc75a0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:11.320639 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1333/2691] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:13:11 2022] DELETE /identity/v3/projects/fe4d9c2b6c874957bdf1c38dcec03f8b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:11.327195 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a298cb-4b92-4c08-9852-5323990e0b28 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:11.327306 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a298cb-4b92-4c08-9852-5323990e0b28 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:11.327485 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a298cb-4b92-4c08-9852-5323990e0b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:11.346870 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-e2a298cb-4b92-4c08-9852-5323990e0b28 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:11.348183 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-e2a298cb-4b92-4c08-9852-5323990e0b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:11.407848 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1359/2692] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:13:11.416251 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21840bd3-2859-4341-afe2-0ce8dbe7de91 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:11.416528 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21840bd3-2859-4341-afe2-0ce8dbe7de91 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:11.416794 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21840bd3-2859-4341-afe2-0ce8dbe7de91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:11.436038 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-21840bd3-2859-4341-afe2-0ce8dbe7de91 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:11.437213 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-21840bd3-2859-4341-afe2-0ce8dbe7de91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:11.446396 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1334/2693] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:13:11.450977 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a298cb-4b92-4c08-9852-5323990e0b28 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:11.461795 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a298cb-4b92-4c08-9852-5323990e0b28 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:11.467875 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843366f2-80ac-47ce-9ad6-9b71a3c9836b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:11.468524 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843366f2-80ac-47ce-9ad6-9b71a3c9836b admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:11.468798 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843366f2-80ac-47ce-9ad6-9b71a3c9836b admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:11.469063 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843366f2-80ac-47ce-9ad6-9b71a3c9836b admin admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:11.469789 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843366f2-80ac-47ce-9ad6-9b71a3c9836b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:13:11.470087 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843366f2-80ac-47ce-9ad6-9b71a3c9836b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:11.471681 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843366f2-80ac-47ce-9ad6-9b71a3c9836b admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:11.484756 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1360/2694] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:13:11.489685 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21840bd3-2859-4341-afe2-0ce8dbe7de91 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:11.499237 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21840bd3-2859-4341-afe2-0ce8dbe7de91 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:11.505674 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee3aaa-859d-47b0-be9d-750f452cc3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:11.506316 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee3aaa-859d-47b0-be9d-750f452cc3ac admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:11.506591 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee3aaa-859d-47b0-be9d-750f452cc3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:11.506856 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee3aaa-859d-47b0-be9d-750f452cc3ac admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:11.507527 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee3aaa-859d-47b0-be9d-750f452cc3ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:11.509510 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee3aaa-859d-47b0-be9d-750f452cc3ac admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:11.536950 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1335/2695] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:13:11 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:13:11.541339 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843366f2-80ac-47ce-9ad6-9b71a3c9836b admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:11.551462 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843366f2-80ac-47ce-9ad6-9b71a3c9836b admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:11.609055 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001002b-e903-4840-8436-fad4b66b5bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:11.609732 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001002b-e903-4840-8436-fad4b66b5bed admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:11.610004 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001002b-e903-4840-8436-fad4b66b5bed admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:11.610267 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001002b-e903-4840-8436-fad4b66b5bed admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:11.610955 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001002b-e903-4840-8436-fad4b66b5bed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:11.612973 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001002b-e903-4840-8436-fad4b66b5bed admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:11.633766 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1361/2696] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:13:11 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:13:11.639751 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee3aaa-859d-47b0-be9d-750f452cc3ac admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:11.651163 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee3aaa-859d-47b0-be9d-750f452cc3ac admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:11.655909 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa6c4e-8e64-484a-98af-68bbe5839f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:11.656570 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa6c4e-8e64-484a-98af-68bbe5839f87 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:11.656840 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa6c4e-8e64-484a-98af-68bbe5839f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:11.657109 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa6c4e-8e64-484a-98af-68bbe5839f87 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:11.657833 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa6c4e-8e64-484a-98af-68bbe5839f87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:11.659462 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa6c4e-8e64-484a-98af-68bbe5839f87 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:11.670439 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1336/2697] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:13:11.674640 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001002b-e903-4840-8436-fad4b66b5bed admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:11.684636 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001002b-e903-4840-8436-fad4b66b5bed admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:11.689943 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d96a0-98d4-43bb-a504-a18b5fd9a24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:11.690596 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d96a0-98d4-43bb-a504-a18b5fd9a24b admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:11.690915 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d96a0-98d4-43bb-a504-a18b5fd9a24b admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:11.691322 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d96a0-98d4-43bb-a504-a18b5fd9a24b admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:11.692149 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d96a0-98d4-43bb-a504-a18b5fd9a24b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:11.693829 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d96a0-98d4-43bb-a504-a18b5fd9a24b admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:11.704397 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1362/2698] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:13:11.709097 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa6c4e-8e64-484a-98af-68bbe5839f87 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:11.719355 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa6c4e-8e64-484a-98af-68bbe5839f87 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:11.724894 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2354e-c58a-402b-8e20-5201b24b72a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:11.725775 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2354e-c58a-402b-8e20-5201b24b72a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:11.726042 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2354e-c58a-402b-8e20-5201b24b72a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:11.726336 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2354e-c58a-402b-8e20-5201b24b72a7 admin admin] PATH_INFO: `/v3/projects/d98f6ec5279c49c5b9859bf853f6a386/users/c44995391d6f4d10940dd34760b23ec5/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:11.740873 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2354e-c58a-402b-8e20-5201b24b72a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d98f6ec5279c49c5b9859bf853f6a386, user_id=c44995391d6f4d10940dd34760b23ec5, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:11.743434 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2354e-c58a-402b-8e20-5201b24b72a7 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:11.758882 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1337/2699] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:13:11 2022] PUT /identity/v3/projects/d98f6ec5279c49c5b9859bf853f6a386/users/c44995391d6f4d10940dd34760b23ec5/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:11.771377 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8d16e-2f74-4e2f-b5ec-e71dccb7ee30 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:11.771883 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8d16e-2f74-4e2f-b5ec-e71dccb7ee30 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:11.772005 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8d16e-2f74-4e2f-b5ec-e71dccb7ee30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:11.803870 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-dea8d16e-2f74-4e2f-b5ec-e71dccb7ee30 None None] MFA Rules not processed for user `c44995391d6f4d10940dd34760b23ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:11.805064 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-dea8d16e-2f74-4e2f-b5ec-e71dccb7ee30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:11.887131 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1363/2700] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:13:11.891894 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2354e-c58a-402b-8e20-5201b24b72a7 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:11.964060 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2354e-c58a-402b-8e20-5201b24b72a7 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:11.969376 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b33eb-62f7-4d9a-ab42-6ab6fde6b3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:11.970024 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b33eb-62f7-4d9a-ab42-6ab6fde6b3a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:11.970300 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b33eb-62f7-4d9a-ab42-6ab6fde6b3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:11.970567 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b33eb-62f7-4d9a-ab42-6ab6fde6b3a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:11.971232 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b33eb-62f7-4d9a-ab42-6ab6fde6b3a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:11.973535 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b33eb-62f7-4d9a-ab42-6ab6fde6b3a7 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:12.003481 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1338/2701] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:13:11 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:13:12.009349 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8d16e-2f74-4e2f-b5ec-e71dccb7ee30 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:12.024579 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8d16e-2f74-4e2f-b5ec-e71dccb7ee30 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:12.081010 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c21a8-d857-4729-b68d-359d25746000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:12.081932 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c21a8-d857-4729-b68d-359d25746000 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:12.082061 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c21a8-d857-4729-b68d-359d25746000 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:12.082277 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c21a8-d857-4729-b68d-359d25746000 admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:12.082994 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c21a8-d857-4729-b68d-359d25746000 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:12.092553 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c21a8-d857-4729-b68d-359d25746000 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:12.105215 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1364/2702] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:13:12 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:13:12.109200 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b33eb-62f7-4d9a-ab42-6ab6fde6b3a7 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:12.120062 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b33eb-62f7-4d9a-ab42-6ab6fde6b3a7 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:12.125634 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9150f5-9dc0-4db0-9def-02d8c6f4fef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:12.126286 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9150f5-9dc0-4db0-9def-02d8c6f4fef7 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:12.126558 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9150f5-9dc0-4db0-9def-02d8c6f4fef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:12.126821 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9150f5-9dc0-4db0-9def-02d8c6f4fef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:12.127557 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9150f5-9dc0-4db0-9def-02d8c6f4fef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:12.129262 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9150f5-9dc0-4db0-9def-02d8c6f4fef7 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:12.140109 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1339/2703] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:13:12.144338 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c21a8-d857-4729-b68d-359d25746000 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:12.160295 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c21a8-d857-4729-b68d-359d25746000 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:12.169111 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad8474-f7cc-415d-be8c-a99190be898d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:12.170381 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad8474-f7cc-415d-be8c-a99190be898d admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:12.170644 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad8474-f7cc-415d-be8c-a99190be898d admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:12.171031 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad8474-f7cc-415d-be8c-a99190be898d admin admin] PATH_INFO: `/v3/projects/f47aad6ac4e04dc2a7a6d8e070a2e1b5/users/1d4c14d8e8594b8baea38d6f4b70a114/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:12.187834 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad8474-f7cc-415d-be8c-a99190be898d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f47aad6ac4e04dc2a7a6d8e070a2e1b5, user_id=1d4c14d8e8594b8baea38d6f4b70a114, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:12.190463 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad8474-f7cc-415d-be8c-a99190be898d admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:12.208532 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1365/2704] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:13:12 2022] PUT /identity/v3/projects/f47aad6ac4e04dc2a7a6d8e070a2e1b5/users/1d4c14d8e8594b8baea38d6f4b70a114/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:12.213222 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9150f5-9dc0-4db0-9def-02d8c6f4fef7 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:12.231164 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9150f5-9dc0-4db0-9def-02d8c6f4fef7 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:12.290374 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff2eeb-eba8-471d-b47b-3d5c6481e2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:12.291045 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff2eeb-eba8-471d-b47b-3d5c6481e2aa admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:12.291316 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff2eeb-eba8-471d-b47b-3d5c6481e2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:12.291586 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff2eeb-eba8-471d-b47b-3d5c6481e2aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:12.292331 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff2eeb-eba8-471d-b47b-3d5c6481e2aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:12.293928 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff2eeb-eba8-471d-b47b-3d5c6481e2aa admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:12.303577 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1340/2705] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:13:12.307751 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad8474-f7cc-415d-be8c-a99190be898d admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:12.317899 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad8474-f7cc-415d-be8c-a99190be898d admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:12.322846 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d801f34-3c22-44cd-9c3f-660f490cccf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:12.323736 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d801f34-3c22-44cd-9c3f-660f490cccf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:12.324014 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d801f34-3c22-44cd-9c3f-660f490cccf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:12.324281 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d801f34-3c22-44cd-9c3f-660f490cccf9 admin admin] PATH_INFO: `/v3/projects/f47aad6ac4e04dc2a7a6d8e070a2e1b5/users/1d4c14d8e8594b8baea38d6f4b70a114/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:12.326559 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d801f34-3c22-44cd-9c3f-660f490cccf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f47aad6ac4e04dc2a7a6d8e070a2e1b5, user_id=1d4c14d8e8594b8baea38d6f4b70a114, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:12.329216 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d801f34-3c22-44cd-9c3f-660f490cccf9 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:12.339450 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1366/2706] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:13:12 2022] PUT /identity/v3/projects/f47aad6ac4e04dc2a7a6d8e070a2e1b5/users/1d4c14d8e8594b8baea38d6f4b70a114/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:12.350731 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444b8c4-2e4d-4fe4-9fcc-ec2708cc0eb7 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:12.351012 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444b8c4-2e4d-4fe4-9fcc-ec2708cc0eb7 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:12.351285 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444b8c4-2e4d-4fe4-9fcc-ec2708cc0eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:12.379802 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-8444b8c4-2e4d-4fe4-9fcc-ec2708cc0eb7 None None] MFA Rules not processed for user `1d4c14d8e8594b8baea38d6f4b70a114`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:12.380884 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-8444b8c4-2e4d-4fe4-9fcc-ec2708cc0eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:12.459601 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1341/2707] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:13:12.470789 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d801f34-3c22-44cd-9c3f-660f490cccf9 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:12.473074 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-0d801f34-3c22-44cd-9c3f-660f490cccf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:12.532680 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d801f34-3c22-44cd-9c3f-660f490cccf9 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:12.536737 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ee91c-554b-4da9-962d-640ab16d8e49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:12.537406 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ee91c-554b-4da9-962d-640ab16d8e49 service cinder] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:12.537682 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ee91c-554b-4da9-962d-640ab16d8e49 service cinder] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:12.537956 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ee91c-554b-4da9-962d-640ab16d8e49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:12.547424 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ee91c-554b-4da9-962d-640ab16d8e49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:12.548930 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ee91c-554b-4da9-962d-640ab16d8e49 service cinder] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:12.559411 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1367/2708] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:13:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:13:12.946688 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444b8c4-2e4d-4fe4-9fcc-ec2708cc0eb7 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:13.011401 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444b8c4-2e4d-4fe4-9fcc-ec2708cc0eb7 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:13.016749 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fde5c-5294-4616-b1fb-eebdc80e28b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:13.017675 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fde5c-5294-4616-b1fb-eebdc80e28b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:13.017945 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fde5c-5294-4616-b1fb-eebdc80e28b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:13.018205 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fde5c-5294-4616-b1fb-eebdc80e28b5 admin admin] PATH_INFO: `/v3/users/c44995391d6f4d10940dd34760b23ec5` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:13.019525 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63fde5c-5294-4616-b1fb-eebdc80e28b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c44995391d6f4d10940dd34760b23ec5)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:13.021605 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63fde5c-5294-4616-b1fb-eebdc80e28b5 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:13.078350 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-a63fde5c-5294-4616-b1fb-eebdc80e28b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c44995391d6f4d10940dd34760b23ec5'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:13.078932 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-a63fde5c-5294-4616-b1fb-eebdc80e28b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c44995391d6f4d10940dd34760b23ec5'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:13.090428 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-a63fde5c-5294-4616-b1fb-eebdc80e28b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c44995391d6f4d10940dd34760b23ec5'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:13.091025 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-a63fde5c-5294-4616-b1fb-eebdc80e28b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c44995391d6f4d10940dd34760b23ec5'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:13.098488 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-a63fde5c-5294-4616-b1fb-eebdc80e28b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c44995391d6f4d10940dd34760b23ec5'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:13.112132 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1342/2709] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:13:12 2022] DELETE /identity/v3/users/c44995391d6f4d10940dd34760b23ec5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:13.117046 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e8c81-2936-43e6-b1b6-e8d23956c7c2 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:13.117545 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e8c81-2936-43e6-b1b6-e8d23956c7c2 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:13.117667 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e8c81-2936-43e6-b1b6-e8d23956c7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:13.135635 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-297e8c81-2936-43e6-b1b6-e8d23956c7c2 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:13.136892 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-297e8c81-2936-43e6-b1b6-e8d23956c7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:13.196359 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1368/2710] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:13:13.208234 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fde5c-5294-4616-b1fb-eebdc80e28b5 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:13.209993 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-a63fde5c-5294-4616-b1fb-eebdc80e28b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:13.269794 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fde5c-5294-4616-b1fb-eebdc80e28b5 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:13.273878 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af74e89-8fd4-430e-ba2a-c7f2dac588d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:13.274518 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af74e89-8fd4-430e-ba2a-c7f2dac588d7 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:13.274788 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af74e89-8fd4-430e-ba2a-c7f2dac588d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:13.275054 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af74e89-8fd4-430e-ba2a-c7f2dac588d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:13.284287 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af74e89-8fd4-430e-ba2a-c7f2dac588d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:13.285919 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af74e89-8fd4-430e-ba2a-c7f2dac588d7 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:13.295496 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1343/2711] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:13:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:13:13.562884 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e8c81-2936-43e6-b1b6-e8d23956c7c2 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:13.564301 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-297e8c81-2936-43e6-b1b6-e8d23956c7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:13.576817 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e8c81-2936-43e6-b1b6-e8d23956c7c2 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:13.581495 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea2f78-5f2c-4767-b427-774461b6c205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:13.582607 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea2f78-5f2c-4767-b427-774461b6c205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:13.582882 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea2f78-5f2c-4767-b427-774461b6c205 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:13.583173 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea2f78-5f2c-4767-b427-774461b6c205 admin admin] PATH_INFO: `/v3/projects/d98f6ec5279c49c5b9859bf853f6a386` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:13.584375 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea2f78-5f2c-4767-b427-774461b6c205 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d98f6ec5279c49c5b9859bf853f6a386)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:13.586311 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea2f78-5f2c-4767-b427-774461b6c205 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:13.632264 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-3bea2f78-5f2c-4767-b427-774461b6c205 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd98f6ec5279c49c5b9859bf853f6a386', 'request_id': 'req-3bea2f78-5f2c-4767-b427-774461b6c205'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:13.640222 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-3bea2f78-5f2c-4767-b427-774461b6c205 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd98f6ec5279c49c5b9859bf853f6a386', 'request_id': 'req-3bea2f78-5f2c-4767-b427-774461b6c205'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:13.646322 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-3bea2f78-5f2c-4767-b427-774461b6c205 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd98f6ec5279c49c5b9859bf853f6a386', 'request_id': 'req-3bea2f78-5f2c-4767-b427-774461b6c205'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:13.656219 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-3bea2f78-5f2c-4767-b427-774461b6c205 admin admin] The token cache is being invalidate because project d98f6ec5279c49c5b9859bf853f6a386 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:13:13.656491 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-3bea2f78-5f2c-4767-b427-774461b6c205 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:13.657077 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-3bea2f78-5f2c-4767-b427-774461b6c205 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:13.658605 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1369/2712] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:13:13 2022] DELETE /identity/v3/projects/d98f6ec5279c49c5b9859bf853f6a386 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:13.663008 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af74e89-8fd4-430e-ba2a-c7f2dac588d7 service neutron] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:13.672961 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af74e89-8fd4-430e-ba2a-c7f2dac588d7 service neutron] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:13.729564 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f512d0-c1a6-4ad3-a4b2-b3f452674a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:13.730466 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f512d0-c1a6-4ad3-a4b2-b3f452674a32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:13.730738 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f512d0-c1a6-4ad3-a4b2-b3f452674a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:13.731035 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f512d0-c1a6-4ad3-a4b2-b3f452674a32 admin admin] PATH_INFO: `/v3/users/1d4c14d8e8594b8baea38d6f4b70a114` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:13.732301 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f512d0-c1a6-4ad3-a4b2-b3f452674a32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d4c14d8e8594b8baea38d6f4b70a114)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:13.734252 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f512d0-c1a6-4ad3-a4b2-b3f452674a32 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:13.787080 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-94f512d0-c1a6-4ad3-a4b2-b3f452674a32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d4c14d8e8594b8baea38d6f4b70a114'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:13.787768 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-94f512d0-c1a6-4ad3-a4b2-b3f452674a32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d4c14d8e8594b8baea38d6f4b70a114'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:13.800562 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-94f512d0-c1a6-4ad3-a4b2-b3f452674a32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d4c14d8e8594b8baea38d6f4b70a114'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:13.801309 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-94f512d0-c1a6-4ad3-a4b2-b3f452674a32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d4c14d8e8594b8baea38d6f4b70a114'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:13.808145 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-94f512d0-c1a6-4ad3-a4b2-b3f452674a32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d4c14d8e8594b8baea38d6f4b70a114'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:13.822511 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1344/2713] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:13:13 2022] DELETE /identity/v3/users/1d4c14d8e8594b8baea38d6f4b70a114 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:14.030453 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea2f78-5f2c-4767-b427-774461b6c205 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:14.031918 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-3bea2f78-5f2c-4767-b427-774461b6c205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:14.090317 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea2f78-5f2c-4767-b427-774461b6c205 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:14.101839 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f512d0-c1a6-4ad3-a4b2-b3f452674a32 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:14.103297 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-94f512d0-c1a6-4ad3-a4b2-b3f452674a32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:14.140642 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2285215-0f87-4b4a-9533-1efd10e01a21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:14.141294 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2285215-0f87-4b4a-9533-1efd10e01a21 service cinder] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:14.141578 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2285215-0f87-4b4a-9533-1efd10e01a21 service cinder] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:14.141835 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2285215-0f87-4b4a-9533-1efd10e01a21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:14.143564 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-b2285215-0f87-4b4a-9533-1efd10e01a21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:14.180806 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f512d0-c1a6-4ad3-a4b2-b3f452674a32 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:14.185919 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150d899-f293-488e-993c-9172e2d07ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:14.186943 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150d899-f293-488e-993c-9172e2d07ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:14.187190 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150d899-f293-488e-993c-9172e2d07ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:14.187456 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150d899-f293-488e-993c-9172e2d07ec5 admin admin] PATH_INFO: `/v3/projects/f47aad6ac4e04dc2a7a6d8e070a2e1b5` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:14.188665 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150d899-f293-488e-993c-9172e2d07ec5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f47aad6ac4e04dc2a7a6d8e070a2e1b5)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:14.190572 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150d899-f293-488e-993c-9172e2d07ec5 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:14.202906 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2285215-0f87-4b4a-9533-1efd10e01a21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:14.204403 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2285215-0f87-4b4a-9533-1efd10e01a21 service cinder] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:14.213636 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1370/2714] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:13:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:13:14.237565 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3150d899-f293-488e-993c-9172e2d07ec5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f47aad6ac4e04dc2a7a6d8e070a2e1b5', 'request_id': 'req-3150d899-f293-488e-993c-9172e2d07ec5'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:14.245635 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3150d899-f293-488e-993c-9172e2d07ec5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f47aad6ac4e04dc2a7a6d8e070a2e1b5', 'request_id': 'req-3150d899-f293-488e-993c-9172e2d07ec5'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:14.252533 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3150d899-f293-488e-993c-9172e2d07ec5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f47aad6ac4e04dc2a7a6d8e070a2e1b5', 'request_id': 'req-3150d899-f293-488e-993c-9172e2d07ec5'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:14.264250 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3150d899-f293-488e-993c-9172e2d07ec5 admin admin] The token cache is being invalidate because project f47aad6ac4e04dc2a7a6d8e070a2e1b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:13:14.264531 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3150d899-f293-488e-993c-9172e2d07ec5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:14.265206 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3150d899-f293-488e-993c-9172e2d07ec5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:14.267173 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1345/2715] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:13:14 2022] DELETE /identity/v3/projects/f47aad6ac4e04dc2a7a6d8e070a2e1b5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:13:14.272054 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb94646-0df2-4861-9659-4349ded80148 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:14.272404 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb94646-0df2-4861-9659-4349ded80148 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:14.272734 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb94646-0df2-4861-9659-4349ded80148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:14.292663 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-8fb94646-0df2-4861-9659-4349ded80148 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:14.293856 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-8fb94646-0df2-4861-9659-4349ded80148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:14.366031 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1371/2716] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:13:14.367014 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7b862-e535-4897-ab5e-24e7027c682b None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:14.367296 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7b862-e535-4897-ab5e-24e7027c682b None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:14.367564 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7b862-e535-4897-ab5e-24e7027c682b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:14.388576 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-b5d7b862-e535-4897-ab5e-24e7027c682b None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:14.390151 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-b5d7b862-e535-4897-ab5e-24e7027c682b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:14.398628 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1346/2717] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:13:14.402953 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb94646-0df2-4861-9659-4349ded80148 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:14.413153 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb94646-0df2-4861-9659-4349ded80148 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:14.417586 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7152b87-2c6e-415a-b435-db02decb257d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:14.418237 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7152b87-2c6e-415a-b435-db02decb257d admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:14.418510 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7152b87-2c6e-415a-b435-db02decb257d admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:14.418772 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7152b87-2c6e-415a-b435-db02decb257d admin admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:14.419544 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7152b87-2c6e-415a-b435-db02decb257d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:13:14.419886 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7152b87-2c6e-415a-b435-db02decb257d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:14.421523 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7152b87-2c6e-415a-b435-db02decb257d admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:14.434931 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1372/2718] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:13:14.439335 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7b862-e535-4897-ab5e-24e7027c682b None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:14.448729 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7b862-e535-4897-ab5e-24e7027c682b None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:14.453742 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216cd377-95e3-4b95-8799-26d3def3cad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:14.454390 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cd377-95e3-4b95-8799-26d3def3cad5 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:14.454662 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cd377-95e3-4b95-8799-26d3def3cad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:14.454927 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cd377-95e3-4b95-8799-26d3def3cad5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:14.455604 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cd377-95e3-4b95-8799-26d3def3cad5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:14.458104 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cd377-95e3-4b95-8799-26d3def3cad5 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:14.488790 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1347/2719] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:13:14 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:13:14.489863 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7152b87-2c6e-415a-b435-db02decb257d admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:14.499587 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7152b87-2c6e-415a-b435-db02decb257d admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:14.558618 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75538e80-276a-4857-9ae8-53f79b229c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:14.559302 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75538e80-276a-4857-9ae8-53f79b229c3c admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:14.559570 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75538e80-276a-4857-9ae8-53f79b229c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:14.559873 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75538e80-276a-4857-9ae8-53f79b229c3c admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:14.560537 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75538e80-276a-4857-9ae8-53f79b229c3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:14.562482 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75538e80-276a-4857-9ae8-53f79b229c3c admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:14.586217 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1373/2720] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:13:14 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:13:14.592581 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216cd377-95e3-4b95-8799-26d3def3cad5 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:14.604585 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216cd377-95e3-4b95-8799-26d3def3cad5 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:14.609657 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f02cc5-363b-4f20-8876-9db2c7f16922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:14.610340 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f02cc5-363b-4f20-8876-9db2c7f16922 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:14.610612 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f02cc5-363b-4f20-8876-9db2c7f16922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:14.610876 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f02cc5-363b-4f20-8876-9db2c7f16922 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:14.611628 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f02cc5-363b-4f20-8876-9db2c7f16922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:14.613251 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f02cc5-363b-4f20-8876-9db2c7f16922 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:14.623539 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1348/2721] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:13:14.627679 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75538e80-276a-4857-9ae8-53f79b229c3c admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:14.639064 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75538e80-276a-4857-9ae8-53f79b229c3c admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:14.645236 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b4b4a-168a-4c4f-8638-0906d686164b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:14.646012 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b4b4a-168a-4c4f-8638-0906d686164b admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:14.646313 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b4b4a-168a-4c4f-8638-0906d686164b admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:14.646585 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b4b4a-168a-4c4f-8638-0906d686164b admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:14.647310 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b4b4a-168a-4c4f-8638-0906d686164b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:14.648953 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b4b4a-168a-4c4f-8638-0906d686164b admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:14.659587 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1374/2722] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:13:14.664190 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f02cc5-363b-4f20-8876-9db2c7f16922 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:14.674375 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f02cc5-363b-4f20-8876-9db2c7f16922 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:14.679656 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf53ac-bdb2-4ff3-a242-c45bfd9acd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:14.680610 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf53ac-bdb2-4ff3-a242-c45bfd9acd02 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:14.680860 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf53ac-bdb2-4ff3-a242-c45bfd9acd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:14.681128 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf53ac-bdb2-4ff3-a242-c45bfd9acd02 admin admin] PATH_INFO: `/v3/projects/90220ffa938f4944bade81e5d3be75d6/users/15f16d6c13a84968b759ccc3817f0f0b/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:14.695745 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf53ac-bdb2-4ff3-a242-c45bfd9acd02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90220ffa938f4944bade81e5d3be75d6, user_id=15f16d6c13a84968b759ccc3817f0f0b, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:14.698395 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf53ac-bdb2-4ff3-a242-c45bfd9acd02 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:14.713242 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1349/2723] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:13:14 2022] PUT /identity/v3/projects/90220ffa938f4944bade81e5d3be75d6/users/15f16d6c13a84968b759ccc3817f0f0b/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:13:14.724086 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630dc58-c502-46ef-aa4e-2917c0a94b10 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:14.724370 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630dc58-c502-46ef-aa4e-2917c0a94b10 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:14.724644 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630dc58-c502-46ef-aa4e-2917c0a94b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:14.751960 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-b630dc58-c502-46ef-aa4e-2917c0a94b10 None None] MFA Rules not processed for user `15f16d6c13a84968b759ccc3817f0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:14.753187 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-b630dc58-c502-46ef-aa4e-2917c0a94b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:14.816455 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1375/2724] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:13:14.823641 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf53ac-bdb2-4ff3-a242-c45bfd9acd02 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:14.912709 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf53ac-bdb2-4ff3-a242-c45bfd9acd02 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:14.918629 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871d33e-6211-4190-a451-332a698dceb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:14.919285 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871d33e-6211-4190-a451-332a698dceb8 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:14.919593 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871d33e-6211-4190-a451-332a698dceb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:14.919889 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871d33e-6211-4190-a451-332a698dceb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:14.920562 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871d33e-6211-4190-a451-332a698dceb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:14.922473 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871d33e-6211-4190-a451-332a698dceb8 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:14.955987 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1350/2725] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:13:14 2022] POST /identity/v3/projects => generated 375 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:13:14.960434 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630dc58-c502-46ef-aa4e-2917c0a94b10 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:14.971242 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630dc58-c502-46ef-aa4e-2917c0a94b10 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:15.029782 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f5001-37ce-453d-98e8-7c4f3d031de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:15.030447 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f5001-37ce-453d-98e8-7c4f3d031de0 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:15.030727 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f5001-37ce-453d-98e8-7c4f3d031de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:15.030991 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f5001-37ce-453d-98e8-7c4f3d031de0 admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:15.031679 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f5001-37ce-453d-98e8-7c4f3d031de0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:15.033644 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f5001-37ce-453d-98e8-7c4f3d031de0 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:15.055528 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1376/2726] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:13:14 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 03:13:15.059695 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871d33e-6211-4190-a451-332a698dceb8 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:15.070105 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871d33e-6211-4190-a451-332a698dceb8 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:15.075263 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fab32-6150-464b-b852-0b701e85938b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:15.075960 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fab32-6150-464b-b852-0b701e85938b admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:15.076236 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fab32-6150-464b-b852-0b701e85938b admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:15.076514 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fab32-6150-464b-b852-0b701e85938b admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:15.077244 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1fab32-6150-464b-b852-0b701e85938b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:15.078838 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1fab32-6150-464b-b852-0b701e85938b admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:15.089416 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1351/2727] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:13:15.093570 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f5001-37ce-453d-98e8-7c4f3d031de0 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:15.103638 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f5001-37ce-453d-98e8-7c4f3d031de0 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:15.108674 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bda08-45fd-408e-9163-e8ce1dbb76de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:15.109541 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bda08-45fd-408e-9163-e8ce1dbb76de admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:15.109807 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bda08-45fd-408e-9163-e8ce1dbb76de admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:15.110050 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bda08-45fd-408e-9163-e8ce1dbb76de admin admin] PATH_INFO: `/v3/projects/93b0eee1f2e04e7a846ba100ba043b6e/users/da0d941f577a4a4399ce0785abfed4b1/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:15.125044 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bda08-45fd-408e-9163-e8ce1dbb76de admin admin] RBAC: Authorizing `identity:create_grant(project_id=93b0eee1f2e04e7a846ba100ba043b6e, user_id=da0d941f577a4a4399ce0785abfed4b1, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:15.127679 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bda08-45fd-408e-9163-e8ce1dbb76de admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:15.142788 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1377/2728] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:13:15 2022] PUT /identity/v3/projects/93b0eee1f2e04e7a846ba100ba043b6e/users/da0d941f577a4a4399ce0785abfed4b1/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:15.147143 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fab32-6150-464b-b852-0b701e85938b admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:15.157557 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fab32-6150-464b-b852-0b701e85938b admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:15.219928 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfb5a2-4b4c-4b42-af0c-61e1eb4eff97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:15.220660 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfb5a2-4b4c-4b42-af0c-61e1eb4eff97 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:15.220908 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfb5a2-4b4c-4b42-af0c-61e1eb4eff97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:15.221158 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfb5a2-4b4c-4b42-af0c-61e1eb4eff97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:15.221885 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfb5a2-4b4c-4b42-af0c-61e1eb4eff97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:15.223517 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfb5a2-4b4c-4b42-af0c-61e1eb4eff97 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:15.237304 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1352/2729] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:13:15.238661 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bda08-45fd-408e-9163-e8ce1dbb76de admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:15.249557 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bda08-45fd-408e-9163-e8ce1dbb76de admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:15.255509 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb6be4-c572-4cd2-8531-dff450aa1cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:15.256406 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb6be4-c572-4cd2-8531-dff450aa1cd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:15.256694 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb6be4-c572-4cd2-8531-dff450aa1cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:15.257008 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb6be4-c572-4cd2-8531-dff450aa1cd7 admin admin] PATH_INFO: `/v3/projects/93b0eee1f2e04e7a846ba100ba043b6e/users/da0d941f577a4a4399ce0785abfed4b1/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:15.259512 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb6be4-c572-4cd2-8531-dff450aa1cd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93b0eee1f2e04e7a846ba100ba043b6e, user_id=da0d941f577a4a4399ce0785abfed4b1, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:15.262785 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb6be4-c572-4cd2-8531-dff450aa1cd7 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:15.274385 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1378/2730] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:13:15 2022] PUT /identity/v3/projects/93b0eee1f2e04e7a846ba100ba043b6e/users/da0d941f577a4a4399ce0785abfed4b1/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:15.344116 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f954e-e553-46c0-9d1e-24898c382550 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:15.344366 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f954e-e553-46c0-9d1e-24898c382550 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:15.344659 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f954e-e553-46c0-9d1e-24898c382550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:15.373606 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-ee8f954e-e553-46c0-9d1e-24898c382550 None None] MFA Rules not processed for user `da0d941f577a4a4399ce0785abfed4b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:15.374862 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-ee8f954e-e553-46c0-9d1e-24898c382550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:15.456447 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1353/2731] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:15 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:13:15.470115 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb6be4-c572-4cd2-8531-dff450aa1cd7 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:15.471941 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-80cb6be4-c572-4cd2-8531-dff450aa1cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:15.527996 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb6be4-c572-4cd2-8531-dff450aa1cd7 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:15.532458 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03570cf1-aa31-4167-9232-82965e31096e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:15.533162 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03570cf1-aa31-4167-9232-82965e31096e service cinder] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:15.533435 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03570cf1-aa31-4167-9232-82965e31096e service cinder] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:15.533699 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03570cf1-aa31-4167-9232-82965e31096e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:15.589677 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03570cf1-aa31-4167-9232-82965e31096e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:15.591093 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03570cf1-aa31-4167-9232-82965e31096e service cinder] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:15.600218 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1379/2732] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:13:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:13:17.975410 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8306e38-72c4-46b6-b196-b344403dad4f None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:17.975985 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8306e38-72c4-46b6-b196-b344403dad4f None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:17.975985 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8306e38-72c4-46b6-b196-b344403dad4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:17.999639 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-f8306e38-72c4-46b6-b196-b344403dad4f None None] MFA Rules not processed for user `83115653901749f6ade6638593fb54e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:18.000976 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-f8306e38-72c4-46b6-b196-b344403dad4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:18.056154 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1354/2733] 10.222.0.32 () {58 vars in 1009 bytes} [Tue Apr 12 03:13:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:13:18.110609 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03570cf1-aa31-4167-9232-82965e31096e service cinder] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:18.112562 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-03570cf1-aa31-4167-9232-82965e31096e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:18.190935 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03570cf1-aa31-4167-9232-82965e31096e service cinder] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:18.196975 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5f5ef-a943-4325-856a-8d2420f806b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e8d78f92f12405fb746ddeb2579bd2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:18.197622 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5f5ef-a943-4325-856a-8d2420f806b1 service swift] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:18.197923 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5f5ef-a943-4325-856a-8d2420f806b1 service swift] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:18.198188 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5f5ef-a943-4325-856a-8d2420f806b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:18.207125 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5f5ef-a943-4325-856a-8d2420f806b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:18.208904 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5f5ef-a943-4325-856a-8d2420f806b1 service swift] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:18.218571 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1380/2734] 10.222.0.32 () {60 vars in 1384 bytes} [Tue Apr 12 03:13:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 03:13:27.522597 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f47b2-74cd-4300-a2f4-4a15f7bf584e None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:27.522597 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f47b2-74cd-4300-a2f4-4a15f7bf584e None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:27.522597 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f47b2-74cd-4300-a2f4-4a15f7bf584e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:27.542845 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-438f47b2-74cd-4300-a2f4-4a15f7bf584e None None] MFA Rules not processed for user `157ff7b3ca7b4af69a47cc36b0d1917a`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:27.544072 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-438f47b2-74cd-4300-a2f4-4a15f7bf584e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:27.603970 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1355/2735] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:13:29.807792 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5f5ef-a943-4325-856a-8d2420f806b1 service swift] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:29.943546 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5f5ef-a943-4325-856a-8d2420f806b1 service swift] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:29.950251 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103d0e5-d3cb-4173-b9c4-4cf91f038b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:29.951394 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103d0e5-d3cb-4173-b9c4-4cf91f038b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:29.951803 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103d0e5-d3cb-4173-b9c4-4cf91f038b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:29.952184 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103d0e5-d3cb-4173-b9c4-4cf91f038b91 admin admin] PATH_INFO: `/v3/users/15f16d6c13a84968b759ccc3817f0f0b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:29.953499 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103d0e5-d3cb-4173-b9c4-4cf91f038b91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15f16d6c13a84968b759ccc3817f0f0b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:29.955939 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103d0e5-d3cb-4173-b9c4-4cf91f038b91 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:30.047395 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-7103d0e5-d3cb-4173-b9c4-4cf91f038b91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15f16d6c13a84968b759ccc3817f0f0b'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:30.056567 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-7103d0e5-d3cb-4173-b9c4-4cf91f038b91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15f16d6c13a84968b759ccc3817f0f0b'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:30.057290 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-7103d0e5-d3cb-4173-b9c4-4cf91f038b91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15f16d6c13a84968b759ccc3817f0f0b'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:30.058046 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-7103d0e5-d3cb-4173-b9c4-4cf91f038b91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15f16d6c13a84968b759ccc3817f0f0b'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:30.076682 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-7103d0e5-d3cb-4173-b9c4-4cf91f038b91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15f16d6c13a84968b759ccc3817f0f0b'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:30.095981 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1381/2736] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:13:29 2022] DELETE /identity/v3/users/15f16d6c13a84968b759ccc3817f0f0b => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:30.100676 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b994e9-5115-4247-87b4-93706dcaa073 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:30.101488 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b994e9-5115-4247-87b4-93706dcaa073 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:30.101860 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b994e9-5115-4247-87b4-93706dcaa073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:30.125833 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-a7b994e9-5115-4247-87b4-93706dcaa073 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:30.127531 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-a7b994e9-5115-4247-87b4-93706dcaa073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:30.256094 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1356/2737] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:13:30.267639 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103d0e5-d3cb-4173-b9c4-4cf91f038b91 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:30.269315 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-7103d0e5-d3cb-4173-b9c4-4cf91f038b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:30.333970 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103d0e5-d3cb-4173-b9c4-4cf91f038b91 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:30.337579 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec58ec-887f-474b-bd4e-ef5bb76f0d20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:30.338230 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec58ec-887f-474b-bd4e-ef5bb76f0d20 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:30.338508 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec58ec-887f-474b-bd4e-ef5bb76f0d20 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:30.338791 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec58ec-887f-474b-bd4e-ef5bb76f0d20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:30.348851 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec58ec-887f-474b-bd4e-ef5bb76f0d20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:30.350792 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec58ec-887f-474b-bd4e-ef5bb76f0d20 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:30.364051 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1382/2738] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:13:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:13:30.736643 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b994e9-5115-4247-87b4-93706dcaa073 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:30.738537 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-a7b994e9-5115-4247-87b4-93706dcaa073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:30.766317 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b994e9-5115-4247-87b4-93706dcaa073 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:30.784115 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a9e5f-bf6c-4322-a884-33bf009c788e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:30.785462 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a9e5f-bf6c-4322-a884-33bf009c788e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:30.785954 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a9e5f-bf6c-4322-a884-33bf009c788e admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:30.786656 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a9e5f-bf6c-4322-a884-33bf009c788e admin admin] PATH_INFO: `/v3/projects/90220ffa938f4944bade81e5d3be75d6` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:30.789391 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a9e5f-bf6c-4322-a884-33bf009c788e admin admin] RBAC: Authorizing `identity:delete_project(project_id=90220ffa938f4944bade81e5d3be75d6)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:30.793475 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a9e5f-bf6c-4322-a884-33bf009c788e admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:30.858019 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-968a9e5f-bf6c-4322-a884-33bf009c788e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90220ffa938f4944bade81e5d3be75d6', 'request_id': 'req-968a9e5f-bf6c-4322-a884-33bf009c788e'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:30.868068 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-968a9e5f-bf6c-4322-a884-33bf009c788e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90220ffa938f4944bade81e5d3be75d6', 'request_id': 'req-968a9e5f-bf6c-4322-a884-33bf009c788e'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:30.875829 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-968a9e5f-bf6c-4322-a884-33bf009c788e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90220ffa938f4944bade81e5d3be75d6', 'request_id': 'req-968a9e5f-bf6c-4322-a884-33bf009c788e'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:30.896909 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-968a9e5f-bf6c-4322-a884-33bf009c788e admin admin] The token cache is being invalidate because project 90220ffa938f4944bade81e5d3be75d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:13:30.897370 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-968a9e5f-bf6c-4322-a884-33bf009c788e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:30.898101 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-968a9e5f-bf6c-4322-a884-33bf009c788e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:30.900432 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1357/2739] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:13:30 2022] DELETE /identity/v3/projects/90220ffa938f4944bade81e5d3be75d6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:30.904706 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec58ec-887f-474b-bd4e-ef5bb76f0d20 service neutron] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:30.924788 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec58ec-887f-474b-bd4e-ef5bb76f0d20 service neutron] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:31.025301 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31cea9-69d4-4ef3-a7d8-8ed356ddfb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:31.026984 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31cea9-69d4-4ef3-a7d8-8ed356ddfb37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:31.027591 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31cea9-69d4-4ef3-a7d8-8ed356ddfb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:31.028592 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31cea9-69d4-4ef3-a7d8-8ed356ddfb37 admin admin] PATH_INFO: `/v3/users/da0d941f577a4a4399ce0785abfed4b1` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:31.030329 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba31cea9-69d4-4ef3-a7d8-8ed356ddfb37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da0d941f577a4a4399ce0785abfed4b1)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:31.032966 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba31cea9-69d4-4ef3-a7d8-8ed356ddfb37 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:31.111686 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-ba31cea9-69d4-4ef3-a7d8-8ed356ddfb37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da0d941f577a4a4399ce0785abfed4b1'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:31.124404 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-ba31cea9-69d4-4ef3-a7d8-8ed356ddfb37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da0d941f577a4a4399ce0785abfed4b1'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:31.125498 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-ba31cea9-69d4-4ef3-a7d8-8ed356ddfb37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da0d941f577a4a4399ce0785abfed4b1'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:31.126189 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-ba31cea9-69d4-4ef3-a7d8-8ed356ddfb37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da0d941f577a4a4399ce0785abfed4b1'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:31.141021 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-ba31cea9-69d4-4ef3-a7d8-8ed356ddfb37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da0d941f577a4a4399ce0785abfed4b1'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:31.167906 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1383/2740] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:13:30 2022] DELETE /identity/v3/users/da0d941f577a4a4399ce0785abfed4b1 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:31.557975 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a9e5f-bf6c-4322-a884-33bf009c788e admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:31.560753 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-968a9e5f-bf6c-4322-a884-33bf009c788e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:31.607599 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a9e5f-bf6c-4322-a884-33bf009c788e admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:31.708858 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572d4b5-5156-4b22-8d14-c2dec5b9b911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:31.710115 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572d4b5-5156-4b22-8d14-c2dec5b9b911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:31.710387 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572d4b5-5156-4b22-8d14-c2dec5b9b911 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:31.710786 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572d4b5-5156-4b22-8d14-c2dec5b9b911 admin admin] PATH_INFO: `/v3/projects/93b0eee1f2e04e7a846ba100ba043b6e` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:31.713945 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572d4b5-5156-4b22-8d14-c2dec5b9b911 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93b0eee1f2e04e7a846ba100ba043b6e)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:31.716132 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572d4b5-5156-4b22-8d14-c2dec5b9b911 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:31.903259 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-6572d4b5-5156-4b22-8d14-c2dec5b9b911 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93b0eee1f2e04e7a846ba100ba043b6e', 'request_id': 'req-6572d4b5-5156-4b22-8d14-c2dec5b9b911'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:31.916460 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-6572d4b5-5156-4b22-8d14-c2dec5b9b911 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93b0eee1f2e04e7a846ba100ba043b6e', 'request_id': 'req-6572d4b5-5156-4b22-8d14-c2dec5b9b911'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:31.939769 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-6572d4b5-5156-4b22-8d14-c2dec5b9b911 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93b0eee1f2e04e7a846ba100ba043b6e', 'request_id': 'req-6572d4b5-5156-4b22-8d14-c2dec5b9b911'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:31.967070 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-6572d4b5-5156-4b22-8d14-c2dec5b9b911 admin admin] The token cache is being invalidate because project 93b0eee1f2e04e7a846ba100ba043b6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:13:31.969229 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-6572d4b5-5156-4b22-8d14-c2dec5b9b911 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:31.972160 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-6572d4b5-5156-4b22-8d14-c2dec5b9b911 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:31.974462 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1358/2741] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:13:31 2022] DELETE /identity/v3/projects/93b0eee1f2e04e7a846ba100ba043b6e => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:31.979851 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f134cc-5d0b-42a2-95ce-0841864d9ada None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:31.980559 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f134cc-5d0b-42a2-95ce-0841864d9ada None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:31.980559 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f134cc-5d0b-42a2-95ce-0841864d9ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:32.024613 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-a4f134cc-5d0b-42a2-95ce-0841864d9ada None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:32.026042 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-a4f134cc-5d0b-42a2-95ce-0841864d9ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:32.133569 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1384/2742] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:13:32.141935 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1fede-1d67-4b00-9bdd-0cd557bc10c4 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:32.142491 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1fede-1d67-4b00-9bdd-0cd557bc10c4 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:32.142935 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1fede-1d67-4b00-9bdd-0cd557bc10c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:32.181968 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-0ac1fede-1d67-4b00-9bdd-0cd557bc10c4 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:32.189433 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-0ac1fede-1d67-4b00-9bdd-0cd557bc10c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:32.211173 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1359/2743] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:13:32.215665 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f134cc-5d0b-42a2-95ce-0841864d9ada None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:32.226945 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f134cc-5d0b-42a2-95ce-0841864d9ada None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:32.234628 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcdd404-5e0a-45f1-b36b-c59000c6ef1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:32.235339 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcdd404-5e0a-45f1-b36b-c59000c6ef1f admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:32.235594 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcdd404-5e0a-45f1-b36b-c59000c6ef1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:32.236099 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcdd404-5e0a-45f1-b36b-c59000c6ef1f admin admin] PATH_INFO: `/v3/domains` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:32.236858 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcdd404-5e0a-45f1-b36b-c59000c6ef1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79724) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:13:32.237181 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcdd404-5e0a-45f1-b36b-c59000c6ef1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:32.239019 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcdd404-5e0a-45f1-b36b-c59000c6ef1f admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:32.258277 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1fede-1d67-4b00-9bdd-0cd557bc10c4 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:32.264474 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1385/2744] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:13:32.268704 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1fede-1d67-4b00-9bdd-0cd557bc10c4 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:32.276122 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35779666-46f9-4d8a-a648-53f2d10a1790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:32.277205 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35779666-46f9-4d8a-a648-53f2d10a1790 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:32.278008 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35779666-46f9-4d8a-a648-53f2d10a1790 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:32.278434 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35779666-46f9-4d8a-a648-53f2d10a1790 admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:32.279339 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35779666-46f9-4d8a-a648-53f2d10a1790 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:32.281876 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35779666-46f9-4d8a-a648-53f2d10a1790 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:32.313480 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1360/2745] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:13:32 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:13:32.318649 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcdd404-5e0a-45f1-b36b-c59000c6ef1f admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:32.330396 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcdd404-5e0a-45f1-b36b-c59000c6ef1f admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:32.406017 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31091520-b9f9-48be-89a3-8f137c792dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:32.406762 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31091520-b9f9-48be-89a3-8f137c792dfb admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:32.407037 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31091520-b9f9-48be-89a3-8f137c792dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:32.407537 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31091520-b9f9-48be-89a3-8f137c792dfb admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:32.408416 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31091520-b9f9-48be-89a3-8f137c792dfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:32.410800 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31091520-b9f9-48be-89a3-8f137c792dfb admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:32.444388 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1386/2746] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:13:32 2022] POST /identity/v3/users => generated 288 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:13:32.446100 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35779666-46f9-4d8a-a648-53f2d10a1790 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:32.460693 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35779666-46f9-4d8a-a648-53f2d10a1790 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:32.467286 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270317bf-b72a-4106-8967-1bde705cd497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:32.468230 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270317bf-b72a-4106-8967-1bde705cd497 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:32.468692 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270317bf-b72a-4106-8967-1bde705cd497 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:32.469116 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270317bf-b72a-4106-8967-1bde705cd497 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:32.470001 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270317bf-b72a-4106-8967-1bde705cd497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:32.472191 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270317bf-b72a-4106-8967-1bde705cd497 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:32.498966 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1361/2747] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:13:32.503305 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31091520-b9f9-48be-89a3-8f137c792dfb admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:32.514215 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31091520-b9f9-48be-89a3-8f137c792dfb admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:32.523921 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1331f5c-e079-48c9-ae47-4a019e8676ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:32.525023 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1331f5c-e079-48c9-ae47-4a019e8676ec admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:32.525388 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1331f5c-e079-48c9-ae47-4a019e8676ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:32.525749 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1331f5c-e079-48c9-ae47-4a019e8676ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:32.527284 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1331f5c-e079-48c9-ae47-4a019e8676ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:32.533776 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1331f5c-e079-48c9-ae47-4a019e8676ec admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:32.545823 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1387/2748] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:13:32.554567 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270317bf-b72a-4106-8967-1bde705cd497 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:32.566972 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270317bf-b72a-4106-8967-1bde705cd497 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:32.580497 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928233d4-cab5-4582-9f98-6fa944bc84df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:32.581457 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928233d4-cab5-4582-9f98-6fa944bc84df admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:32.581738 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928233d4-cab5-4582-9f98-6fa944bc84df admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:32.582200 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928233d4-cab5-4582-9f98-6fa944bc84df admin admin] PATH_INFO: `/v3/projects/16264a5897694d37a86b32ef63c63468/users/06e25b6bcb3d4dd2b1a55f9db998b0d7/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:32.609439 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928233d4-cab5-4582-9f98-6fa944bc84df admin admin] RBAC: Authorizing `identity:create_grant(project_id=16264a5897694d37a86b32ef63c63468, user_id=06e25b6bcb3d4dd2b1a55f9db998b0d7, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:32.612219 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928233d4-cab5-4582-9f98-6fa944bc84df admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:32.639824 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1362/2749] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:13:32 2022] PUT /identity/v3/projects/16264a5897694d37a86b32ef63c63468/users/06e25b6bcb3d4dd2b1a55f9db998b0d7/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:32.647796 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23dc9c7-99a5-41ff-a3ca-37f0d241e6c6 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:32.647796 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23dc9c7-99a5-41ff-a3ca-37f0d241e6c6 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:32.647796 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23dc9c7-99a5-41ff-a3ca-37f0d241e6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:32.712197 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-e23dc9c7-99a5-41ff-a3ca-37f0d241e6c6 None None] MFA Rules not processed for user `06e25b6bcb3d4dd2b1a55f9db998b0d7`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:32.713428 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-e23dc9c7-99a5-41ff-a3ca-37f0d241e6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:32.803546 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1388/2750] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:13:32.808185 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928233d4-cab5-4582-9f98-6fa944bc84df admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:32.902426 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928233d4-cab5-4582-9f98-6fa944bc84df admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:32.928156 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13131bf-70b9-4be8-97b4-21bae02fce3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:32.929328 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13131bf-70b9-4be8-97b4-21bae02fce3e admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:32.929759 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13131bf-70b9-4be8-97b4-21bae02fce3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:32.930198 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13131bf-70b9-4be8-97b4-21bae02fce3e admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:32.931064 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13131bf-70b9-4be8-97b4-21bae02fce3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:32.933199 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13131bf-70b9-4be8-97b4-21bae02fce3e admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:32.986292 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1363/2751] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:13:32 2022] POST /identity/v3/projects => generated 377 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:13:32.990260 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23dc9c7-99a5-41ff-a3ca-37f0d241e6c6 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:33.003840 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23dc9c7-99a5-41ff-a3ca-37f0d241e6c6 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:33.093452 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77bf1e-e750-422d-9200-6d8a3ead3f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:33.094950 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77bf1e-e750-422d-9200-6d8a3ead3f91 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:33.095407 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77bf1e-e750-422d-9200-6d8a3ead3f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:33.095868 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77bf1e-e750-422d-9200-6d8a3ead3f91 admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:33.096907 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c77bf1e-e750-422d-9200-6d8a3ead3f91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:33.099667 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c77bf1e-e750-422d-9200-6d8a3ead3f91 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:33.127173 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1389/2752] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:13:32 2022] POST /identity/v3/users => generated 289 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:13:33.130911 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13131bf-70b9-4be8-97b4-21bae02fce3e admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:33.155413 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13131bf-70b9-4be8-97b4-21bae02fce3e admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:33.172384 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13915853-04ee-465f-a33d-ee381caf800b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:33.173343 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13915853-04ee-465f-a33d-ee381caf800b admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:33.173855 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13915853-04ee-465f-a33d-ee381caf800b admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:33.174214 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13915853-04ee-465f-a33d-ee381caf800b admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:33.175027 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13915853-04ee-465f-a33d-ee381caf800b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:33.177106 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13915853-04ee-465f-a33d-ee381caf800b admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:33.190367 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1364/2753] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:13:33.194254 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77bf1e-e750-422d-9200-6d8a3ead3f91 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:33.204633 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77bf1e-e750-422d-9200-6d8a3ead3f91 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:33.211237 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45f3e1-b83f-490a-a8a0-40810f8b7e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:33.212015 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45f3e1-b83f-490a-a8a0-40810f8b7e2e admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:33.212293 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45f3e1-b83f-490a-a8a0-40810f8b7e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:33.212556 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45f3e1-b83f-490a-a8a0-40810f8b7e2e admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:33.213472 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45f3e1-b83f-490a-a8a0-40810f8b7e2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:33.215288 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45f3e1-b83f-490a-a8a0-40810f8b7e2e admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:33.226808 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1390/2754] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:13:33.231299 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13915853-04ee-465f-a33d-ee381caf800b admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:33.249339 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13915853-04ee-465f-a33d-ee381caf800b admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:33.254696 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1c07e-fd40-4474-88f5-61c5ceff25a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:33.256005 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1c07e-fd40-4474-88f5-61c5ceff25a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:33.256794 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1c07e-fd40-4474-88f5-61c5ceff25a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:33.257320 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1c07e-fd40-4474-88f5-61c5ceff25a2 admin admin] PATH_INFO: `/v3/projects/8f5e72ffd83340dcaf091c54080ee20b/users/b264f81add98484886e578287d8dd401/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:33.276881 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1c07e-fd40-4474-88f5-61c5ceff25a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f5e72ffd83340dcaf091c54080ee20b, user_id=b264f81add98484886e578287d8dd401, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:33.281679 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1c07e-fd40-4474-88f5-61c5ceff25a2 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:33.297270 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1365/2755] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:13:33 2022] PUT /identity/v3/projects/8f5e72ffd83340dcaf091c54080ee20b/users/b264f81add98484886e578287d8dd401/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:13:33.308523 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76c35a-0590-4035-acf2-5ae85b9b4a5e None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:33.309192 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76c35a-0590-4035-acf2-5ae85b9b4a5e None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:33.309844 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76c35a-0590-4035-acf2-5ae85b9b4a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:33.340186 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-9f76c35a-0590-4035-acf2-5ae85b9b4a5e None None] MFA Rules not processed for user `b264f81add98484886e578287d8dd401`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:33.341822 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-9f76c35a-0590-4035-acf2-5ae85b9b4a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:33.408660 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1391/2756] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:13:33.413351 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1c07e-fd40-4474-88f5-61c5ceff25a2 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:33.476887 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1c07e-fd40-4474-88f5-61c5ceff25a2 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:33.482519 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fe9fd-4523-4a7b-8d9c-bfba94f0c18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:33.483182 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fe9fd-4523-4a7b-8d9c-bfba94f0c18e admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:33.483453 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fe9fd-4523-4a7b-8d9c-bfba94f0c18e admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:33.483713 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fe9fd-4523-4a7b-8d9c-bfba94f0c18e admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:33.484429 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72fe9fd-4523-4a7b-8d9c-bfba94f0c18e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:33.486377 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72fe9fd-4523-4a7b-8d9c-bfba94f0c18e admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:33.514011 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1366/2757] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:13:33 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:13:33.518324 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76c35a-0590-4035-acf2-5ae85b9b4a5e None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:33.533094 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76c35a-0590-4035-acf2-5ae85b9b4a5e None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:33.592017 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535d046-c62f-42c4-b557-3bb8941324af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:33.592686 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535d046-c62f-42c4-b557-3bb8941324af admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:33.592948 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535d046-c62f-42c4-b557-3bb8941324af admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:33.593210 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535d046-c62f-42c4-b557-3bb8941324af admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:33.593889 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535d046-c62f-42c4-b557-3bb8941324af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:33.595836 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535d046-c62f-42c4-b557-3bb8941324af admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:33.618107 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1392/2758] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:13:33 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:13:33.622264 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fe9fd-4523-4a7b-8d9c-bfba94f0c18e admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:33.632497 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fe9fd-4523-4a7b-8d9c-bfba94f0c18e admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:33.637395 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b501a87-c406-4f67-a12a-0cea0c46aac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:33.638045 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b501a87-c406-4f67-a12a-0cea0c46aac5 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:33.638316 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b501a87-c406-4f67-a12a-0cea0c46aac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:33.638576 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b501a87-c406-4f67-a12a-0cea0c46aac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:33.639381 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b501a87-c406-4f67-a12a-0cea0c46aac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:33.641054 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b501a87-c406-4f67-a12a-0cea0c46aac5 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:33.651589 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1367/2759] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:13:33.656028 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535d046-c62f-42c4-b557-3bb8941324af admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:33.666593 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535d046-c62f-42c4-b557-3bb8941324af admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:33.672301 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048448f-5d22-4f4c-a4fe-3c445dfbabc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:33.673179 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048448f-5d22-4f4c-a4fe-3c445dfbabc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:33.673454 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048448f-5d22-4f4c-a4fe-3c445dfbabc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:33.673725 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048448f-5d22-4f4c-a4fe-3c445dfbabc5 admin admin] PATH_INFO: `/v3/projects/398a3f34d61b4146bb0346a8dbd14467/users/807a32dc5c9e4e85b837edf604437c5a/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:33.690823 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048448f-5d22-4f4c-a4fe-3c445dfbabc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=398a3f34d61b4146bb0346a8dbd14467, user_id=807a32dc5c9e4e85b837edf604437c5a, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:33.693589 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048448f-5d22-4f4c-a4fe-3c445dfbabc5 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:33.708822 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1393/2760] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:13:33 2022] PUT /identity/v3/projects/398a3f34d61b4146bb0346a8dbd14467/users/807a32dc5c9e4e85b837edf604437c5a/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:33.713676 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b501a87-c406-4f67-a12a-0cea0c46aac5 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:33.729860 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b501a87-c406-4f67-a12a-0cea0c46aac5 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:33.796709 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbced64c-ae21-4efe-b19d-7a9db8cfcc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:33.797705 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbced64c-ae21-4efe-b19d-7a9db8cfcc72 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:33.798134 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbced64c-ae21-4efe-b19d-7a9db8cfcc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:33.798547 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbced64c-ae21-4efe-b19d-7a9db8cfcc72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:33.799701 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbced64c-ae21-4efe-b19d-7a9db8cfcc72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:33.802177 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbced64c-ae21-4efe-b19d-7a9db8cfcc72 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:33.812777 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1368/2761] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:13:33.817902 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048448f-5d22-4f4c-a4fe-3c445dfbabc5 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:33.834826 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048448f-5d22-4f4c-a4fe-3c445dfbabc5 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:33.840680 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f27fb-822e-4fb5-adc5-9f0408229c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:33.841588 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f27fb-822e-4fb5-adc5-9f0408229c6c admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:33.841844 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f27fb-822e-4fb5-adc5-9f0408229c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:33.842112 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f27fb-822e-4fb5-adc5-9f0408229c6c admin admin] PATH_INFO: `/v3/projects/398a3f34d61b4146bb0346a8dbd14467/users/807a32dc5c9e4e85b837edf604437c5a/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:33.844341 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f27fb-822e-4fb5-adc5-9f0408229c6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=398a3f34d61b4146bb0346a8dbd14467, user_id=807a32dc5c9e4e85b837edf604437c5a, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:33.846973 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f27fb-822e-4fb5-adc5-9f0408229c6c admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:33.858784 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1394/2762] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:13:33 2022] PUT /identity/v3/projects/398a3f34d61b4146bb0346a8dbd14467/users/807a32dc5c9e4e85b837edf604437c5a/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:33.869608 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb8b73-85d9-4783-a4c2-4345f30e85c8 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:33.869888 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb8b73-85d9-4783-a4c2-4345f30e85c8 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:33.870155 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb8b73-85d9-4783-a4c2-4345f30e85c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:33.898304 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-6ceb8b73-85d9-4783-a4c2-4345f30e85c8 None None] MFA Rules not processed for user `807a32dc5c9e4e85b837edf604437c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:33.899545 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-6ceb8b73-85d9-4783-a4c2-4345f30e85c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:33.968116 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1369/2763] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:33 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:13:33.980206 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f27fb-822e-4fb5-adc5-9f0408229c6c admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:33.982057 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-1a3f27fb-822e-4fb5-adc5-9f0408229c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:34.038529 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f27fb-822e-4fb5-adc5-9f0408229c6c admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:34.042773 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f8051-2ea6-45b5-af16-01ea0dccfb92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:34.043412 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f8051-2ea6-45b5-af16-01ea0dccfb92 service cinder] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:34.043683 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f8051-2ea6-45b5-af16-01ea0dccfb92 service cinder] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:34.044111 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f8051-2ea6-45b5-af16-01ea0dccfb92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:34.100736 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f8051-2ea6-45b5-af16-01ea0dccfb92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:34.102172 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f8051-2ea6-45b5-af16-01ea0dccfb92 service cinder] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:34.111116 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1395/2764] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:13:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:13:36.741959 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb8b73-85d9-4783-a4c2-4345f30e85c8 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:36.744820 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-6ceb8b73-85d9-4783-a4c2-4345f30e85c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:36.758754 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb8b73-85d9-4783-a4c2-4345f30e85c8 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:36.762590 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d38c4-7d72-464a-95e1-920e1f35a4ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:36.763315 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d38c4-7d72-464a-95e1-920e1f35a4ec service cinder] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:36.763705 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d38c4-7d72-464a-95e1-920e1f35a4ec service cinder] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:36.764025 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d38c4-7d72-464a-95e1-920e1f35a4ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:36.824330 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d38c4-7d72-464a-95e1-920e1f35a4ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:36.826150 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d38c4-7d72-464a-95e1-920e1f35a4ec service cinder] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:36.847259 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1370/2765] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:13:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:13:37.583862 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f8051-2ea6-45b5-af16-01ea0dccfb92 service cinder] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:37.600830 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f8051-2ea6-45b5-af16-01ea0dccfb92 service cinder] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:37.605171 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea9cf9-d1b4-4567-b6f7-f0aba1e194ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:37.606360 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea9cf9-d1b4-4567-b6f7-f0aba1e194ce service cinder] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:37.607115 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea9cf9-d1b4-4567-b6f7-f0aba1e194ce service cinder] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:37.607762 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea9cf9-d1b4-4567-b6f7-f0aba1e194ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:37.620223 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea9cf9-d1b4-4567-b6f7-f0aba1e194ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:37.622034 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea9cf9-d1b4-4567-b6f7-f0aba1e194ce service cinder] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:37.639091 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1396/2766] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:13:37 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:13:40.223702 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8b666-6904-419b-ae0e-71333f056182 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:40.224217 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8b666-6904-419b-ae0e-71333f056182 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:40.224315 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8b666-6904-419b-ae0e-71333f056182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:40.243987 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-a1d8b666-6904-419b-ae0e-71333f056182 None None] MFA Rules not processed for user `83115653901749f6ade6638593fb54e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:40.245119 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-a1d8b666-6904-419b-ae0e-71333f056182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:40.312680 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1371/2767] 10.222.0.32 () {58 vars in 967 bytes} [Tue Apr 12 03:13:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:13:40.326619 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea9cf9-d1b4-4567-b6f7-f0aba1e194ce service cinder] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:40.328836 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-0cea9cf9-d1b4-4567-b6f7-f0aba1e194ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:40.407614 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea9cf9-d1b4-4567-b6f7-f0aba1e194ce service cinder] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:40.414310 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6237d0d-a260-447f-89c3-5871f68c0097 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e8d78f92f12405fb746ddeb2579bd2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:40.415079 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6237d0d-a260-447f-89c3-5871f68c0097 service swift] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:40.415363 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6237d0d-a260-447f-89c3-5871f68c0097 service swift] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:40.415609 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6237d0d-a260-447f-89c3-5871f68c0097 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:40.426923 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6237d0d-a260-447f-89c3-5871f68c0097 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:40.431218 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6237d0d-a260-447f-89c3-5871f68c0097 service swift] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:40.432364 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8b666-6904-419b-ae0e-71333f056182 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:40.434005 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-a1d8b666-6904-419b-ae0e-71333f056182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:40.447822 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1397/2768] 10.222.0.32 () {60 vars in 1384 bytes} [Tue Apr 12 03:13:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 03:13:40.531055 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8b666-6904-419b-ae0e-71333f056182 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:40.536363 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b7e585-13f7-4ff6-9f79-4dbca5f4001b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:40.537437 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7e585-13f7-4ff6-9f79-4dbca5f4001b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:40.537924 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7e585-13f7-4ff6-9f79-4dbca5f4001b admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:40.538340 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7e585-13f7-4ff6-9f79-4dbca5f4001b admin admin] PATH_INFO: `/v3/users/5fa9975255bc4bceb902d552f99402bb` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:40.539866 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b7e585-13f7-4ff6-9f79-4dbca5f4001b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fa9975255bc4bceb902d552f99402bb)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:40.541930 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b7e585-13f7-4ff6-9f79-4dbca5f4001b admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:40.601381 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-f9b7e585-13f7-4ff6-9f79-4dbca5f4001b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fa9975255bc4bceb902d552f99402bb'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:40.602429 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-f9b7e585-13f7-4ff6-9f79-4dbca5f4001b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fa9975255bc4bceb902d552f99402bb'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:40.616531 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-f9b7e585-13f7-4ff6-9f79-4dbca5f4001b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fa9975255bc4bceb902d552f99402bb'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:40.617423 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-f9b7e585-13f7-4ff6-9f79-4dbca5f4001b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fa9975255bc4bceb902d552f99402bb'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:40.625197 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-f9b7e585-13f7-4ff6-9f79-4dbca5f4001b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fa9975255bc4bceb902d552f99402bb'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:40.643715 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1372/2769] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:13:40 2022] DELETE /identity/v3/users/5fa9975255bc4bceb902d552f99402bb => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:40.738925 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6237d0d-a260-447f-89c3-5871f68c0097 service swift] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:40.740405 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-e6237d0d-a260-447f-89c3-5871f68c0097 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:40.755086 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6237d0d-a260-447f-89c3-5871f68c0097 service swift] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:40.819636 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9214591-3e7e-452d-9279-960c387a9ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:40.820664 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9214591-3e7e-452d-9279-960c387a9ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:40.821126 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9214591-3e7e-452d-9279-960c387a9ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:40.821589 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9214591-3e7e-452d-9279-960c387a9ce1 admin admin] PATH_INFO: `/v3/users/b25155bdbda64a7487a8b8ad5a08e991` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:40.823321 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9214591-3e7e-452d-9279-960c387a9ce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b25155bdbda64a7487a8b8ad5a08e991)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:40.825865 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9214591-3e7e-452d-9279-960c387a9ce1 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:40.837622 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b7e585-13f7-4ff6-9f79-4dbca5f4001b admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:40.839313 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-f9b7e585-13f7-4ff6-9f79-4dbca5f4001b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:40.855988 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b7e585-13f7-4ff6-9f79-4dbca5f4001b admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:40.866033 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7eb5fb-ba20-472b-af0c-49399f50520b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:40.868392 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7eb5fb-ba20-472b-af0c-49399f50520b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:40.869808 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7eb5fb-ba20-472b-af0c-49399f50520b admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:40.870224 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7eb5fb-ba20-472b-af0c-49399f50520b admin admin] PATH_INFO: `/v3/projects/93bbadf297534dd28da937ad11f5e24a` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:40.872508 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7eb5fb-ba20-472b-af0c-49399f50520b admin admin] RBAC: Authorizing `identity:delete_project(project_id=93bbadf297534dd28da937ad11f5e24a)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:40.874638 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7eb5fb-ba20-472b-af0c-49399f50520b admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:40.905223 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a9214591-3e7e-452d-9279-960c387a9ce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b25155bdbda64a7487a8b8ad5a08e991'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:40.917576 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a9214591-3e7e-452d-9279-960c387a9ce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b25155bdbda64a7487a8b8ad5a08e991'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:40.918394 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a9214591-3e7e-452d-9279-960c387a9ce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b25155bdbda64a7487a8b8ad5a08e991'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:40.919044 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a9214591-3e7e-452d-9279-960c387a9ce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b25155bdbda64a7487a8b8ad5a08e991'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:40.932724 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-bf7eb5fb-ba20-472b-af0c-49399f50520b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93bbadf297534dd28da937ad11f5e24a', 'request_id': 'req-bf7eb5fb-ba20-472b-af0c-49399f50520b'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:40.933830 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a9214591-3e7e-452d-9279-960c387a9ce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b25155bdbda64a7487a8b8ad5a08e991'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:40.942140 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-bf7eb5fb-ba20-472b-af0c-49399f50520b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93bbadf297534dd28da937ad11f5e24a', 'request_id': 'req-bf7eb5fb-ba20-472b-af0c-49399f50520b'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:40.952719 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-bf7eb5fb-ba20-472b-af0c-49399f50520b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93bbadf297534dd28da937ad11f5e24a', 'request_id': 'req-bf7eb5fb-ba20-472b-af0c-49399f50520b'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:40.956185 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1398/2770] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:13:40 2022] DELETE /identity/v3/users/b25155bdbda64a7487a8b8ad5a08e991 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:13:40.957759 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e220d2-34ff-42f4-bfff-09aaabcdc4ea None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:40.958046 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e220d2-34ff-42f4-bfff-09aaabcdc4ea None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:40.958311 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e220d2-34ff-42f4-bfff-09aaabcdc4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:40.964943 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-bf7eb5fb-ba20-472b-af0c-49399f50520b admin admin] The token cache is being invalidate because project 93bbadf297534dd28da937ad11f5e24a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:13:40.965231 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-bf7eb5fb-ba20-472b-af0c-49399f50520b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:40.965879 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-bf7eb5fb-ba20-472b-af0c-49399f50520b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:40.967636 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1373/2771] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:13:40 2022] DELETE /identity/v3/projects/93bbadf297534dd28da937ad11f5e24a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:40.972557 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659c75e-2bab-4a4c-9eb3-16bbb33c36d7 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:40.972838 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659c75e-2bab-4a4c-9eb3-16bbb33c36d7 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:40.973111 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659c75e-2bab-4a4c-9eb3-16bbb33c36d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:40.982264 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-d2e220d2-34ff-42f4-bfff-09aaabcdc4ea None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:40.983446 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-d2e220d2-34ff-42f4-bfff-09aaabcdc4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:40.991304 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-8659c75e-2bab-4a4c-9eb3-16bbb33c36d7 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:40.992482 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-8659c75e-2bab-4a4c-9eb3-16bbb33c36d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:41.040910 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1399/2772] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:13:41.049446 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1374/2773] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:13:41.051295 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e220d2-34ff-42f4-bfff-09aaabcdc4ea None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:41.052780 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-d2e220d2-34ff-42f4-bfff-09aaabcdc4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:41.057782 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842ab98-76f6-4e55-84eb-fcfaba4b4d20 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:41.058056 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842ab98-76f6-4e55-84eb-fcfaba4b4d20 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:41.058327 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842ab98-76f6-4e55-84eb-fcfaba4b4d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:41.077428 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-d842ab98-76f6-4e55-84eb-fcfaba4b4d20 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:41.078732 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-d842ab98-76f6-4e55-84eb-fcfaba4b4d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:41.087004 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1375/2774] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:13:41.092283 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842ab98-76f6-4e55-84eb-fcfaba4b4d20 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:41.101223 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842ab98-76f6-4e55-84eb-fcfaba4b4d20 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:41.106134 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24c781-f7ab-42d5-a675-7d57b3091f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:41.106780 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24c781-f7ab-42d5-a675-7d57b3091f43 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:41.107053 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24c781-f7ab-42d5-a675-7d57b3091f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:41.107317 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24c781-f7ab-42d5-a675-7d57b3091f43 admin admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:41.108062 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e24c781-f7ab-42d5-a675-7d57b3091f43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:13:41.108359 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e24c781-f7ab-42d5-a675-7d57b3091f43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:41.109972 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e24c781-f7ab-42d5-a675-7d57b3091f43 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:41.113100 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e220d2-34ff-42f4-bfff-09aaabcdc4ea None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:41.117776 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ed131-f93c-4099-a782-61f5e6df1f78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:41.118771 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ed131-f93c-4099-a782-61f5e6df1f78 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:41.119060 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ed131-f93c-4099-a782-61f5e6df1f78 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:41.119360 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ed131-f93c-4099-a782-61f5e6df1f78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:41.122286 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1376/2775] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:13:41.126739 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24c781-f7ab-42d5-a675-7d57b3091f43 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:41.134965 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ed131-f93c-4099-a782-61f5e6df1f78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:41.136405 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24c781-f7ab-42d5-a675-7d57b3091f43 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:41.136835 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ed131-f93c-4099-a782-61f5e6df1f78 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:41.141267 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81cb4d-fbb8-412f-b8d7-24b6ef05c3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:41.141937 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81cb4d-fbb8-412f-b8d7-24b6ef05c3d8 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:41.142198 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81cb4d-fbb8-412f-b8d7-24b6ef05c3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:41.142438 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81cb4d-fbb8-412f-b8d7-24b6ef05c3d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:41.143143 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81cb4d-fbb8-412f-b8d7-24b6ef05c3d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:41.145172 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81cb4d-fbb8-412f-b8d7-24b6ef05c3d8 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:41.149684 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1400/2776] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:13:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:13:41.174024 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1377/2777] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:13:41 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 03:13:41.175453 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ed131-f93c-4099-a782-61f5e6df1f78 service neutron] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:41.185105 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ed131-f93c-4099-a782-61f5e6df1f78 service neutron] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:41.244495 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64833a06-8b63-4d62-bcfd-f106373d3a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:41.245347 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64833a06-8b63-4d62-bcfd-f106373d3a72 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:41.245754 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64833a06-8b63-4d62-bcfd-f106373d3a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:41.246029 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64833a06-8b63-4d62-bcfd-f106373d3a72 admin admin] PATH_INFO: `/v3/users` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:41.246733 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64833a06-8b63-4d62-bcfd-f106373d3a72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:41.248834 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64833a06-8b63-4d62-bcfd-f106373d3a72 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:41.270769 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1401/2778] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:13:41 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:13:41.275196 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81cb4d-fbb8-412f-b8d7-24b6ef05c3d8 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:41.285407 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81cb4d-fbb8-412f-b8d7-24b6ef05c3d8 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:41.290517 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb798c-4c01-41d9-bacc-83d6d3c3f49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:41.291262 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb798c-4c01-41d9-bacc-83d6d3c3f49e admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:41.291537 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb798c-4c01-41d9-bacc-83d6d3c3f49e admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:41.291933 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb798c-4c01-41d9-bacc-83d6d3c3f49e admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:41.292811 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb798c-4c01-41d9-bacc-83d6d3c3f49e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:41.295563 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb798c-4c01-41d9-bacc-83d6d3c3f49e admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:41.306865 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1378/2779] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:13:41.310915 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64833a06-8b63-4d62-bcfd-f106373d3a72 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:41.320628 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64833a06-8b63-4d62-bcfd-f106373d3a72 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:41.326045 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4438c94-3d0b-4653-97d0-76eadcd3c187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:41.326719 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4438c94-3d0b-4653-97d0-76eadcd3c187 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:41.327260 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4438c94-3d0b-4653-97d0-76eadcd3c187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:41.327260 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4438c94-3d0b-4653-97d0-76eadcd3c187 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:41.328019 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4438c94-3d0b-4653-97d0-76eadcd3c187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:41.329628 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4438c94-3d0b-4653-97d0-76eadcd3c187 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:41.339972 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1402/2780] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:13:41.344044 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb798c-4c01-41d9-bacc-83d6d3c3f49e admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:41.354033 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb798c-4c01-41d9-bacc-83d6d3c3f49e admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:41.359252 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c75150-6b02-4292-a54b-de4add3aefa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:41.360178 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c75150-6b02-4292-a54b-de4add3aefa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:41.360464 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c75150-6b02-4292-a54b-de4add3aefa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:41.360736 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c75150-6b02-4292-a54b-de4add3aefa5 admin admin] PATH_INFO: `/v3/projects/f1dd2028f6f24f21be7d88a9ff3e7ae5/users/4bed3e6279424fa9b89c577041191a14/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:41.376092 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c75150-6b02-4292-a54b-de4add3aefa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1dd2028f6f24f21be7d88a9ff3e7ae5, user_id=4bed3e6279424fa9b89c577041191a14, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:41.379125 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c75150-6b02-4292-a54b-de4add3aefa5 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:41.392961 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1379/2781] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:13:41 2022] PUT /identity/v3/projects/f1dd2028f6f24f21be7d88a9ff3e7ae5/users/4bed3e6279424fa9b89c577041191a14/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:41.398046 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4e923-ff84-47eb-a75d-8c7972c9d529 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:41.398323 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4e923-ff84-47eb-a75d-8c7972c9d529 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:41.398588 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4e923-ff84-47eb-a75d-8c7972c9d529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:41.417115 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-29e4e923-ff84-47eb-a75d-8c7972c9d529 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:41.418360 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-29e4e923-ff84-47eb-a75d-8c7972c9d529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:41.432373 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c75150-6b02-4292-a54b-de4add3aefa5 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:41.434480 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-f2c75150-6b02-4292-a54b-de4add3aefa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:41.482430 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1403/2782] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:13:41.492364 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4e923-ff84-47eb-a75d-8c7972c9d529 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:41.509422 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c75150-6b02-4292-a54b-de4add3aefa5 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:41.514111 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf3dbe-d870-44a2-9b91-a55a07d5ab28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:41.514964 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf3dbe-d870-44a2-9b91-a55a07d5ab28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:41.515236 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf3dbe-d870-44a2-9b91-a55a07d5ab28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:41.515501 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf3dbe-d870-44a2-9b91-a55a07d5ab28 admin admin] PATH_INFO: `/v3/projects/f9d49841c16043088f0ceb8dd141867f` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:41.516721 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf3dbe-d870-44a2-9b91-a55a07d5ab28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9d49841c16043088f0ceb8dd141867f)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:41.518646 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf3dbe-d870-44a2-9b91-a55a07d5ab28 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:41.551183 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4e923-ff84-47eb-a75d-8c7972c9d529 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:41.556975 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ea7ca-e900-46bb-9e42-cba56e38e06b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:41.557843 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ea7ca-e900-46bb-9e42-cba56e38e06b service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:41.558117 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ea7ca-e900-46bb-9e42-cba56e38e06b service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:41.558383 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ea7ca-e900-46bb-9e42-cba56e38e06b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:41.569289 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ea7ca-e900-46bb-9e42-cba56e38e06b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:41.569588 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ea7ca-e900-46bb-9e42-cba56e38e06b service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:41.573141 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-fedf3dbe-d870-44a2-9b91-a55a07d5ab28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9d49841c16043088f0ceb8dd141867f', 'request_id': 'req-fedf3dbe-d870-44a2-9b91-a55a07d5ab28'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:41.581443 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-fedf3dbe-d870-44a2-9b91-a55a07d5ab28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9d49841c16043088f0ceb8dd141867f', 'request_id': 'req-fedf3dbe-d870-44a2-9b91-a55a07d5ab28'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:41.581626 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1404/2783] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:13:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 03:13:41.588520 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-fedf3dbe-d870-44a2-9b91-a55a07d5ab28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9d49841c16043088f0ceb8dd141867f', 'request_id': 'req-fedf3dbe-d870-44a2-9b91-a55a07d5ab28'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:41.596470 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ea7ca-e900-46bb-9e42-cba56e38e06b service neutron] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:41.598253 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-f82ea7ca-e900-46bb-9e42-cba56e38e06b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:41.599668 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-fedf3dbe-d870-44a2-9b91-a55a07d5ab28 admin admin] The token cache is being invalidate because project f9d49841c16043088f0ceb8dd141867f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:13:41.600092 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-fedf3dbe-d870-44a2-9b91-a55a07d5ab28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:41.600835 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-fedf3dbe-d870-44a2-9b91-a55a07d5ab28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:41.615753 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1380/2784] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:13:41 2022] DELETE /identity/v3/projects/f9d49841c16043088f0ceb8dd141867f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:41.616132 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ea7ca-e900-46bb-9e42-cba56e38e06b service neutron] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:41.689350 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02e6a5-7fd1-4560-850e-4fa4d6a20c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:41.690436 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02e6a5-7fd1-4560-850e-4fa4d6a20c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:41.690819 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02e6a5-7fd1-4560-850e-4fa4d6a20c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:41.691228 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02e6a5-7fd1-4560-850e-4fa4d6a20c12 admin admin] PATH_INFO: `/v3/users/06e25b6bcb3d4dd2b1a55f9db998b0d7` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:41.692865 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02e6a5-7fd1-4560-850e-4fa4d6a20c12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06e25b6bcb3d4dd2b1a55f9db998b0d7)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:41.695203 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02e6a5-7fd1-4560-850e-4fa4d6a20c12 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:41.769814 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-ea02e6a5-7fd1-4560-850e-4fa4d6a20c12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06e25b6bcb3d4dd2b1a55f9db998b0d7'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:41.777939 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-ea02e6a5-7fd1-4560-850e-4fa4d6a20c12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06e25b6bcb3d4dd2b1a55f9db998b0d7'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:41.779219 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-ea02e6a5-7fd1-4560-850e-4fa4d6a20c12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06e25b6bcb3d4dd2b1a55f9db998b0d7'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:41.779758 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-ea02e6a5-7fd1-4560-850e-4fa4d6a20c12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06e25b6bcb3d4dd2b1a55f9db998b0d7'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:41.795589 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-ea02e6a5-7fd1-4560-850e-4fa4d6a20c12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06e25b6bcb3d4dd2b1a55f9db998b0d7'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:41.810776 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1405/2785] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:13:41 2022] DELETE /identity/v3/users/06e25b6bcb3d4dd2b1a55f9db998b0d7 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:13:41.815263 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe52db7-c7af-4566-ae26-7301421384b3 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:41.815507 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe52db7-c7af-4566-ae26-7301421384b3 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:41.815874 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe52db7-c7af-4566-ae26-7301421384b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:41.834792 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-bfe52db7-c7af-4566-ae26-7301421384b3 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:41.836042 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-bfe52db7-c7af-4566-ae26-7301421384b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:41.901858 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1381/2786] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:13:41.911857 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02e6a5-7fd1-4560-850e-4fa4d6a20c12 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:41.913371 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-ea02e6a5-7fd1-4560-850e-4fa4d6a20c12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:41.974000 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02e6a5-7fd1-4560-850e-4fa4d6a20c12 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:41.978056 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd320a54-8609-43eb-b75f-c6659be0a5a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:41.978838 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd320a54-8609-43eb-b75f-c6659be0a5a3 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:41.979061 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd320a54-8609-43eb-b75f-c6659be0a5a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:41.979354 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd320a54-8609-43eb-b75f-c6659be0a5a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:41.992541 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd320a54-8609-43eb-b75f-c6659be0a5a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:41.994174 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd320a54-8609-43eb-b75f-c6659be0a5a3 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:42.007921 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1406/2787] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:13:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:13:42.444135 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe52db7-c7af-4566-ae26-7301421384b3 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:42.446612 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-bfe52db7-c7af-4566-ae26-7301421384b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:42.467289 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe52db7-c7af-4566-ae26-7301421384b3 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:42.483921 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24397194-80c3-48ee-b3aa-2359d8a805a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:42.484977 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24397194-80c3-48ee-b3aa-2359d8a805a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:42.485262 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24397194-80c3-48ee-b3aa-2359d8a805a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:42.485531 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24397194-80c3-48ee-b3aa-2359d8a805a6 admin admin] PATH_INFO: `/v3/projects/16264a5897694d37a86b32ef63c63468` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:42.487211 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24397194-80c3-48ee-b3aa-2359d8a805a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16264a5897694d37a86b32ef63c63468)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:42.489177 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24397194-80c3-48ee-b3aa-2359d8a805a6 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:42.537458 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-24397194-80c3-48ee-b3aa-2359d8a805a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16264a5897694d37a86b32ef63c63468', 'request_id': 'req-24397194-80c3-48ee-b3aa-2359d8a805a6'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:42.546238 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-24397194-80c3-48ee-b3aa-2359d8a805a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16264a5897694d37a86b32ef63c63468', 'request_id': 'req-24397194-80c3-48ee-b3aa-2359d8a805a6'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:42.552858 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-24397194-80c3-48ee-b3aa-2359d8a805a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16264a5897694d37a86b32ef63c63468', 'request_id': 'req-24397194-80c3-48ee-b3aa-2359d8a805a6'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:42.563111 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-24397194-80c3-48ee-b3aa-2359d8a805a6 admin admin] The token cache is being invalidate because project 16264a5897694d37a86b32ef63c63468 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:13:42.563465 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-24397194-80c3-48ee-b3aa-2359d8a805a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:42.564112 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-24397194-80c3-48ee-b3aa-2359d8a805a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:42.565741 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1382/2788] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:13:42 2022] DELETE /identity/v3/projects/16264a5897694d37a86b32ef63c63468 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:42.569888 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd320a54-8609-43eb-b75f-c6659be0a5a3 service neutron] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:42.580284 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd320a54-8609-43eb-b75f-c6659be0a5a3 service neutron] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:42.639482 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df988fc0-86d1-40fb-8cd7-5260a0c893da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:42.640407 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df988fc0-86d1-40fb-8cd7-5260a0c893da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:42.640674 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df988fc0-86d1-40fb-8cd7-5260a0c893da admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:42.640935 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df988fc0-86d1-40fb-8cd7-5260a0c893da admin admin] PATH_INFO: `/v3/users/b264f81add98484886e578287d8dd401` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:42.642104 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df988fc0-86d1-40fb-8cd7-5260a0c893da admin admin] RBAC: Authorizing `identity:delete_user(user_id=b264f81add98484886e578287d8dd401)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:42.644051 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df988fc0-86d1-40fb-8cd7-5260a0c893da admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:42.691237 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-df988fc0-86d1-40fb-8cd7-5260a0c893da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b264f81add98484886e578287d8dd401'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:42.699566 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-df988fc0-86d1-40fb-8cd7-5260a0c893da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b264f81add98484886e578287d8dd401'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:42.700674 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-df988fc0-86d1-40fb-8cd7-5260a0c893da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b264f81add98484886e578287d8dd401'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:42.701204 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-df988fc0-86d1-40fb-8cd7-5260a0c893da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b264f81add98484886e578287d8dd401'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:42.714109 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-df988fc0-86d1-40fb-8cd7-5260a0c893da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b264f81add98484886e578287d8dd401'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:42.727744 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1407/2789] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:13:42 2022] DELETE /identity/v3/users/b264f81add98484886e578287d8dd401 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:42.814753 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24397194-80c3-48ee-b3aa-2359d8a805a6 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:42.816571 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-24397194-80c3-48ee-b3aa-2359d8a805a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:42.833307 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24397194-80c3-48ee-b3aa-2359d8a805a6 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:42.917792 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c41525-19cc-49d1-a843-37162d3dc2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:42.917792 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c41525-19cc-49d1-a843-37162d3dc2ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:42.917792 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c41525-19cc-49d1-a843-37162d3dc2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:42.917792 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c41525-19cc-49d1-a843-37162d3dc2ce admin admin] PATH_INFO: `/v3/users/d034574e907f4903a7af70cab219f9cc` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:42.926027 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c41525-19cc-49d1-a843-37162d3dc2ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=d034574e907f4903a7af70cab219f9cc)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:42.929783 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c41525-19cc-49d1-a843-37162d3dc2ce admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:43.002610 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-03c41525-19cc-49d1-a843-37162d3dc2ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd034574e907f4903a7af70cab219f9cc'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:43.004894 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-03c41525-19cc-49d1-a843-37162d3dc2ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd034574e907f4903a7af70cab219f9cc'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:43.030980 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-03c41525-19cc-49d1-a843-37162d3dc2ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd034574e907f4903a7af70cab219f9cc'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:43.032152 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-03c41525-19cc-49d1-a843-37162d3dc2ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd034574e907f4903a7af70cab219f9cc'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:43.040687 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-03c41525-19cc-49d1-a843-37162d3dc2ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd034574e907f4903a7af70cab219f9cc'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:43.055217 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df988fc0-86d1-40fb-8cd7-5260a0c893da admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:43.056793 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-df988fc0-86d1-40fb-8cd7-5260a0c893da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:43.058881 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1383/2790] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:13:42 2022] DELETE /identity/v3/users/d034574e907f4903a7af70cab219f9cc => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:43.074050 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df988fc0-86d1-40fb-8cd7-5260a0c893da admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:43.150708 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3783fc-7701-43c6-9a8b-0d7242dcdc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:43.151977 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3783fc-7701-43c6-9a8b-0d7242dcdc0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:43.152437 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3783fc-7701-43c6-9a8b-0d7242dcdc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:43.152862 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3783fc-7701-43c6-9a8b-0d7242dcdc0b admin admin] PATH_INFO: `/v3/projects/8f5e72ffd83340dcaf091c54080ee20b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:43.154456 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3783fc-7701-43c6-9a8b-0d7242dcdc0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f5e72ffd83340dcaf091c54080ee20b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:43.156701 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3783fc-7701-43c6-9a8b-0d7242dcdc0b admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:43.225033 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-4b3783fc-7701-43c6-9a8b-0d7242dcdc0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f5e72ffd83340dcaf091c54080ee20b', 'request_id': 'req-4b3783fc-7701-43c6-9a8b-0d7242dcdc0b'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:43.250229 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-4b3783fc-7701-43c6-9a8b-0d7242dcdc0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f5e72ffd83340dcaf091c54080ee20b', 'request_id': 'req-4b3783fc-7701-43c6-9a8b-0d7242dcdc0b'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:43.272321 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-4b3783fc-7701-43c6-9a8b-0d7242dcdc0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f5e72ffd83340dcaf091c54080ee20b', 'request_id': 'req-4b3783fc-7701-43c6-9a8b-0d7242dcdc0b'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:43.293995 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c41525-19cc-49d1-a843-37162d3dc2ce admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:43.295534 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-03c41525-19cc-49d1-a843-37162d3dc2ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:43.299712 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-4b3783fc-7701-43c6-9a8b-0d7242dcdc0b admin admin] The token cache is being invalidate because project 8f5e72ffd83340dcaf091c54080ee20b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:13:43.300023 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-4b3783fc-7701-43c6-9a8b-0d7242dcdc0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:43.300893 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-4b3783fc-7701-43c6-9a8b-0d7242dcdc0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:43.307552 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1408/2791] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:13:43 2022] DELETE /identity/v3/projects/8f5e72ffd83340dcaf091c54080ee20b => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:43.308838 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3783fc-7701-43c6-9a8b-0d7242dcdc0b admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:43.310365 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-4b3783fc-7701-43c6-9a8b-0d7242dcdc0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:43.316371 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c41525-19cc-49d1-a843-37162d3dc2ce admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:43.392319 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3783fc-7701-43c6-9a8b-0d7242dcdc0b admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:43.396430 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f6d63-39eb-461a-902d-f9f2308825a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:43.397428 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f6d63-39eb-461a-902d-f9f2308825a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:43.397795 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f6d63-39eb-461a-902d-f9f2308825a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:43.398151 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f6d63-39eb-461a-902d-f9f2308825a9 admin admin] PATH_INFO: `/v3/projects/729edaa2a27a40f897ddba50391dd29f` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:43.398300 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c10cf-3d01-4154-8358-dc581bcc40e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:43.399845 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5f6d63-39eb-461a-902d-f9f2308825a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=729edaa2a27a40f897ddba50391dd29f)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:43.400147 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c10cf-3d01-4154-8358-dc581bcc40e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:43.400595 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c10cf-3d01-4154-8358-dc581bcc40e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:43.400874 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c10cf-3d01-4154-8358-dc581bcc40e9 admin admin] PATH_INFO: `/v3/users/807a32dc5c9e4e85b837edf604437c5a` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:43.402140 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5f6d63-39eb-461a-902d-f9f2308825a9 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:43.402268 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c10cf-3d01-4154-8358-dc581bcc40e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=807a32dc5c9e4e85b837edf604437c5a)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:43.404565 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c10cf-3d01-4154-8358-dc581bcc40e9 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:43.459327 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-5c5f6d63-39eb-461a-902d-f9f2308825a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '729edaa2a27a40f897ddba50391dd29f', 'request_id': 'req-5c5f6d63-39eb-461a-902d-f9f2308825a9'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:43.468917 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-b62c10cf-3d01-4154-8358-dc581bcc40e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '807a32dc5c9e4e85b837edf604437c5a'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:43.476839 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-b62c10cf-3d01-4154-8358-dc581bcc40e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '807a32dc5c9e4e85b837edf604437c5a'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:43.478065 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-b62c10cf-3d01-4154-8358-dc581bcc40e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '807a32dc5c9e4e85b837edf604437c5a'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:43.478892 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-b62c10cf-3d01-4154-8358-dc581bcc40e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '807a32dc5c9e4e85b837edf604437c5a'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:43.489430 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-5c5f6d63-39eb-461a-902d-f9f2308825a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '729edaa2a27a40f897ddba50391dd29f', 'request_id': 'req-5c5f6d63-39eb-461a-902d-f9f2308825a9'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:43.498287 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-b62c10cf-3d01-4154-8358-dc581bcc40e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '807a32dc5c9e4e85b837edf604437c5a'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:43.499846 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-5c5f6d63-39eb-461a-902d-f9f2308825a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '729edaa2a27a40f897ddba50391dd29f', 'request_id': 'req-5c5f6d63-39eb-461a-902d-f9f2308825a9'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:43.522151 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-5c5f6d63-39eb-461a-902d-f9f2308825a9 admin admin] The token cache is being invalidate because project 729edaa2a27a40f897ddba50391dd29f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:13:43.522912 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-5c5f6d63-39eb-461a-902d-f9f2308825a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:43.523799 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-5c5f6d63-39eb-461a-902d-f9f2308825a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:43.525631 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1384/2792] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:13:43 2022] DELETE /identity/v3/projects/729edaa2a27a40f897ddba50391dd29f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:13:43.530952 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f8a8b-e68b-46e2-9912-dc35f60cc62f None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:43.531958 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f8a8b-e68b-46e2-9912-dc35f60cc62f None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:43.532436 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f8a8b-e68b-46e2-9912-dc35f60cc62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:43.536210 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1409/2793] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:13:43 2022] DELETE /identity/v3/users/807a32dc5c9e4e85b837edf604437c5a => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:43.565517 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-7f6f8a8b-e68b-46e2-9912-dc35f60cc62f None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:43.568477 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-7f6f8a8b-e68b-46e2-9912-dc35f60cc62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:43.699338 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1385/2794] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:13:43.707942 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22dd88-2bc4-442a-9356-f33e1d86b23c None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:43.709100 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22dd88-2bc4-442a-9356-f33e1d86b23c None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:43.709584 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22dd88-2bc4-442a-9356-f33e1d86b23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:43.731644 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-fc22dd88-2bc4-442a-9356-f33e1d86b23c None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:43.733525 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-fc22dd88-2bc4-442a-9356-f33e1d86b23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:43.745977 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1410/2795] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:13:43.750315 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f8a8b-e68b-46e2-9912-dc35f60cc62f None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:43.761312 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f8a8b-e68b-46e2-9912-dc35f60cc62f None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:43.766225 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71d69a-e227-435e-abf1-e5770c077e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:43.767142 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71d69a-e227-435e-abf1-e5770c077e16 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:43.767418 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71d69a-e227-435e-abf1-e5770c077e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:43.767687 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71d69a-e227-435e-abf1-e5770c077e16 admin admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:43.768492 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71d69a-e227-435e-abf1-e5770c077e16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:13:43.768785 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71d69a-e227-435e-abf1-e5770c077e16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:43.770679 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71d69a-e227-435e-abf1-e5770c077e16 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:43.795898 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1386/2796] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:13:43.798903 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22dd88-2bc4-442a-9356-f33e1d86b23c None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:43.815638 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22dd88-2bc4-442a-9356-f33e1d86b23c None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:43.822277 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab29196-c64c-4205-a5a5-1a7a058fcc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:43.824265 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab29196-c64c-4205-a5a5-1a7a058fcc11 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:43.825484 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab29196-c64c-4205-a5a5-1a7a058fcc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:43.826057 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab29196-c64c-4205-a5a5-1a7a058fcc11 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:43.826867 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab29196-c64c-4205-a5a5-1a7a058fcc11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:43.830853 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab29196-c64c-4205-a5a5-1a7a058fcc11 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:43.890465 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1411/2797] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:13:43 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:13:43.896101 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71d69a-e227-435e-abf1-e5770c077e16 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:43.908440 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71d69a-e227-435e-abf1-e5770c077e16 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:43.980606 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab29196-c64c-4205-a5a5-1a7a058fcc11 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:43.983408 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-aab29196-c64c-4205-a5a5-1a7a058fcc11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:44.014163 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931dc86-c5a8-42db-bc36-0f21ce1624a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:44.014852 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931dc86-c5a8-42db-bc36-0f21ce1624a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:44.015654 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931dc86-c5a8-42db-bc36-0f21ce1624a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:44.015654 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931dc86-c5a8-42db-bc36-0f21ce1624a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:44.016184 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931dc86-c5a8-42db-bc36-0f21ce1624a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:44.020478 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931dc86-c5a8-42db-bc36-0f21ce1624a9 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:44.051378 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1387/2798] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:13:43 2022] POST /identity/v3/users => generated 287 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:13:44.056189 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931dc86-c5a8-42db-bc36-0f21ce1624a9 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:44.081082 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931dc86-c5a8-42db-bc36-0f21ce1624a9 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:44.086336 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01e4df-294d-493c-9f32-d58c0b47f39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:44.087305 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01e4df-294d-493c-9f32-d58c0b47f39a admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:44.087651 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01e4df-294d-493c-9f32-d58c0b47f39a admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:44.088078 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01e4df-294d-493c-9f32-d58c0b47f39a admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:44.088878 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d01e4df-294d-493c-9f32-d58c0b47f39a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:44.090573 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d01e4df-294d-493c-9f32-d58c0b47f39a admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:44.104453 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1388/2799] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:13:44.109033 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01e4df-294d-493c-9f32-d58c0b47f39a admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:44.112545 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab29196-c64c-4205-a5a5-1a7a058fcc11 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:44.127586 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01e4df-294d-493c-9f32-d58c0b47f39a admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:44.135266 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7dae4-1785-4813-8dfa-f0af9a66f2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:44.136237 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7caed9-12db-4e4c-8007-ae5d79684109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:44.136415 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7dae4-1785-4813-8dfa-f0af9a66f2ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:44.136563 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7dae4-1785-4813-8dfa-f0af9a66f2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:44.136820 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7dae4-1785-4813-8dfa-f0af9a66f2ba admin admin] PATH_INFO: `/v3/projects/398a3f34d61b4146bb0346a8dbd14467` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:44.137265 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7caed9-12db-4e4c-8007-ae5d79684109 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:44.137663 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7caed9-12db-4e4c-8007-ae5d79684109 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:44.138024 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7caed9-12db-4e4c-8007-ae5d79684109 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:44.138521 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7dae4-1785-4813-8dfa-f0af9a66f2ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=398a3f34d61b4146bb0346a8dbd14467)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:44.141267 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7dae4-1785-4813-8dfa-f0af9a66f2ba admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:44.146505 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7caed9-12db-4e4c-8007-ae5d79684109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:44.150377 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7caed9-12db-4e4c-8007-ae5d79684109 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:44.167457 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1389/2800] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:13:44.168543 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7caed9-12db-4e4c-8007-ae5d79684109 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:44.181492 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7caed9-12db-4e4c-8007-ae5d79684109 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:44.197193 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c7c59-5647-49bc-bc2b-de389dd8580a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:44.200279 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c7c59-5647-49bc-bc2b-de389dd8580a admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:44.200733 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c7c59-5647-49bc-bc2b-de389dd8580a admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:44.201422 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c7c59-5647-49bc-bc2b-de389dd8580a admin admin] PATH_INFO: `/v3/projects/45a7e885a5914143ac199e06594b9da5/users/877c9754d92541978cc90518e9605c98/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:44.216557 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a8f7dae4-1785-4813-8dfa-f0af9a66f2ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '398a3f34d61b4146bb0346a8dbd14467', 'request_id': 'req-a8f7dae4-1785-4813-8dfa-f0af9a66f2ba'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:44.226923 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c7c59-5647-49bc-bc2b-de389dd8580a admin admin] RBAC: Authorizing `identity:create_grant(project_id=45a7e885a5914143ac199e06594b9da5, user_id=877c9754d92541978cc90518e9605c98, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:44.229099 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a8f7dae4-1785-4813-8dfa-f0af9a66f2ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '398a3f34d61b4146bb0346a8dbd14467', 'request_id': 'req-a8f7dae4-1785-4813-8dfa-f0af9a66f2ba'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:44.231006 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c7c59-5647-49bc-bc2b-de389dd8580a admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:44.238459 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a8f7dae4-1785-4813-8dfa-f0af9a66f2ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '398a3f34d61b4146bb0346a8dbd14467', 'request_id': 'req-a8f7dae4-1785-4813-8dfa-f0af9a66f2ba'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:44.250174 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1390/2801] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:13:44 2022] PUT /identity/v3/projects/45a7e885a5914143ac199e06594b9da5/users/877c9754d92541978cc90518e9605c98/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:44.263267 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560c610-f820-4f31-aabe-595abee12989 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:44.264194 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560c610-f820-4f31-aabe-595abee12989 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:44.264585 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560c610-f820-4f31-aabe-595abee12989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:44.264846 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a8f7dae4-1785-4813-8dfa-f0af9a66f2ba admin admin] The token cache is being invalidate because project 398a3f34d61b4146bb0346a8dbd14467 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:13:44.265136 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a8f7dae4-1785-4813-8dfa-f0af9a66f2ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:44.267950 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a8f7dae4-1785-4813-8dfa-f0af9a66f2ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:44.271351 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1412/2802] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:13:43 2022] DELETE /identity/v3/projects/398a3f34d61b4146bb0346a8dbd14467 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:44.335768 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-f560c610-f820-4f31-aabe-595abee12989 None None] MFA Rules not processed for user `877c9754d92541978cc90518e9605c98`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:44.339773 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-f560c610-f820-4f31-aabe-595abee12989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:44.441864 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1391/2803] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:13:44.454312 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7dae4-1785-4813-8dfa-f0af9a66f2ba admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:44.455804 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-a8f7dae4-1785-4813-8dfa-f0af9a66f2ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:44.531542 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7dae4-1785-4813-8dfa-f0af9a66f2ba admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:44.589150 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ba04e-5576-4c13-827d-101844452ff8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:44.591496 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ba04e-5576-4c13-827d-101844452ff8 service cinder] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:44.592042 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ba04e-5576-4c13-827d-101844452ff8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:44.592504 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ba04e-5576-4c13-827d-101844452ff8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:44.604574 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ba04e-5576-4c13-827d-101844452ff8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:44.606095 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ba04e-5576-4c13-827d-101844452ff8 service cinder] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:44.616115 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1413/2804] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:13:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:13:47.082301 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc6185-b0f7-4d83-86e6-2149d85dad4b None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:47.082742 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc6185-b0f7-4d83-86e6-2149d85dad4b None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:47.082826 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc6185-b0f7-4d83-86e6-2149d85dad4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:47.111887 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-24dc6185-b0f7-4d83-86e6-2149d85dad4b None None] MFA Rules not processed for user `4bed3e6279424fa9b89c577041191a14`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:47.113108 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-24dc6185-b0f7-4d83-86e6-2149d85dad4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:47.185960 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1392/2805] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:13:47.190608 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ba04e-5576-4c13-827d-101844452ff8 service cinder] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:47.192057 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-9d1ba04e-5576-4c13-827d-101844452ff8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:47.260324 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ba04e-5576-4c13-827d-101844452ff8 service cinder] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:47.265118 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b18a99-cb73-4470-9224-64f426699534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:47.265837 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b18a99-cb73-4470-9224-64f426699534 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:47.266105 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b18a99-cb73-4470-9224-64f426699534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:47.266408 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b18a99-cb73-4470-9224-64f426699534 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:47.267161 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b18a99-cb73-4470-9224-64f426699534 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:47.269310 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b18a99-cb73-4470-9224-64f426699534 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:47.295746 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1414/2806] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:13:47 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:13:47.299914 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc6185-b0f7-4d83-86e6-2149d85dad4b None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:47.311320 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc6185-b0f7-4d83-86e6-2149d85dad4b None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:47.397979 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b979de0-eec7-4d1c-bec3-e38d999b9190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:47.398562 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b979de0-eec7-4d1c-bec3-e38d999b9190 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:47.398902 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b979de0-eec7-4d1c-bec3-e38d999b9190 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:47.399193 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b979de0-eec7-4d1c-bec3-e38d999b9190 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:47.399916 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b979de0-eec7-4d1c-bec3-e38d999b9190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:47.401881 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b979de0-eec7-4d1c-bec3-e38d999b9190 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:47.427712 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1393/2807] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:13:47 2022] POST /identity/v3/users => generated 299 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:13:47.433026 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b18a99-cb73-4470-9224-64f426699534 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:47.460903 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b18a99-cb73-4470-9224-64f426699534 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:47.469074 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3d242-2715-4e6f-b668-59816731e17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:47.469793 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3d242-2715-4e6f-b668-59816731e17c admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:47.470076 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3d242-2715-4e6f-b668-59816731e17c admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:47.470349 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3d242-2715-4e6f-b668-59816731e17c admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:47.471101 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3d242-2715-4e6f-b668-59816731e17c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:47.472853 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3d242-2715-4e6f-b668-59816731e17c admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:47.484506 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1415/2808] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:13:47.488819 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b979de0-eec7-4d1c-bec3-e38d999b9190 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:47.504618 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b979de0-eec7-4d1c-bec3-e38d999b9190 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:47.509425 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1137c-7f8e-4ac7-a7cb-82eb447071f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:47.510492 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1137c-7f8e-4ac7-a7cb-82eb447071f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:47.510771 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1137c-7f8e-4ac7-a7cb-82eb447071f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:47.511046 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1137c-7f8e-4ac7-a7cb-82eb447071f6 admin admin] PATH_INFO: `/v3/projects/476d54f083c54f89b7b0de86d9f68238/users/efb5cc68d27e41efaecc54cc1a16206c/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:47.531403 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1137c-7f8e-4ac7-a7cb-82eb447071f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=476d54f083c54f89b7b0de86d9f68238, user_id=efb5cc68d27e41efaecc54cc1a16206c, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:47.534167 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1137c-7f8e-4ac7-a7cb-82eb447071f6 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:47.548053 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1394/2809] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:13:47 2022] PUT /identity/v3/projects/476d54f083c54f89b7b0de86d9f68238/users/efb5cc68d27e41efaecc54cc1a16206c/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:47.552031 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3d242-2715-4e6f-b668-59816731e17c admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:47.562771 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3d242-2715-4e6f-b668-59816731e17c admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:47.639811 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a2acd-e825-427f-8189-ba9577cfe541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:47.640493 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a2acd-e825-427f-8189-ba9577cfe541 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:47.640769 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a2acd-e825-427f-8189-ba9577cfe541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:47.641038 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a2acd-e825-427f-8189-ba9577cfe541 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:47.641766 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a2acd-e825-427f-8189-ba9577cfe541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:47.643412 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a2acd-e825-427f-8189-ba9577cfe541 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:47.656022 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1416/2810] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:13:47.660041 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1137c-7f8e-4ac7-a7cb-82eb447071f6 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:47.673302 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1137c-7f8e-4ac7-a7cb-82eb447071f6 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:47.693566 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4dd3e-8a16-4310-a873-d6f47cb05bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:47.694575 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4dd3e-8a16-4310-a873-d6f47cb05bc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:47.694831 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4dd3e-8a16-4310-a873-d6f47cb05bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:47.695148 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4dd3e-8a16-4310-a873-d6f47cb05bc6 admin admin] PATH_INFO: `/v3/projects/476d54f083c54f89b7b0de86d9f68238/users/efb5cc68d27e41efaecc54cc1a16206c/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:47.697535 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd4dd3e-8a16-4310-a873-d6f47cb05bc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=476d54f083c54f89b7b0de86d9f68238, user_id=efb5cc68d27e41efaecc54cc1a16206c, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:47.700671 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd4dd3e-8a16-4310-a873-d6f47cb05bc6 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:47.713131 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1395/2811] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:13:47 2022] PUT /identity/v3/projects/476d54f083c54f89b7b0de86d9f68238/users/efb5cc68d27e41efaecc54cc1a16206c/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:49.439233 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a2acd-e825-427f-8189-ba9577cfe541 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:49.443595 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-144a2acd-e825-427f-8189-ba9577cfe541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:49.548983 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a2acd-e825-427f-8189-ba9577cfe541 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:49.635624 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbc14d-e06b-4650-854a-6fb3b79f9162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:49.636324 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbc14d-e06b-4650-854a-6fb3b79f9162 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:49.636603 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbc14d-e06b-4650-854a-6fb3b79f9162 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:49.636874 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbc14d-e06b-4650-854a-6fb3b79f9162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:49.641330 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-d0bbc14d-e06b-4650-854a-6fb3b79f9162 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:49.729814 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbc14d-e06b-4650-854a-6fb3b79f9162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:49.731742 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbc14d-e06b-4650-854a-6fb3b79f9162 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:49.746818 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1417/2812] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:13:49 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:13:54.421310 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a4337-81c1-4fab-9fba-a134ac62df99 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:54.421874 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a4337-81c1-4fab-9fba-a134ac62df99 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:54.421874 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a4337-81c1-4fab-9fba-a134ac62df99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:54.452567 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-840a4337-81c1-4fab-9fba-a134ac62df99 None None] MFA Rules not processed for user `efb5cc68d27e41efaecc54cc1a16206c`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:54.453887 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-840a4337-81c1-4fab-9fba-a134ac62df99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:54.528180 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1396/2813] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:13:54.541239 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbc14d-e06b-4650-854a-6fb3b79f9162 service neutron] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:54.542661 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-d0bbc14d-e06b-4650-854a-6fb3b79f9162 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:54.607963 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbc14d-e06b-4650-854a-6fb3b79f9162 service neutron] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:54.615879 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b609df-981e-4158-857f-102210f40fbc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a6cffa8af470388d4b063c3c49849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:54.618138 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b609df-981e-4158-857f-102210f40fbc service glance] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:54.619589 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b609df-981e-4158-857f-102210f40fbc service glance] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:54.620225 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b609df-981e-4158-857f-102210f40fbc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:54.711968 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b609df-981e-4158-857f-102210f40fbc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:54.713592 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b609df-981e-4158-857f-102210f40fbc service glance] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:54.723620 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1418/2814] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:13:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:13:54.837999 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc34b7-d12e-48d8-9db1-d997e7e066e4 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:54.837999 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc34b7-d12e-48d8-9db1-d997e7e066e4 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:54.837999 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc34b7-d12e-48d8-9db1-d997e7e066e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:54.860189 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-00fc34b7-d12e-48d8-9db1-d997e7e066e4 None None] MFA Rules not processed for user `83115653901749f6ade6638593fb54e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:54.861383 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-00fc34b7-d12e-48d8-9db1-d997e7e066e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:54.920253 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1397/2815] 10.222.0.32 () {58 vars in 1009 bytes} [Tue Apr 12 03:13:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:13:54.934085 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b609df-981e-4158-857f-102210f40fbc service glance] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:54.935507 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-c0b609df-981e-4158-857f-102210f40fbc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:55.021043 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b609df-981e-4158-857f-102210f40fbc service glance] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:55.026801 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c768c8-9efc-4e6a-b2a7-0f33d7c1cd7d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e8d78f92f12405fb746ddeb2579bd2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:55.027453 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c768c8-9efc-4e6a-b2a7-0f33d7c1cd7d service swift] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:55.027756 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c768c8-9efc-4e6a-b2a7-0f33d7c1cd7d service swift] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:55.028025 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c768c8-9efc-4e6a-b2a7-0f33d7c1cd7d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:55.037382 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c768c8-9efc-4e6a-b2a7-0f33d7c1cd7d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:55.039028 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c768c8-9efc-4e6a-b2a7-0f33d7c1cd7d service swift] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:55.048511 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1419/2816] 10.222.0.32 () {60 vars in 1384 bytes} [Tue Apr 12 03:13:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 03:13:56.378888 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc34b7-d12e-48d8-9db1-d997e7e066e4 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:56.380890 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-00fc34b7-d12e-48d8-9db1-d997e7e066e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:56.458958 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc34b7-d12e-48d8-9db1-d997e7e066e4 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:56.465152 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c002062-914e-45bc-9393-9e25e287bf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:56.466455 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c002062-914e-45bc-9393-9e25e287bf85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:56.466826 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c002062-914e-45bc-9393-9e25e287bf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:56.467195 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c002062-914e-45bc-9393-9e25e287bf85 admin admin] PATH_INFO: `/v3/users/877c9754d92541978cc90518e9605c98` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:56.468589 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c002062-914e-45bc-9393-9e25e287bf85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=877c9754d92541978cc90518e9605c98)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:56.470711 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c002062-914e-45bc-9393-9e25e287bf85 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:56.555754 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-7c002062-914e-45bc-9393-9e25e287bf85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '877c9754d92541978cc90518e9605c98'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:56.557019 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-7c002062-914e-45bc-9393-9e25e287bf85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '877c9754d92541978cc90518e9605c98'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:56.590351 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-7c002062-914e-45bc-9393-9e25e287bf85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '877c9754d92541978cc90518e9605c98'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:56.592418 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-7c002062-914e-45bc-9393-9e25e287bf85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '877c9754d92541978cc90518e9605c98'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:56.608315 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-7c002062-914e-45bc-9393-9e25e287bf85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '877c9754d92541978cc90518e9605c98'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:56.640675 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1398/2817] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:13:56 2022] DELETE /identity/v3/users/877c9754d92541978cc90518e9605c98 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:56.641889 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38de1a-68ba-4651-a743-268d0dc5ed39 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:56.642371 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38de1a-68ba-4651-a743-268d0dc5ed39 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:56.642459 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38de1a-68ba-4651-a743-268d0dc5ed39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:56.673294 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-3e38de1a-68ba-4651-a743-268d0dc5ed39 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:56.674679 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-3e38de1a-68ba-4651-a743-268d0dc5ed39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:56.751992 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1420/2818] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 03:13:56.766647 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c002062-914e-45bc-9393-9e25e287bf85 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:56.768323 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-7c002062-914e-45bc-9393-9e25e287bf85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:56.835591 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c002062-914e-45bc-9393-9e25e287bf85 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:56.839376 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9590b7-c429-47a8-a4dd-308aec4e7cdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:56.840068 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9590b7-c429-47a8-a4dd-308aec4e7cdf service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:56.844127 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9590b7-c429-47a8-a4dd-308aec4e7cdf service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:56.844420 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9590b7-c429-47a8-a4dd-308aec4e7cdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:56.855065 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9590b7-c429-47a8-a4dd-308aec4e7cdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:56.856897 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9590b7-c429-47a8-a4dd-308aec4e7cdf service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:56.867436 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1399/2819] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:13:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:13:57.257751 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38de1a-68ba-4651-a743-268d0dc5ed39 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:57.259600 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-3e38de1a-68ba-4651-a743-268d0dc5ed39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:57.276240 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38de1a-68ba-4651-a743-268d0dc5ed39 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:57.286102 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46048bf-241a-4936-8b89-1880de1fe7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:57.286991 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46048bf-241a-4936-8b89-1880de1fe7d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:57.287270 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46048bf-241a-4936-8b89-1880de1fe7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:57.287533 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46048bf-241a-4936-8b89-1880de1fe7d9 admin admin] PATH_INFO: `/v3/projects/45a7e885a5914143ac199e06594b9da5` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:57.288767 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46048bf-241a-4936-8b89-1880de1fe7d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45a7e885a5914143ac199e06594b9da5)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:57.291251 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46048bf-241a-4936-8b89-1880de1fe7d9 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:57.350999 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a46048bf-241a-4936-8b89-1880de1fe7d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45a7e885a5914143ac199e06594b9da5', 'request_id': 'req-a46048bf-241a-4936-8b89-1880de1fe7d9'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:57.364880 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a46048bf-241a-4936-8b89-1880de1fe7d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45a7e885a5914143ac199e06594b9da5', 'request_id': 'req-a46048bf-241a-4936-8b89-1880de1fe7d9'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:57.382944 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a46048bf-241a-4936-8b89-1880de1fe7d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45a7e885a5914143ac199e06594b9da5', 'request_id': 'req-a46048bf-241a-4936-8b89-1880de1fe7d9'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:57.403288 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a46048bf-241a-4936-8b89-1880de1fe7d9 admin admin] The token cache is being invalidate because project 45a7e885a5914143ac199e06594b9da5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:13:57.403568 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a46048bf-241a-4936-8b89-1880de1fe7d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:57.404472 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a46048bf-241a-4936-8b89-1880de1fe7d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:13:57.407766 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1421/2820] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:13:57 2022] DELETE /identity/v3/projects/45a7e885a5914143ac199e06594b9da5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:57.412596 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b2882-8bf1-4599-bb15-0d059eb69732 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:57.413594 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b2882-8bf1-4599-bb15-0d059eb69732 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:57.414057 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b2882-8bf1-4599-bb15-0d059eb69732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:57.433183 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-e63b2882-8bf1-4599-bb15-0d059eb69732 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:57.434786 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-e63b2882-8bf1-4599-bb15-0d059eb69732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:57.520883 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886b2df-c51f-4e76-8c1f-08e606d93e4e None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:57.521139 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1400/2821] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:13:57.521698 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886b2df-c51f-4e76-8c1f-08e606d93e4e None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:57.522136 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886b2df-c51f-4e76-8c1f-08e606d93e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:57.552330 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-6886b2df-c51f-4e76-8c1f-08e606d93e4e None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:57.553945 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-6886b2df-c51f-4e76-8c1f-08e606d93e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:57.562963 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1422/2822] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:13:57.567058 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b2882-8bf1-4599-bb15-0d059eb69732 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:57.580622 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b2882-8bf1-4599-bb15-0d059eb69732 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:57.585530 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e07a4-2201-4b01-a997-a377b6c1a458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:57.586269 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e07a4-2201-4b01-a997-a377b6c1a458 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:57.586728 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e07a4-2201-4b01-a997-a377b6c1a458 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:57.587217 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e07a4-2201-4b01-a997-a377b6c1a458 admin admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:57.587960 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e07a4-2201-4b01-a997-a377b6c1a458 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:13:57.588265 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e07a4-2201-4b01-a997-a377b6c1a458 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:57.589879 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e07a4-2201-4b01-a997-a377b6c1a458 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:57.615042 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1401/2823] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:13:57.615963 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886b2df-c51f-4e76-8c1f-08e606d93e4e None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:57.626732 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886b2df-c51f-4e76-8c1f-08e606d93e4e None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:57.631679 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4153314-61da-4583-8a45-06440e6c173c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:57.632465 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4153314-61da-4583-8a45-06440e6c173c admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:57.633018 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4153314-61da-4583-8a45-06440e6c173c admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:57.633477 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4153314-61da-4583-8a45-06440e6c173c admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:57.634249 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4153314-61da-4583-8a45-06440e6c173c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:57.636733 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4153314-61da-4583-8a45-06440e6c173c admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:57.667798 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1423/2824] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:13:57 2022] POST /identity/v3/projects => generated 395 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 03:13:57.671512 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e07a4-2201-4b01-a997-a377b6c1a458 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:57.683748 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e07a4-2201-4b01-a997-a377b6c1a458 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:57.747498 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46104b9c-0d55-45d0-a272-0f6b5cd05b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:57.748207 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46104b9c-0d55-45d0-a272-0f6b5cd05b2e admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:57.748480 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46104b9c-0d55-45d0-a272-0f6b5cd05b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:57.748880 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46104b9c-0d55-45d0-a272-0f6b5cd05b2e admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:57.749565 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46104b9c-0d55-45d0-a272-0f6b5cd05b2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:57.753698 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46104b9c-0d55-45d0-a272-0f6b5cd05b2e admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:57.782930 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1402/2825] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:13:57 2022] POST /identity/v3/users => generated 298 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:13:57.786834 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4153314-61da-4583-8a45-06440e6c173c admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:57.803744 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4153314-61da-4583-8a45-06440e6c173c admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:57.815467 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0704a90-2da8-4e23-aa85-8ee8a56aa877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:57.816448 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0704a90-2da8-4e23-aa85-8ee8a56aa877 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:57.816901 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0704a90-2da8-4e23-aa85-8ee8a56aa877 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:57.817338 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0704a90-2da8-4e23-aa85-8ee8a56aa877 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:57.818224 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0704a90-2da8-4e23-aa85-8ee8a56aa877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:57.823012 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0704a90-2da8-4e23-aa85-8ee8a56aa877 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:57.837329 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1424/2826] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:13:57.841926 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46104b9c-0d55-45d0-a272-0f6b5cd05b2e admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:57.853570 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46104b9c-0d55-45d0-a272-0f6b5cd05b2e admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:57.858365 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087f91f-273f-4f37-9bc2-c3b810b9efe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:57.859139 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087f91f-273f-4f37-9bc2-c3b810b9efe2 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:57.859515 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087f91f-273f-4f37-9bc2-c3b810b9efe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:57.859960 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087f91f-273f-4f37-9bc2-c3b810b9efe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:57.860747 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1087f91f-273f-4f37-9bc2-c3b810b9efe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:57.862575 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1087f91f-273f-4f37-9bc2-c3b810b9efe2 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:57.874542 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1403/2827] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:13:57.878415 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0704a90-2da8-4e23-aa85-8ee8a56aa877 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:57.896215 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0704a90-2da8-4e23-aa85-8ee8a56aa877 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:57.901753 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0237aa1-bcef-43ff-8230-0b67f46bdc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:57.902693 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0237aa1-bcef-43ff-8230-0b67f46bdc9d admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:57.902964 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0237aa1-bcef-43ff-8230-0b67f46bdc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:57.903230 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0237aa1-bcef-43ff-8230-0b67f46bdc9d admin admin] PATH_INFO: `/v3/projects/4bb423a2e5f54fcf8a4ec337896d567b/users/44207abf08c24d53b4e572b32daac0dc/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:57.937258 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0237aa1-bcef-43ff-8230-0b67f46bdc9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bb423a2e5f54fcf8a4ec337896d567b, user_id=44207abf08c24d53b4e572b32daac0dc, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:57.940721 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0237aa1-bcef-43ff-8230-0b67f46bdc9d admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:57.970208 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1425/2828] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:13:57 2022] PUT /identity/v3/projects/4bb423a2e5f54fcf8a4ec337896d567b/users/44207abf08c24d53b4e572b32daac0dc/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:13:58.057506 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab9d99-fd70-4359-965d-959240841f20 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:58.057793 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab9d99-fd70-4359-965d-959240841f20 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:58.058070 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab9d99-fd70-4359-965d-959240841f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:58.108988 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-89ab9d99-fd70-4359-965d-959240841f20 None None] MFA Rules not processed for user `44207abf08c24d53b4e572b32daac0dc`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:13:58.111039 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-89ab9d99-fd70-4359-965d-959240841f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:58.203864 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1404/2829] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:13:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:13:58.217141 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0237aa1-bcef-43ff-8230-0b67f46bdc9d admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:13:58.220862 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-a0237aa1-bcef-43ff-8230-0b67f46bdc9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:13:58.322371 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0237aa1-bcef-43ff-8230-0b67f46bdc9d admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:13:58.328122 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08946d22-e86a-415e-997f-644e3e903d58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44248c51c2cb497b85a68dce0496a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:13:58.328721 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08946d22-e86a-415e-997f-644e3e903d58 service cinder] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:13:58.329070 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08946d22-e86a-415e-997f-644e3e903d58 service cinder] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:13:58.329455 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08946d22-e86a-415e-997f-644e3e903d58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:13:58.340424 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08946d22-e86a-415e-997f-644e3e903d58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:13:58.342806 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08946d22-e86a-415e-997f-644e3e903d58 service cinder] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:13:58.356914 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1426/2830] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:13:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:14:04.428603 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370d223-003e-43ef-a556-2a68577f7063 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:14:04.429079 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370d223-003e-43ef-a556-2a68577f7063 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:14:04.429180 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370d223-003e-43ef-a556-2a68577f7063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:14:04.450347 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-9370d223-003e-43ef-a556-2a68577f7063 None None] MFA Rules not processed for user `4bed3e6279424fa9b89c577041191a14`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:14:04.451560 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-9370d223-003e-43ef-a556-2a68577f7063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:14:04.509362 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1405/2831] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:14:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:14:06.322938 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40effd5-f5cb-47f1-ae99-a92ba6d834b3 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:14:06.323438 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40effd5-f5cb-47f1-ae99-a92ba6d834b3 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:14:06.323438 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40effd5-f5cb-47f1-ae99-a92ba6d834b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:14:06.343296 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-e40effd5-f5cb-47f1-ae99-a92ba6d834b3 None None] MFA Rules not processed for user `83115653901749f6ade6638593fb54e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:14:06.344614 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-e40effd5-f5cb-47f1-ae99-a92ba6d834b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:14:06.404074 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1427/2832] 10.222.0.32 () {58 vars in 1009 bytes} [Tue Apr 12 03:14:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:14:06.417539 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370d223-003e-43ef-a556-2a68577f7063 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:14:06.419082 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-9370d223-003e-43ef-a556-2a68577f7063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:14:06.491746 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370d223-003e-43ef-a556-2a68577f7063 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:14:06.498197 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976f31b-687f-4685-9739-ded512248853 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e8d78f92f12405fb746ddeb2579bd2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:14:06.498849 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976f31b-687f-4685-9739-ded512248853 service swift] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:14:06.499126 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976f31b-687f-4685-9739-ded512248853 service swift] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:14:06.499366 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976f31b-687f-4685-9739-ded512248853 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:14:06.508078 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976f31b-687f-4685-9739-ded512248853 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:14:06.509832 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976f31b-687f-4685-9739-ded512248853 service swift] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:14:06.521629 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1406/2833] 10.222.0.32 () {60 vars in 1384 bytes} [Tue Apr 12 03:14:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 12 03:14:06.686651 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40effd5-f5cb-47f1-ae99-a92ba6d834b3 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:14:06.836216 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40effd5-f5cb-47f1-ae99-a92ba6d834b3 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:14:06.848394 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49eb60-711d-4251-9d52-57a30183dcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:14:06.849314 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49eb60-711d-4251-9d52-57a30183dcf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:14:06.849585 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49eb60-711d-4251-9d52-57a30183dcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:14:06.849852 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49eb60-711d-4251-9d52-57a30183dcf9 admin admin] PATH_INFO: `/v3/users/44207abf08c24d53b4e572b32daac0dc` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:14:06.851075 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49eb60-711d-4251-9d52-57a30183dcf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44207abf08c24d53b4e572b32daac0dc)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:14:06.853895 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49eb60-711d-4251-9d52-57a30183dcf9 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:14:06.940817 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-1e49eb60-711d-4251-9d52-57a30183dcf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44207abf08c24d53b4e572b32daac0dc'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:14:06.959082 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-1e49eb60-711d-4251-9d52-57a30183dcf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44207abf08c24d53b4e572b32daac0dc'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:14:06.959856 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-1e49eb60-711d-4251-9d52-57a30183dcf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44207abf08c24d53b4e572b32daac0dc'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:14:06.960470 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-1e49eb60-711d-4251-9d52-57a30183dcf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44207abf08c24d53b4e572b32daac0dc'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:14:06.984922 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-1e49eb60-711d-4251-9d52-57a30183dcf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44207abf08c24d53b4e572b32daac0dc'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:14:07.006690 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1428/2834] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:14:06 2022] DELETE /identity/v3/users/44207abf08c24d53b4e572b32daac0dc => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:14:07.008141 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6087b50-2e5f-4d71-a3df-cd9481f1a305 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:14:07.008426 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6087b50-2e5f-4d71-a3df-cd9481f1a305 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:14:07.008695 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6087b50-2e5f-4d71-a3df-cd9481f1a305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:14:07.028411 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-b6087b50-2e5f-4d71-a3df-cd9481f1a305 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:14:07.029664 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-b6087b50-2e5f-4d71-a3df-cd9481f1a305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:14:07.134618 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1407/2835] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:14:07.141079 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49eb60-711d-4251-9d52-57a30183dcf9 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:14:07.142631 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-1e49eb60-711d-4251-9d52-57a30183dcf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:14:07.212743 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49eb60-711d-4251-9d52-57a30183dcf9 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:14:07.217251 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5d73e-7446-4869-8e98-1c64df08d6c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:14:07.218103 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5d73e-7446-4869-8e98-1c64df08d6c9 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:14:07.218385 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5d73e-7446-4869-8e98-1c64df08d6c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:14:07.218816 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5d73e-7446-4869-8e98-1c64df08d6c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:14:07.233991 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5d73e-7446-4869-8e98-1c64df08d6c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:14:07.236360 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5d73e-7446-4869-8e98-1c64df08d6c9 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:14:07.252030 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1429/2836] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:14:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:14:07.644549 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6087b50-2e5f-4d71-a3df-cd9481f1a305 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:14:07.649950 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-b6087b50-2e5f-4d71-a3df-cd9481f1a305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:14:07.663288 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6087b50-2e5f-4d71-a3df-cd9481f1a305 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:14:07.668615 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529a004-aefe-45c1-8fc4-87c48e1a432d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:14:07.669653 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529a004-aefe-45c1-8fc4-87c48e1a432d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:14:07.669994 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529a004-aefe-45c1-8fc4-87c48e1a432d admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:14:07.670332 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529a004-aefe-45c1-8fc4-87c48e1a432d admin admin] PATH_INFO: `/v3/projects/4bb423a2e5f54fcf8a4ec337896d567b` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:14:07.672336 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3529a004-aefe-45c1-8fc4-87c48e1a432d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bb423a2e5f54fcf8a4ec337896d567b)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:14:07.676230 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3529a004-aefe-45c1-8fc4-87c48e1a432d admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:14:07.740800 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3529a004-aefe-45c1-8fc4-87c48e1a432d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bb423a2e5f54fcf8a4ec337896d567b', 'request_id': 'req-3529a004-aefe-45c1-8fc4-87c48e1a432d'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:14:07.756056 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3529a004-aefe-45c1-8fc4-87c48e1a432d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bb423a2e5f54fcf8a4ec337896d567b', 'request_id': 'req-3529a004-aefe-45c1-8fc4-87c48e1a432d'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:14:07.765170 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3529a004-aefe-45c1-8fc4-87c48e1a432d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bb423a2e5f54fcf8a4ec337896d567b', 'request_id': 'req-3529a004-aefe-45c1-8fc4-87c48e1a432d'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:14:07.779013 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3529a004-aefe-45c1-8fc4-87c48e1a432d admin admin] The token cache is being invalidate because project 4bb423a2e5f54fcf8a4ec337896d567b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:14:07.779302 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3529a004-aefe-45c1-8fc4-87c48e1a432d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:14:07.779952 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-3529a004-aefe-45c1-8fc4-87c48e1a432d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:14:07.791654 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1408/2837] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:14:07 2022] DELETE /identity/v3/projects/4bb423a2e5f54fcf8a4ec337896d567b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:14:33.169802 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5d73e-7446-4869-8e98-1c64df08d6c9 service neutron] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:14:33.182733 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5d73e-7446-4869-8e98-1c64df08d6c9 service neutron] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:14:33.238591 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebaef31-c512-4324-b7e1-09ef3103d517 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:14:33.239230 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebaef31-c512-4324-b7e1-09ef3103d517 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:14:33.239500 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebaef31-c512-4324-b7e1-09ef3103d517 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:14:33.239820 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebaef31-c512-4324-b7e1-09ef3103d517 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:14:33.241663 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-3ebaef31-c512-4324-b7e1-09ef3103d517 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:14:33.306499 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebaef31-c512-4324-b7e1-09ef3103d517 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:14:33.307974 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebaef31-c512-4324-b7e1-09ef3103d517 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:14:33.318910 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1430/2838] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:14:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:15:00.071479 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529a004-aefe-45c1-8fc4-87c48e1a432d admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:15:00.072962 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-3529a004-aefe-45c1-8fc4-87c48e1a432d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:15:00.086348 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529a004-aefe-45c1-8fc4-87c48e1a432d admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:15:00.090401 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f48de-e4dc-49f4-a8ae-220ec6c4c14d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:15:00.091055 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f48de-e4dc-49f4-a8ae-220ec6c4c14d service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:15:00.091357 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f48de-e4dc-49f4-a8ae-220ec6c4c14d service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:15:00.091618 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f48de-e4dc-49f4-a8ae-220ec6c4c14d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:15:00.093570 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-790f48de-e4dc-49f4-a8ae-220ec6c4c14d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:15:00.167809 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f48de-e4dc-49f4-a8ae-220ec6c4c14d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:15:00.169173 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f48de-e4dc-49f4-a8ae-220ec6c4c14d service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:15:00.180756 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1409/2839] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:15:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:15:01.461444 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebaef31-c512-4324-b7e1-09ef3103d517 service neutron] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:15:01.463557 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-3ebaef31-c512-4324-b7e1-09ef3103d517 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:15:01.477091 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebaef31-c512-4324-b7e1-09ef3103d517 service neutron] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:15:01.482823 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27856f4f-2330-4504-be61-5c4673e022ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:15:01.483674 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27856f4f-2330-4504-be61-5c4673e022ca service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:15:01.484030 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27856f4f-2330-4504-be61-5c4673e022ca service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:15:01.484379 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27856f4f-2330-4504-be61-5c4673e022ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:15:01.486765 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-27856f4f-2330-4504-be61-5c4673e022ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:15:01.506018 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27856f4f-2330-4504-be61-5c4673e022ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:15:01.507442 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27856f4f-2330-4504-be61-5c4673e022ca service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:15:01.519906 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1431/2840] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:15:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:15:22.427528 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f48de-e4dc-49f4-a8ae-220ec6c4c14d service neutron] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:15:22.437101 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f48de-e4dc-49f4-a8ae-220ec6c4c14d service neutron] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:15:22.442789 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4e0b2-613d-4c53-be48-418abc8961f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:15:22.444371 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4e0b2-613d-4c53-be48-418abc8961f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:15:22.444952 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4e0b2-613d-4c53-be48-418abc8961f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:15:22.445389 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4e0b2-613d-4c53-be48-418abc8961f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:15:22.448320 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-56e4e0b2-613d-4c53-be48-418abc8961f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:15:22.461356 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4e0b2-613d-4c53-be48-418abc8961f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:15:22.462246 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4e0b2-613d-4c53-be48-418abc8961f1 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:15:22.471379 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1410/2841] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:15:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:15:34.775949 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27856f4f-2330-4504-be61-5c4673e022ca service neutron] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:15:34.785324 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27856f4f-2330-4504-be61-5c4673e022ca service neutron] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:15:34.789154 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da360e89-6fac-454c-ab0a-dadff7a5185a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:15:34.789796 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da360e89-6fac-454c-ab0a-dadff7a5185a service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:15:34.790074 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da360e89-6fac-454c-ab0a-dadff7a5185a service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:15:34.790347 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da360e89-6fac-454c-ab0a-dadff7a5185a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:15:34.792305 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-da360e89-6fac-454c-ab0a-dadff7a5185a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:15:34.856892 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da360e89-6fac-454c-ab0a-dadff7a5185a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:15:34.858339 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da360e89-6fac-454c-ab0a-dadff7a5185a service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:15:34.868565 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1432/2842] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:15:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:15:41.674257 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4e0b2-613d-4c53-be48-418abc8961f1 service neutron] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:15:41.675969 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-56e4e0b2-613d-4c53-be48-418abc8961f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:15:41.691757 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4e0b2-613d-4c53-be48-418abc8961f1 service neutron] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:15:41.697682 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ffc4c-701c-4c76-8536-6101d0efed54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:15:41.698751 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ffc4c-701c-4c76-8536-6101d0efed54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:15:41.699120 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ffc4c-701c-4c76-8536-6101d0efed54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:15:41.699790 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ffc4c-701c-4c76-8536-6101d0efed54 admin admin] PATH_INFO: `/v3/users/157ff7b3ca7b4af69a47cc36b0d1917a` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:15:41.701184 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ffc4c-701c-4c76-8536-6101d0efed54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=157ff7b3ca7b4af69a47cc36b0d1917a)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:15:41.703192 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ffc4c-701c-4c76-8536-6101d0efed54 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:15:41.751549 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-5d0ffc4c-701c-4c76-8536-6101d0efed54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '157ff7b3ca7b4af69a47cc36b0d1917a'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:15:41.752320 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-5d0ffc4c-701c-4c76-8536-6101d0efed54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '157ff7b3ca7b4af69a47cc36b0d1917a'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:15:41.770975 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-5d0ffc4c-701c-4c76-8536-6101d0efed54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '157ff7b3ca7b4af69a47cc36b0d1917a'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:15:41.771710 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-5d0ffc4c-701c-4c76-8536-6101d0efed54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '157ff7b3ca7b4af69a47cc36b0d1917a'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:15:41.779446 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-5d0ffc4c-701c-4c76-8536-6101d0efed54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '157ff7b3ca7b4af69a47cc36b0d1917a'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:15:41.793563 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1411/2843] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:15:41 2022] DELETE /identity/v3/users/157ff7b3ca7b4af69a47cc36b0d1917a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:15:41.971088 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da360e89-6fac-454c-ab0a-dadff7a5185a service neutron] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:15:41.985281 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da360e89-6fac-454c-ab0a-dadff7a5185a service neutron] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:15:42.048901 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af851e-748c-4e72-b530-6efffc01870d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:15:42.049761 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af851e-748c-4e72-b530-6efffc01870d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:15:42.050036 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af851e-748c-4e72-b530-6efffc01870d admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:15:42.050303 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af851e-748c-4e72-b530-6efffc01870d admin admin] PATH_INFO: `/v3/projects/faa0847777334640bf8854a96c6e7a19` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:15:42.051457 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af851e-748c-4e72-b530-6efffc01870d admin admin] RBAC: Authorizing `identity:delete_project(project_id=faa0847777334640bf8854a96c6e7a19)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:15:42.053374 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af851e-748c-4e72-b530-6efffc01870d admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:15:42.098687 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-61af851e-748c-4e72-b530-6efffc01870d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faa0847777334640bf8854a96c6e7a19', 'request_id': 'req-61af851e-748c-4e72-b530-6efffc01870d'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:15:42.106761 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-61af851e-748c-4e72-b530-6efffc01870d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faa0847777334640bf8854a96c6e7a19', 'request_id': 'req-61af851e-748c-4e72-b530-6efffc01870d'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:15:42.113019 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-61af851e-748c-4e72-b530-6efffc01870d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faa0847777334640bf8854a96c6e7a19', 'request_id': 'req-61af851e-748c-4e72-b530-6efffc01870d'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:15:42.122739 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-61af851e-748c-4e72-b530-6efffc01870d admin admin] The token cache is being invalidate because project faa0847777334640bf8854a96c6e7a19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:15:42.123031 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-61af851e-748c-4e72-b530-6efffc01870d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:15:42.123666 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-61af851e-748c-4e72-b530-6efffc01870d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:15:42.125261 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1433/2844] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:15:41 2022] DELETE /identity/v3/projects/faa0847777334640bf8854a96c6e7a19 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:15:42.129239 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ffc4c-701c-4c76-8536-6101d0efed54 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:15:42.130606 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-5d0ffc4c-701c-4c76-8536-6101d0efed54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:15:42.143323 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ffc4c-701c-4c76-8536-6101d0efed54 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:15:42.198975 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee52f0c-161e-4c0a-9f9d-16861e614d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:15:42.200216 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee52f0c-161e-4c0a-9f9d-16861e614d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:15:42.200484 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee52f0c-161e-4c0a-9f9d-16861e614d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:15:42.200745 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee52f0c-161e-4c0a-9f9d-16861e614d20 admin admin] PATH_INFO: `/v3/users/f63f3414b5a940678abb60201d8fb9f7` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:15:42.201947 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee52f0c-161e-4c0a-9f9d-16861e614d20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f63f3414b5a940678abb60201d8fb9f7)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:15:42.203983 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee52f0c-161e-4c0a-9f9d-16861e614d20 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:15:42.250417 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-8ee52f0c-161e-4c0a-9f9d-16861e614d20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f63f3414b5a940678abb60201d8fb9f7'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:15:42.251047 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-8ee52f0c-161e-4c0a-9f9d-16861e614d20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f63f3414b5a940678abb60201d8fb9f7'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:15:42.263452 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-8ee52f0c-161e-4c0a-9f9d-16861e614d20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f63f3414b5a940678abb60201d8fb9f7'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:15:42.264286 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-8ee52f0c-161e-4c0a-9f9d-16861e614d20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f63f3414b5a940678abb60201d8fb9f7'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:15:42.271490 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-8ee52f0c-161e-4c0a-9f9d-16861e614d20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f63f3414b5a940678abb60201d8fb9f7'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:15:42.289414 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1412/2845] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:15:42 2022] DELETE /identity/v3/users/f63f3414b5a940678abb60201d8fb9f7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:15:42.464643 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af851e-748c-4e72-b530-6efffc01870d admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:15:42.466120 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-61af851e-748c-4e72-b530-6efffc01870d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:15:42.479611 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af851e-748c-4e72-b530-6efffc01870d admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:15:42.544190 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06906776-9bf8-4132-b7e1-1e77de637332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:15:42.545056 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06906776-9bf8-4132-b7e1-1e77de637332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:15:42.545330 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06906776-9bf8-4132-b7e1-1e77de637332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:15:42.545594 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06906776-9bf8-4132-b7e1-1e77de637332 admin admin] PATH_INFO: `/v3/projects/4290d39f5f214ceaa74062aeea829938` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:15:42.546784 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06906776-9bf8-4132-b7e1-1e77de637332 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4290d39f5f214ceaa74062aeea829938)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:15:42.548738 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06906776-9bf8-4132-b7e1-1e77de637332 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:15:42.604822 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-06906776-9bf8-4132-b7e1-1e77de637332 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4290d39f5f214ceaa74062aeea829938', 'request_id': 'req-06906776-9bf8-4132-b7e1-1e77de637332'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:15:42.614735 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-06906776-9bf8-4132-b7e1-1e77de637332 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4290d39f5f214ceaa74062aeea829938', 'request_id': 'req-06906776-9bf8-4132-b7e1-1e77de637332'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:15:42.621185 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-06906776-9bf8-4132-b7e1-1e77de637332 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4290d39f5f214ceaa74062aeea829938', 'request_id': 'req-06906776-9bf8-4132-b7e1-1e77de637332'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:15:42.632230 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-06906776-9bf8-4132-b7e1-1e77de637332 admin admin] The token cache is being invalidate because project 4290d39f5f214ceaa74062aeea829938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:15:42.632506 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-06906776-9bf8-4132-b7e1-1e77de637332 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:15:42.633255 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-06906776-9bf8-4132-b7e1-1e77de637332 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:15:42.634844 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1434/2846] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:15:42 2022] DELETE /identity/v3/projects/4290d39f5f214ceaa74062aeea829938 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:15:57.544041 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51219cd-6484-4fac-9720-e48ddf485493 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:15:57.544582 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51219cd-6484-4fac-9720-e48ddf485493 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:15:57.544582 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51219cd-6484-4fac-9720-e48ddf485493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:15:57.563290 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-d51219cd-6484-4fac-9720-e48ddf485493 None None] MFA Rules not processed for user `83115653901749f6ade6638593fb54e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:15:57.564524 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-d51219cd-6484-4fac-9720-e48ddf485493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:15:57.619659 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1413/2847] 10.222.0.32 () {58 vars in 967 bytes} [Tue Apr 12 03:15:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:15:57.661042 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06906776-9bf8-4132-b7e1-1e77de637332 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:15:57.662674 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-06906776-9bf8-4132-b7e1-1e77de637332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:15:57.732206 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06906776-9bf8-4132-b7e1-1e77de637332 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:15:57.737720 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677214e-ca66-4714-b946-826357c5d03b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e8d78f92f12405fb746ddeb2579bd2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:15:57.738361 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677214e-ca66-4714-b946-826357c5d03b service swift] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:15:57.738636 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677214e-ca66-4714-b946-826357c5d03b service swift] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:15:57.738900 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677214e-ca66-4714-b946-826357c5d03b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:15:57.747285 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677214e-ca66-4714-b946-826357c5d03b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:15:57.748910 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677214e-ca66-4714-b946-826357c5d03b service swift] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:15:57.756843 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1435/2848] 10.222.0.32 () {60 vars in 1384 bytes} [Tue Apr 12 03:15:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 03:16:04.493728 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51219cd-6484-4fac-9720-e48ddf485493 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:16:04.495519 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-d51219cd-6484-4fac-9720-e48ddf485493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:16:04.562161 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51219cd-6484-4fac-9720-e48ddf485493 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:16:04.566752 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d48b22-563b-4412-aac1-cfc48d6bf977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:16:04.567610 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d48b22-563b-4412-aac1-cfc48d6bf977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:16:04.567923 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d48b22-563b-4412-aac1-cfc48d6bf977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:16:04.568190 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d48b22-563b-4412-aac1-cfc48d6bf977 admin admin] PATH_INFO: `/v3/users/4bed3e6279424fa9b89c577041191a14` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:16:04.569383 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d48b22-563b-4412-aac1-cfc48d6bf977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bed3e6279424fa9b89c577041191a14)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:16:04.571320 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d48b22-563b-4412-aac1-cfc48d6bf977 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:16:04.623481 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-82d48b22-563b-4412-aac1-cfc48d6bf977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bed3e6279424fa9b89c577041191a14'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:16:04.624228 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-82d48b22-563b-4412-aac1-cfc48d6bf977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bed3e6279424fa9b89c577041191a14'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:16:04.635934 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-82d48b22-563b-4412-aac1-cfc48d6bf977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bed3e6279424fa9b89c577041191a14'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:16:04.636564 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-82d48b22-563b-4412-aac1-cfc48d6bf977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bed3e6279424fa9b89c577041191a14'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:16:04.643457 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-82d48b22-563b-4412-aac1-cfc48d6bf977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bed3e6279424fa9b89c577041191a14'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:16:04.658409 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1414/2849] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:16:04 2022] DELETE /identity/v3/users/4bed3e6279424fa9b89c577041191a14 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:16:04.846915 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677214e-ca66-4714-b946-826357c5d03b service swift] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:16:04.859578 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677214e-ca66-4714-b946-826357c5d03b service swift] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:16:04.917922 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73331d3-98bb-4672-9411-f8e38a35b550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:16:04.918785 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73331d3-98bb-4672-9411-f8e38a35b550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:16:04.919164 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73331d3-98bb-4672-9411-f8e38a35b550 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:16:04.919368 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73331d3-98bb-4672-9411-f8e38a35b550 admin admin] PATH_INFO: `/v3/projects/f1dd2028f6f24f21be7d88a9ff3e7ae5` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:16:04.920590 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73331d3-98bb-4672-9411-f8e38a35b550 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1dd2028f6f24f21be7d88a9ff3e7ae5)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:16:04.922579 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73331d3-98bb-4672-9411-f8e38a35b550 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:16:04.970052 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a73331d3-98bb-4672-9411-f8e38a35b550 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1dd2028f6f24f21be7d88a9ff3e7ae5', 'request_id': 'req-a73331d3-98bb-4672-9411-f8e38a35b550'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:16:04.977990 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a73331d3-98bb-4672-9411-f8e38a35b550 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1dd2028f6f24f21be7d88a9ff3e7ae5', 'request_id': 'req-a73331d3-98bb-4672-9411-f8e38a35b550'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:16:04.984462 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a73331d3-98bb-4672-9411-f8e38a35b550 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1dd2028f6f24f21be7d88a9ff3e7ae5', 'request_id': 'req-a73331d3-98bb-4672-9411-f8e38a35b550'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:16:04.995152 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a73331d3-98bb-4672-9411-f8e38a35b550 admin admin] The token cache is being invalidate because project f1dd2028f6f24f21be7d88a9ff3e7ae5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:16:04.995427 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a73331d3-98bb-4672-9411-f8e38a35b550 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:16:04.996192 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-a73331d3-98bb-4672-9411-f8e38a35b550 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:16:04.997917 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1436/2850] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:16:04 2022] DELETE /identity/v3/projects/f1dd2028f6f24f21be7d88a9ff3e7ae5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:16:05.002208 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d48b22-563b-4412-aac1-cfc48d6bf977 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:16:05.003642 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-82d48b22-563b-4412-aac1-cfc48d6bf977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:16:05.017190 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d48b22-563b-4412-aac1-cfc48d6bf977 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:16:05.084175 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aecf8e-413e-409d-9727-b5ac74285a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:16:05.085463 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aecf8e-413e-409d-9727-b5ac74285a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:16:05.085767 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aecf8e-413e-409d-9727-b5ac74285a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:16:05.086078 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aecf8e-413e-409d-9727-b5ac74285a0b admin admin] PATH_INFO: `/v3/users/efb5cc68d27e41efaecc54cc1a16206c` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:16:05.088096 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aecf8e-413e-409d-9727-b5ac74285a0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=efb5cc68d27e41efaecc54cc1a16206c)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:16:05.091138 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aecf8e-413e-409d-9727-b5ac74285a0b admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:16:05.156719 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-a7aecf8e-413e-409d-9727-b5ac74285a0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efb5cc68d27e41efaecc54cc1a16206c'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:16:05.157464 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-a7aecf8e-413e-409d-9727-b5ac74285a0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efb5cc68d27e41efaecc54cc1a16206c'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:16:05.170681 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-a7aecf8e-413e-409d-9727-b5ac74285a0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efb5cc68d27e41efaecc54cc1a16206c'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:16:05.171400 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-a7aecf8e-413e-409d-9727-b5ac74285a0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efb5cc68d27e41efaecc54cc1a16206c'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:16:05.178250 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-a7aecf8e-413e-409d-9727-b5ac74285a0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efb5cc68d27e41efaecc54cc1a16206c'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:16:05.193668 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1415/2851] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:16:05 2022] DELETE /identity/v3/users/efb5cc68d27e41efaecc54cc1a16206c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:16:05.398432 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73331d3-98bb-4672-9411-f8e38a35b550 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:16:05.400682 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-a73331d3-98bb-4672-9411-f8e38a35b550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:16:05.416265 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73331d3-98bb-4672-9411-f8e38a35b550 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:16:05.471544 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904c3eb-3c56-4f58-b3f8-67d65767b710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:16:05.472431 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904c3eb-3c56-4f58-b3f8-67d65767b710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:16:05.472702 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904c3eb-3c56-4f58-b3f8-67d65767b710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:16:05.472968 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904c3eb-3c56-4f58-b3f8-67d65767b710 admin admin] PATH_INFO: `/v3/projects/476d54f083c54f89b7b0de86d9f68238` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:16:05.474189 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904c3eb-3c56-4f58-b3f8-67d65767b710 admin admin] RBAC: Authorizing `identity:delete_project(project_id=476d54f083c54f89b7b0de86d9f68238)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:16:05.476114 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904c3eb-3c56-4f58-b3f8-67d65767b710 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:16:05.526623 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-e904c3eb-3c56-4f58-b3f8-67d65767b710 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '476d54f083c54f89b7b0de86d9f68238', 'request_id': 'req-e904c3eb-3c56-4f58-b3f8-67d65767b710'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:16:05.535049 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-e904c3eb-3c56-4f58-b3f8-67d65767b710 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '476d54f083c54f89b7b0de86d9f68238', 'request_id': 'req-e904c3eb-3c56-4f58-b3f8-67d65767b710'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:16:05.541598 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-e904c3eb-3c56-4f58-b3f8-67d65767b710 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '476d54f083c54f89b7b0de86d9f68238', 'request_id': 'req-e904c3eb-3c56-4f58-b3f8-67d65767b710'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:16:05.553840 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-e904c3eb-3c56-4f58-b3f8-67d65767b710 admin admin] The token cache is being invalidate because project 476d54f083c54f89b7b0de86d9f68238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79724) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:16:05.554021 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-e904c3eb-3c56-4f58-b3f8-67d65767b710 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:16:05.554628 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-e904c3eb-3c56-4f58-b3f8-67d65767b710 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:16:05.556249 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1437/2852] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:16:05 2022] DELETE /identity/v3/projects/476d54f083c54f89b7b0de86d9f68238 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:16:05.561539 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538c3d7-5022-4d3d-a453-a7c8a2ab86ff None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:16:05.562059 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538c3d7-5022-4d3d-a453-a7c8a2ab86ff None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:16:05.562059 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538c3d7-5022-4d3d-a453-a7c8a2ab86ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:16:05.581875 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-8538c3d7-5022-4d3d-a453-a7c8a2ab86ff None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:16:05.583047 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-8538c3d7-5022-4d3d-a453-a7c8a2ab86ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:16:05.644160 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1416/2853] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:16:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:16:05.651668 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3699a6-7162-4df6-8330-8d32b76775d5 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:16:05.651977 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3699a6-7162-4df6-8330-8d32b76775d5 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:16:05.652248 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3699a6-7162-4df6-8330-8d32b76775d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:16:05.671167 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-4d3699a6-7162-4df6-8330-8d32b76775d5 None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:16:05.672378 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-4d3699a6-7162-4df6-8330-8d32b76775d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:16:05.681373 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1438/2854] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:16:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:16:05.685959 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538c3d7-5022-4d3d-a453-a7c8a2ab86ff None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:16:05.695976 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538c3d7-5022-4d3d-a453-a7c8a2ab86ff None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:16:05.702225 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e685f05-c37b-4f40-a224-951f6e1dd53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:16:05.702877 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e685f05-c37b-4f40-a224-951f6e1dd53f admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:16:05.703139 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e685f05-c37b-4f40-a224-951f6e1dd53f admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:16:05.703418 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e685f05-c37b-4f40-a224-951f6e1dd53f admin admin] PATH_INFO: `/v3/domains` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:16:05.704163 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e685f05-c37b-4f40-a224-951f6e1dd53f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 03:16:05.704461 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e685f05-c37b-4f40-a224-951f6e1dd53f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:16:05.706062 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e685f05-c37b-4f40-a224-951f6e1dd53f admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:16:05.717620 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1417/2855] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 03:16:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 03:16:05.722056 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3699a6-7162-4df6-8330-8d32b76775d5 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:16:05.731272 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3699a6-7162-4df6-8330-8d32b76775d5 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:16:05.736601 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac22d05-e037-4711-ab8e-947ada5df626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:16:05.737247 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac22d05-e037-4711-ab8e-947ada5df626 admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:16:05.737515 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac22d05-e037-4711-ab8e-947ada5df626 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:16:05.737777 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac22d05-e037-4711-ab8e-947ada5df626 admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:16:05.738465 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac22d05-e037-4711-ab8e-947ada5df626 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:16:05.740391 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac22d05-e037-4711-ab8e-947ada5df626 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:16:05.765811 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1439/2856] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:16:05 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:16:05.772300 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e685f05-c37b-4f40-a224-951f6e1dd53f admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:16:05.787575 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e685f05-c37b-4f40-a224-951f6e1dd53f admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:16:05.849216 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12e3a8-b054-4c6b-9fdf-5b31719896de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:16:05.849801 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12e3a8-b054-4c6b-9fdf-5b31719896de admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:16:05.850074 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12e3a8-b054-4c6b-9fdf-5b31719896de admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:16:05.850341 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12e3a8-b054-4c6b-9fdf-5b31719896de admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:16:05.851008 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12e3a8-b054-4c6b-9fdf-5b31719896de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:16:05.852975 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12e3a8-b054-4c6b-9fdf-5b31719896de admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:16:05.872589 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1418/2857] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:16:05 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:16:05.876662 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac22d05-e037-4711-ab8e-947ada5df626 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:16:05.888796 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac22d05-e037-4711-ab8e-947ada5df626 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:16:05.894440 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269b2cc-6e50-49db-ac9b-d682225b2008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:16:05.895113 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269b2cc-6e50-49db-ac9b-d682225b2008 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:16:05.895392 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269b2cc-6e50-49db-ac9b-d682225b2008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:16:05.895662 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269b2cc-6e50-49db-ac9b-d682225b2008 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:16:05.896434 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269b2cc-6e50-49db-ac9b-d682225b2008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:16:05.898040 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269b2cc-6e50-49db-ac9b-d682225b2008 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:16:05.908831 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1440/2858] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:16:05.912879 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12e3a8-b054-4c6b-9fdf-5b31719896de admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:16:05.923277 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12e3a8-b054-4c6b-9fdf-5b31719896de admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:16:05.928861 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fb4c1-6062-4214-9e32-2eaf0dce4253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:16:05.929535 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fb4c1-6062-4214-9e32-2eaf0dce4253 admin admin] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:16:05.929813 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fb4c1-6062-4214-9e32-2eaf0dce4253 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:16:05.930078 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fb4c1-6062-4214-9e32-2eaf0dce4253 admin admin] PATH_INFO: `/v3/roles` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:16:05.930803 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22fb4c1-6062-4214-9e32-2eaf0dce4253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:16:05.932460 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22fb4c1-6062-4214-9e32-2eaf0dce4253 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:16:05.942594 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1419/2859] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 03:16:05.946979 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269b2cc-6e50-49db-ac9b-d682225b2008 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:16:05.957923 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269b2cc-6e50-49db-ac9b-d682225b2008 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:16:05.963699 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd7546-3e17-422b-aa3f-f01fbe2c9aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:16:05.964598 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd7546-3e17-422b-aa3f-f01fbe2c9aa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:16:05.964891 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd7546-3e17-422b-aa3f-f01fbe2c9aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:16:05.965136 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd7546-3e17-422b-aa3f-f01fbe2c9aa9 admin admin] PATH_INFO: `/v3/projects/e6abe79952f3490e8b90f1cedddb3821/users/d911cacdbc354f1bbdf20d48b00a44a2/roles/0a31c1ce37fa41deb4908731f772414b` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:16:05.980543 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd7546-3e17-422b-aa3f-f01fbe2c9aa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6abe79952f3490e8b90f1cedddb3821, user_id=d911cacdbc354f1bbdf20d48b00a44a2, role_id=0a31c1ce37fa41deb4908731f772414b)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:16:05.983193 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd7546-3e17-422b-aa3f-f01fbe2c9aa9 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:16:05.997272 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1441/2860] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:16:05 2022] PUT /identity/v3/projects/e6abe79952f3490e8b90f1cedddb3821/users/d911cacdbc354f1bbdf20d48b00a44a2/roles/0a31c1ce37fa41deb4908731f772414b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:16:06.002514 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55549038-af48-4a26-adf3-5ef7046a0aca None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:16:06.002795 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55549038-af48-4a26-adf3-5ef7046a0aca None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:16:06.003064 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55549038-af48-4a26-adf3-5ef7046a0aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:16:06.020892 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-55549038-af48-4a26-adf3-5ef7046a0aca None None] MFA Rules not processed for user `99e456857e814b9bb8e2717b9f3a9a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:16:06.022095 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-55549038-af48-4a26-adf3-5ef7046a0aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:16:06.097874 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1420/2861] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:16:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:16:06.108060 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd7546-3e17-422b-aa3f-f01fbe2c9aa9 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:16:06.110492 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-99dd7546-3e17-422b-aa3f-f01fbe2c9aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:16:06.173341 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd7546-3e17-422b-aa3f-f01fbe2c9aa9 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:16:06.177762 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e43694-ef1d-4f9c-ac1a-049ba301f537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:16:06.178409 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e43694-ef1d-4f9c-ac1a-049ba301f537 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:16:06.178684 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e43694-ef1d-4f9c-ac1a-049ba301f537 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:16:06.178953 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e43694-ef1d-4f9c-ac1a-049ba301f537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:16:06.189119 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e43694-ef1d-4f9c-ac1a-049ba301f537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:16:06.190554 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e43694-ef1d-4f9c-ac1a-049ba301f537 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:16:06.204002 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1442/2862] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:16:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:16:10.243374 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ecd20-8ddd-47e3-943c-aee4b38036fb None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:16:10.243897 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ecd20-8ddd-47e3-943c-aee4b38036fb None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:16:10.244019 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ecd20-8ddd-47e3-943c-aee4b38036fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:16:10.273702 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-b24ecd20-8ddd-47e3-943c-aee4b38036fb None None] MFA Rules not processed for user `d911cacdbc354f1bbdf20d48b00a44a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:16:10.274821 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-b24ecd20-8ddd-47e3-943c-aee4b38036fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:16:10.346975 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1421/2863] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:16:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:16:10.351551 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e43694-ef1d-4f9c-ac1a-049ba301f537 service neutron] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:16:10.361543 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e43694-ef1d-4f9c-ac1a-049ba301f537 service neutron] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:16:10.366181 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c4c4e-7c29-4e17-a936-bcf2bfa526eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:16:10.366853 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c4c4e-7c29-4e17-a936-bcf2bfa526eb admin admin] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:16:10.367123 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c4c4e-7c29-4e17-a936-bcf2bfa526eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:16:10.367384 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c4c4e-7c29-4e17-a936-bcf2bfa526eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:16:10.368097 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c4c4e-7c29-4e17-a936-bcf2bfa526eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:16:10.370000 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c4c4e-7c29-4e17-a936-bcf2bfa526eb admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:16:10.397493 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1443/2864] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 03:16:10 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 03:16:10.401403 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ecd20-8ddd-47e3-943c-aee4b38036fb None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:16:10.413061 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ecd20-8ddd-47e3-943c-aee4b38036fb None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:16:10.470635 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5862c3-98c0-4f5f-9c68-e2217929d2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:16:10.471325 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5862c3-98c0-4f5f-9c68-e2217929d2e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:16:10.471587 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5862c3-98c0-4f5f-9c68-e2217929d2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:16:10.471888 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5862c3-98c0-4f5f-9c68-e2217929d2e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:16:10.472583 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5862c3-98c0-4f5f-9c68-e2217929d2e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:16:10.474567 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5862c3-98c0-4f5f-9c68-e2217929d2e1 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:16:10.495587 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1422/2865] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 03:16:10 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 03:16:10.499964 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c4c4e-7c29-4e17-a936-bcf2bfa526eb admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:16:10.510338 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c4c4e-7c29-4e17-a936-bcf2bfa526eb admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:16:10.515304 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a07510-9503-43c5-aee0-2a53a4a7c149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:16:10.516203 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a07510-9503-43c5-aee0-2a53a4a7c149 admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:16:10.516469 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a07510-9503-43c5-aee0-2a53a4a7c149 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:16:10.516882 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a07510-9503-43c5-aee0-2a53a4a7c149 admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:16:10.517616 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a07510-9503-43c5-aee0-2a53a4a7c149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:16:10.519301 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a07510-9503-43c5-aee0-2a53a4a7c149 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:16:10.530781 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1444/2866] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:16:10.535050 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5862c3-98c0-4f5f-9c68-e2217929d2e1 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:16:10.545283 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5862c3-98c0-4f5f-9c68-e2217929d2e1 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:16:10.550152 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c005be0-7020-40b6-bb77-4d4bbfdbc18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:16:10.551138 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c005be0-7020-40b6-bb77-4d4bbfdbc18b admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:16:10.551468 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c005be0-7020-40b6-bb77-4d4bbfdbc18b admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:16:10.551893 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c005be0-7020-40b6-bb77-4d4bbfdbc18b admin admin] PATH_INFO: `/v3/projects/4baa9a4306cf431683b838a9d9e4062e/users/19ee45e0e0e142ce9bcd7151e5fa0664/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:16:10.568336 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c005be0-7020-40b6-bb77-4d4bbfdbc18b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4baa9a4306cf431683b838a9d9e4062e, user_id=19ee45e0e0e142ce9bcd7151e5fa0664, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:16:10.571340 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c005be0-7020-40b6-bb77-4d4bbfdbc18b admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:16:10.586460 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1423/2867] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:16:10 2022] PUT /identity/v3/projects/4baa9a4306cf431683b838a9d9e4062e/users/19ee45e0e0e142ce9bcd7151e5fa0664/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:16:10.590311 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a07510-9503-43c5-aee0-2a53a4a7c149 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:16:10.600907 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a07510-9503-43c5-aee0-2a53a4a7c149 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:16:10.657126 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80188f14-f8a3-43b0-a3b7-763f3ada7f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:16:10.657795 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80188f14-f8a3-43b0-a3b7-763f3ada7f5b admin admin] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:16:10.658068 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80188f14-f8a3-43b0-a3b7-763f3ada7f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:16:10.658327 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80188f14-f8a3-43b0-a3b7-763f3ada7f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:16:10.659020 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80188f14-f8a3-43b0-a3b7-763f3ada7f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:16:10.660676 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80188f14-f8a3-43b0-a3b7-763f3ada7f5b admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:16:10.670850 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1445/2868] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 03:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 03:16:10.675267 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c005be0-7020-40b6-bb77-4d4bbfdbc18b admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:16:10.685987 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c005be0-7020-40b6-bb77-4d4bbfdbc18b admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:16:10.691090 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9b337-66d7-4711-8fce-94716b9cf4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:16:10.692019 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9b337-66d7-4711-8fce-94716b9cf4e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:16:10.692294 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9b337-66d7-4711-8fce-94716b9cf4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:16:10.692561 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9b337-66d7-4711-8fce-94716b9cf4e6 admin admin] PATH_INFO: `/v3/projects/4baa9a4306cf431683b838a9d9e4062e/users/19ee45e0e0e142ce9bcd7151e5fa0664/roles/c0f19d3800f44637822d5162ffe4b497` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:16:10.694575 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe9b337-66d7-4711-8fce-94716b9cf4e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4baa9a4306cf431683b838a9d9e4062e, user_id=19ee45e0e0e142ce9bcd7151e5fa0664, role_id=c0f19d3800f44637822d5162ffe4b497)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:16:10.697284 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe9b337-66d7-4711-8fce-94716b9cf4e6 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:16:10.712060 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1424/2869] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 03:16:10 2022] PUT /identity/v3/projects/4baa9a4306cf431683b838a9d9e4062e/users/19ee45e0e0e142ce9bcd7151e5fa0664/roles/c0f19d3800f44637822d5162ffe4b497 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:16:15.069696 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6230bda-f9ff-4d5a-942a-4f8578fb356d None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:16:15.070249 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6230bda-f9ff-4d5a-942a-4f8578fb356d None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:16:15.070363 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6230bda-f9ff-4d5a-942a-4f8578fb356d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:16:15.097058 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-c6230bda-f9ff-4d5a-942a-4f8578fb356d None None] MFA Rules not processed for user `19ee45e0e0e142ce9bcd7151e5fa0664`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:16:15.098311 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-c6230bda-f9ff-4d5a-942a-4f8578fb356d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:16:15.168983 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1446/2870] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:16:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:16:15.180378 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9b337-66d7-4711-8fce-94716b9cf4e6 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:16:15.182205 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-1fe9b337-66d7-4711-8fce-94716b9cf4e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:16:15.262755 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9b337-66d7-4711-8fce-94716b9cf4e6 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:16:15.268910 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16aa62d-f719-4dab-978b-178418635c52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:16:15.269627 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16aa62d-f719-4dab-978b-178418635c52 service nova] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:16:15.270014 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16aa62d-f719-4dab-978b-178418635c52 service nova] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:16:15.270287 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16aa62d-f719-4dab-978b-178418635c52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:16:15.332192 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16aa62d-f719-4dab-978b-178418635c52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:16:15.333958 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16aa62d-f719-4dab-978b-178418635c52 service nova] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:16:15.346447 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1425/2871] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:16:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:16:16.564931 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8067a-019b-4b0f-abe4-d21f9479f763 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:16:16.565463 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8067a-019b-4b0f-abe4-d21f9479f763 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:16:16.565648 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8067a-019b-4b0f-abe4-d21f9479f763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:16:16.583736 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-e5f8067a-019b-4b0f-abe4-d21f9479f763 None None] MFA Rules not processed for user `d911cacdbc354f1bbdf20d48b00a44a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:16:16.585003 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-e5f8067a-019b-4b0f-abe4-d21f9479f763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:16:16.592200 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1447/2872] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 03:16:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:16:31.025613 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16aa62d-f719-4dab-978b-178418635c52 service nova] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:16:31.027265 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-e16aa62d-f719-4dab-978b-178418635c52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:16:31.089087 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16aa62d-f719-4dab-978b-178418635c52 service nova] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:16:31.093129 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab2504-1df8-45d9-873c-e9d99954570a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:16:31.093755 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab2504-1df8-45d9-873c-e9d99954570a service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:16:31.094027 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab2504-1df8-45d9-873c-e9d99954570a service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:16:31.094272 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab2504-1df8-45d9-873c-e9d99954570a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:16:31.096138 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-20ab2504-1df8-45d9-873c-e9d99954570a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:16:31.106172 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab2504-1df8-45d9-873c-e9d99954570a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:16:31.107750 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab2504-1df8-45d9-873c-e9d99954570a service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:16:31.116145 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1426/2873] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:16:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:16:32.618117 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8067a-019b-4b0f-abe4-d21f9479f763 None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:16:32.619824 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-e5f8067a-019b-4b0f-abe4-d21f9479f763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:16:32.695036 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8067a-019b-4b0f-abe4-d21f9479f763 None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:16:32.700747 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e52e2b-a7b5-4a3e-894c-a0c036b7089c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a88ae51543497382d34573afc2bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:16:32.701506 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e52e2b-a7b5-4a3e-894c-a0c036b7089c service placement] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:16:32.701977 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e52e2b-a7b5-4a3e-894c-a0c036b7089c service placement] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:16:32.702340 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e52e2b-a7b5-4a3e-894c-a0c036b7089c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:16:32.704256 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-b9e52e2b-a7b5-4a3e-894c-a0c036b7089c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:16:32.716508 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e52e2b-a7b5-4a3e-894c-a0c036b7089c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:16:32.718410 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e52e2b-a7b5-4a3e-894c-a0c036b7089c service placement] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:16:32.728399 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1448/2874] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:16:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:16:38.117889 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab2504-1df8-45d9-873c-e9d99954570a service neutron] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:16:38.132708 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab2504-1df8-45d9-873c-e9d99954570a service neutron] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:16:38.149331 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3a137-6655-4767-9412-365c2f95f7de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:16:38.150456 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3a137-6655-4767-9412-365c2f95f7de service nova] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:16:38.151105 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3a137-6655-4767-9412-365c2f95f7de service nova] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:16:38.151644 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3a137-6655-4767-9412-365c2f95f7de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:16:38.154152 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-d1a3a137-6655-4767-9412-365c2f95f7de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:16:38.171783 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a3a137-6655-4767-9412-365c2f95f7de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:16:38.173712 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a3a137-6655-4767-9412-365c2f95f7de service nova] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:16:38.188491 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1427/2875] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:16:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:16:48.227360 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e52e2b-a7b5-4a3e-894c-a0c036b7089c service placement] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:16:48.240603 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e52e2b-a7b5-4a3e-894c-a0c036b7089c service placement] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:16:48.246082 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9206d-c9ce-48a2-8a9f-29a37160c58c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:16:48.246735 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9206d-c9ce-48a2-8a9f-29a37160c58c service nova] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:16:48.247077 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9206d-c9ce-48a2-8a9f-29a37160c58c service nova] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:16:48.247319 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9206d-c9ce-48a2-8a9f-29a37160c58c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:16:48.249382 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-00b9206d-c9ce-48a2-8a9f-29a37160c58c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:16:48.262554 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b9206d-c9ce-48a2-8a9f-29a37160c58c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:16:48.264157 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b9206d-c9ce-48a2-8a9f-29a37160c58c service nova] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:16:48.274828 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1449/2876] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:16:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:16:50.396944 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3a137-6655-4767-9412-365c2f95f7de service nova] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:16:50.439779 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3a137-6655-4767-9412-365c2f95f7de service nova] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:16:50.444768 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f382d-255c-4ee6-99bb-1b95773fc270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:16:50.445409 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f382d-255c-4ee6-99bb-1b95773fc270 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:16:50.445686 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f382d-255c-4ee6-99bb-1b95773fc270 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:16:50.445947 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f382d-255c-4ee6-99bb-1b95773fc270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:16:50.475959 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f382d-255c-4ee6-99bb-1b95773fc270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:16:50.477406 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f382d-255c-4ee6-99bb-1b95773fc270 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:16:50.486844 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1428/2877] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:16:50 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:16:52.468741 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9206d-c9ce-48a2-8a9f-29a37160c58c service nova] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:16:52.510367 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9206d-c9ce-48a2-8a9f-29a37160c58c service nova] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:16:52.516623 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8414b-560c-4ddc-a5da-01b28f709736 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ee5cb310fd4538910e40ea7082708c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:16:52.517296 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8414b-560c-4ddc-a5da-01b28f709736 service nova] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:16:52.517577 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8414b-560c-4ddc-a5da-01b28f709736 service nova] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:16:52.517845 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8414b-560c-4ddc-a5da-01b28f709736 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:16:52.522582 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-05a8414b-560c-4ddc-a5da-01b28f709736 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:16:52.546218 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a8414b-560c-4ddc-a5da-01b28f709736 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:16:52.547756 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a8414b-560c-4ddc-a5da-01b28f709736 service nova] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:16:52.559549 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1450/2878] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:16:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:18:04.840907 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f382d-255c-4ee6-99bb-1b95773fc270 service neutron] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:18:04.842593 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-b96f382d-255c-4ee6-99bb-1b95773fc270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:18:04.881406 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f382d-255c-4ee6-99bb-1b95773fc270 service neutron] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:18:04.887075 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a824a07-484d-4551-9392-2c02a9ee473c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a88ae51543497382d34573afc2bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:18:04.887739 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a824a07-484d-4551-9392-2c02a9ee473c service placement] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:18:04.888019 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a824a07-484d-4551-9392-2c02a9ee473c service placement] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:18:04.888287 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a824a07-484d-4551-9392-2c02a9ee473c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:18:04.890217 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-1a824a07-484d-4551-9392-2c02a9ee473c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:18:04.901991 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a824a07-484d-4551-9392-2c02a9ee473c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:18:04.903577 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a824a07-484d-4551-9392-2c02a9ee473c service placement] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:18:04.913402 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1429/2879] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:18:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 03:19:01.210433 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8414b-560c-4ddc-a5da-01b28f709736 service nova] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:19:01.220985 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8414b-560c-4ddc-a5da-01b28f709736 service nova] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:19:01.227844 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed788e-f387-402c-a463-439027a68026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:19:01.228734 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed788e-f387-402c-a463-439027a68026 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:19:01.229071 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed788e-f387-402c-a463-439027a68026 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:19:01.229436 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed788e-f387-402c-a463-439027a68026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:19:01.232748 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-a3ed788e-f387-402c-a463-439027a68026 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:19:01.262448 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ed788e-f387-402c-a463-439027a68026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:19:01.263841 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ed788e-f387-402c-a463-439027a68026 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:19:01.272709 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1451/2880] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:19:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 03:19:02.403153 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a6ca8-a52b-496d-b4c8-d09808262ad4 None None] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:19:02.403766 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a6ca8-a52b-496d-b4c8-d09808262ad4 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:19:02.403766 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a6ca8-a52b-496d-b4c8-d09808262ad4 None None] PATH_INFO: `/` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:19:02.405116 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1430/2881] 10.222.0.32 () {54 vars in 921 bytes} [Tue Apr 12 03:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 03:19:02.411636 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3bcb3a-3bf9-4104-a153-5a7ef4d42419 None None] REQUEST_METHOD: `POST` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:19:02.412166 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3bcb3a-3bf9-4104-a153-5a7ef4d42419 None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:19:02.412334 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3bcb3a-3bf9-4104-a153-5a7ef4d42419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:19:02.468173 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.auth.core [None req-1f3bcb3a-3bf9-4104-a153-5a7ef4d42419 None None] MFA Rules not processed for user `8f516943aec14608b5c9d343418a2677`. Rule list: `[]` (Enabled: `True`). {{(pid=79724) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:19:02.469415 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-1f3bcb3a-3bf9-4104-a153-5a7ef4d42419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:19:02.476316 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1452/2882] 10.222.0.32 () {58 vars in 1018 bytes} [Tue Apr 12 03:19:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:19:02.488865 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a6ca8-a52b-496d-b4c8-d09808262ad4 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:19:02.499951 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a6ca8-a52b-496d-b4c8-d09808262ad4 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:19:02.504031 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4ec63-0c5c-419d-8acb-b1ee8e739970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:19:02.504892 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4ec63-0c5c-419d-8acb-b1ee8e739970 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:19:02.505238 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4ec63-0c5c-419d-8acb-b1ee8e739970 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:19:02.505660 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4ec63-0c5c-419d-8acb-b1ee8e739970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:19:02.513149 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4ec63-0c5c-419d-8acb-b1ee8e739970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:19:02.514609 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4ec63-0c5c-419d-8acb-b1ee8e739970 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:19:02.523275 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1431/2883] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:19:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:19:03.623116 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77cd14-7909-41b5-8600-2c384c40308b None None] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:19:03.623660 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77cd14-7909-41b5-8600-2c384c40308b None None] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:19:03.623660 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77cd14-7909-41b5-8600-2c384c40308b None None] PATH_INFO: `/` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:19:03.625282 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1453/2884] 10.222.0.32 () {54 vars in 921 bytes} [Tue Apr 12 03:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 03:19:03.630776 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b28a36-b3f9-4b0e-b9f7-1c456efbf520 None None] REQUEST_METHOD: `POST` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:19:03.631259 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b28a36-b3f9-4b0e-b9f7-1c456efbf520 None None] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:19:03.631370 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b28a36-b3f9-4b0e-b9f7-1c456efbf520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:19:03.680839 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.auth.core [None req-02b28a36-b3f9-4b0e-b9f7-1c456efbf520 None None] MFA Rules not processed for user `43ee5cb310fd4538910e40ea7082708c`. Rule list: `[]` (Enabled: `True`). {{(pid=79722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 03:19:03.682030 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-02b28a36-b3f9-4b0e-b9f7-1c456efbf520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:19:03.707640 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1432/2885] 10.222.0.32 () {58 vars in 1018 bytes} [Tue Apr 12 03:19:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 03:19:03.718364 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77cd14-7909-41b5-8600-2c384c40308b None None] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:19:03.729701 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77cd14-7909-41b5-8600-2c384c40308b None None] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:19:03.733490 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d2487-5695-4bb0-85f9-edd16fa3afb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:19:03.734118 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d2487-5695-4bb0-85f9-edd16fa3afb4 service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:19:03.734393 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d2487-5695-4bb0-85f9-edd16fa3afb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:19:03.734659 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d2487-5695-4bb0-85f9-edd16fa3afb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:19:03.744609 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d2487-5695-4bb0-85f9-edd16fa3afb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:19:03.746016 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d2487-5695-4bb0-85f9-edd16fa3afb4 service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:19:03.756731 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1454/2886] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:19:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:20:30.206398 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b28a36-b3f9-4b0e-b9f7-1c456efbf520 None None] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:20:30.216695 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b28a36-b3f9-4b0e-b9f7-1c456efbf520 None None] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:20:30.220590 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d07ac-d673-4e88-b37a-44be1309d457 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:20:30.221464 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d07ac-d673-4e88-b37a-44be1309d457 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:20:30.222305 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d07ac-d673-4e88-b37a-44be1309d457 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:20:30.222591 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d07ac-d673-4e88-b37a-44be1309d457 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:20:30.224523 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-f03d07ac-d673-4e88-b37a-44be1309d457 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:20:30.235525 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d07ac-d673-4e88-b37a-44be1309d457 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:20:30.237173 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d07ac-d673-4e88-b37a-44be1309d457 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:20:30.247268 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1433/2887] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:20:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:20:30.342534 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d2487-5695-4bb0-85f9-edd16fa3afb4 service neutron] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:20:30.352236 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d2487-5695-4bb0-85f9-edd16fa3afb4 service neutron] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:20:30.356480 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0aab3-da06-4f96-90de-2848cf36c82b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:20:30.357596 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0aab3-da06-4f96-90de-2848cf36c82b service neutron] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:20:30.358128 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0aab3-da06-4f96-90de-2848cf36c82b service neutron] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:20:30.358592 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0aab3-da06-4f96-90de-2848cf36c82b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:20:30.360678 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-66f0aab3-da06-4f96-90de-2848cf36c82b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:20:30.376064 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f0aab3-da06-4f96-90de-2848cf36c82b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:20:30.377769 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f0aab3-da06-4f96-90de-2848cf36c82b service neutron] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:20:30.389811 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1455/2888] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:20:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:20:31.573316 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d07ac-d673-4e88-b37a-44be1309d457 service neutron] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:20:31.582229 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d07ac-d673-4e88-b37a-44be1309d457 service neutron] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:20:31.585993 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9fa9f-35b9-4c04-9b08-afd93961ff91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f516943aec14608b5c9d343418a2677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:20:31.586646 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9fa9f-35b9-4c04-9b08-afd93961ff91 service neutron] REQUEST_METHOD: `GET` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:20:31.586917 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9fa9f-35b9-4c04-9b08-afd93961ff91 service neutron] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:20:31.587314 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9fa9f-35b9-4c04-9b08-afd93961ff91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:20:31.590825 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-3aa9fa9f-35b9-4c04-9b08-afd93961ff91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:20:31.607471 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9fa9f-35b9-4c04-9b08-afd93961ff91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:20:31.609010 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9fa9f-35b9-4c04-9b08-afd93961ff91 service neutron] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:20:31.620350 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1434/2889] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:20:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 03:20:40.768746 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0aab3-da06-4f96-90de-2848cf36c82b service neutron] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:20:40.854672 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0aab3-da06-4f96-90de-2848cf36c82b service neutron] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:20:40.859406 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c0efd-9144-4472-a61c-26849342852c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:20:40.860354 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c0efd-9144-4472-a61c-26849342852c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:20:40.860620 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c0efd-9144-4472-a61c-26849342852c admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:20:40.860878 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c0efd-9144-4472-a61c-26849342852c admin admin] PATH_INFO: `/v3/users/d911cacdbc354f1bbdf20d48b00a44a2` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:20:40.862048 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c0efd-9144-4472-a61c-26849342852c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d911cacdbc354f1bbdf20d48b00a44a2)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:20:40.864022 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c0efd-9144-4472-a61c-26849342852c admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:20:40.913840 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-cc4c0efd-9144-4472-a61c-26849342852c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd911cacdbc354f1bbdf20d48b00a44a2'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:20:40.920755 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-cc4c0efd-9144-4472-a61c-26849342852c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd911cacdbc354f1bbdf20d48b00a44a2'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:20:40.921420 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-cc4c0efd-9144-4472-a61c-26849342852c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd911cacdbc354f1bbdf20d48b00a44a2'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:20:40.922039 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-cc4c0efd-9144-4472-a61c-26849342852c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd911cacdbc354f1bbdf20d48b00a44a2'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:20:40.933130 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-cc4c0efd-9144-4472-a61c-26849342852c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd911cacdbc354f1bbdf20d48b00a44a2'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:20:40.946867 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1456/2890] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:20:40 2022] DELETE /identity/v3/users/d911cacdbc354f1bbdf20d48b00a44a2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:20:41.144177 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9fa9f-35b9-4c04-9b08-afd93961ff91 service neutron] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:20:41.158399 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9fa9f-35b9-4c04-9b08-afd93961ff91 service neutron] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:20:41.213804 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34048f6-c443-4ee4-829b-571254f15981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:20:41.214947 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34048f6-c443-4ee4-829b-571254f15981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:20:41.215228 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34048f6-c443-4ee4-829b-571254f15981 admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:20:41.215478 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34048f6-c443-4ee4-829b-571254f15981 admin admin] PATH_INFO: `/v3/projects/e6abe79952f3490e8b90f1cedddb3821` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:20:41.216736 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34048f6-c443-4ee4-829b-571254f15981 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6abe79952f3490e8b90f1cedddb3821)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:20:41.218639 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34048f6-c443-4ee4-829b-571254f15981 admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:20:41.269525 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-e34048f6-c443-4ee4-829b-571254f15981 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6abe79952f3490e8b90f1cedddb3821', 'request_id': 'req-e34048f6-c443-4ee4-829b-571254f15981'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:20:41.282154 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-e34048f6-c443-4ee4-829b-571254f15981 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6abe79952f3490e8b90f1cedddb3821', 'request_id': 'req-e34048f6-c443-4ee4-829b-571254f15981'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:20:41.288249 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-e34048f6-c443-4ee4-829b-571254f15981 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6abe79952f3490e8b90f1cedddb3821', 'request_id': 'req-e34048f6-c443-4ee4-829b-571254f15981'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:20:41.316495 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-e34048f6-c443-4ee4-829b-571254f15981 admin admin] The token cache is being invalidate because project e6abe79952f3490e8b90f1cedddb3821 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:20:41.316743 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-e34048f6-c443-4ee4-829b-571254f15981 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:20:41.317454 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-e34048f6-c443-4ee4-829b-571254f15981 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:20:41.319087 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1435/2891] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:20:41 2022] DELETE /identity/v3/projects/e6abe79952f3490e8b90f1cedddb3821 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:20:41.323912 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c0efd-9144-4472-a61c-26849342852c admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:20:41.325492 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-cc4c0efd-9144-4472-a61c-26849342852c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:20:41.339335 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c0efd-9144-4472-a61c-26849342852c admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:20:41.401870 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3507d-dbba-485f-9d47-f4741d4ba620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:20:41.402732 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3507d-dbba-485f-9d47-f4741d4ba620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:20:41.403009 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3507d-dbba-485f-9d47-f4741d4ba620 admin admin] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:20:41.403276 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3507d-dbba-485f-9d47-f4741d4ba620 admin admin] PATH_INFO: `/v3/users/19ee45e0e0e142ce9bcd7151e5fa0664` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:20:41.404528 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3507d-dbba-485f-9d47-f4741d4ba620 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19ee45e0e0e142ce9bcd7151e5fa0664)` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:20:41.406446 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3507d-dbba-485f-9d47-f4741d4ba620 admin admin] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:20:41.463735 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-ecf3507d-dbba-485f-9d47-f4741d4ba620 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19ee45e0e0e142ce9bcd7151e5fa0664'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:20:41.470436 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-ecf3507d-dbba-485f-9d47-f4741d4ba620 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19ee45e0e0e142ce9bcd7151e5fa0664'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:20:41.471096 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-ecf3507d-dbba-485f-9d47-f4741d4ba620 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19ee45e0e0e142ce9bcd7151e5fa0664'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:20:41.471692 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-ecf3507d-dbba-485f-9d47-f4741d4ba620 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19ee45e0e0e142ce9bcd7151e5fa0664'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:20:41.484266 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.notifications [None req-ecf3507d-dbba-485f-9d47-f4741d4ba620 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19ee45e0e0e142ce9bcd7151e5fa0664'} {{(pid=79724) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:20:41.498700 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1457/2892] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 03:20:41 2022] DELETE /identity/v3/users/19ee45e0e0e142ce9bcd7151e5fa0664 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 03:20:41.678309 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34048f6-c443-4ee4-829b-571254f15981 admin admin] Authenticating user token {{(pid=79722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:20:41.679891 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.fernet_utils [None req-e34048f6-c443-4ee4-829b-571254f15981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:20:41.696098 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34048f6-c443-4ee4-829b-571254f15981 admin admin] Validating token access rules against request {{(pid=79722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:20:41.757086 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13badc4f-e2ea-47d9-8aea-0b46dc76981a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e456857e814b9bb8e2717b9f3a9a8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0c2ded0aef5404894a48ce0d4dafe72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:20:41.757935 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13badc4f-e2ea-47d9-8aea-0b46dc76981a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:20:41.758206 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13badc4f-e2ea-47d9-8aea-0b46dc76981a admin admin] SCRIPT_NAME: `/identity` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:20:41.758468 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13badc4f-e2ea-47d9-8aea-0b46dc76981a admin admin] PATH_INFO: `/v3/projects/4baa9a4306cf431683b838a9d9e4062e` {{(pid=79722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:20:41.759635 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13badc4f-e2ea-47d9-8aea-0b46dc76981a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4baa9a4306cf431683b838a9d9e4062e)` {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:20:41.761582 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13badc4f-e2ea-47d9-8aea-0b46dc76981a admin admin] RBAC: Authorization granted {{(pid=79722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:20:41.810846 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-13badc4f-e2ea-47d9-8aea-0b46dc76981a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4baa9a4306cf431683b838a9d9e4062e', 'request_id': 'req-13badc4f-e2ea-47d9-8aea-0b46dc76981a'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:20:41.820720 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-13badc4f-e2ea-47d9-8aea-0b46dc76981a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4baa9a4306cf431683b838a9d9e4062e', 'request_id': 'req-13badc4f-e2ea-47d9-8aea-0b46dc76981a'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:20:41.828062 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-13badc4f-e2ea-47d9-8aea-0b46dc76981a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4baa9a4306cf431683b838a9d9e4062e', 'request_id': 'req-13badc4f-e2ea-47d9-8aea-0b46dc76981a'} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:20:41.840461 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-13badc4f-e2ea-47d9-8aea-0b46dc76981a admin admin] The token cache is being invalidate because project 4baa9a4306cf431683b838a9d9e4062e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 03:20:41.840742 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-13badc4f-e2ea-47d9-8aea-0b46dc76981a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:20:41.841407 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: DEBUG keystone.notifications [None req-13badc4f-e2ea-47d9-8aea-0b46dc76981a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 03:20:41.843034 dv-cinder-837443-1-iscsi devstack@keystone.service[79722]: [pid: 79722|app: 0|req: 1436/2893] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 03:20:41 2022] DELETE /identity/v3/projects/4baa9a4306cf431683b838a9d9e4062e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 03:23:11.821059 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3507d-dbba-485f-9d47-f4741d4ba620 admin admin] Authenticating user token {{(pid=79724) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 03:23:11.822619 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-ecf3507d-dbba-485f-9d47-f4741d4ba620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:23:11.893320 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3507d-dbba-485f-9d47-f4741d4ba620 admin admin] Validating token access rules against request {{(pid=79724) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 03:23:11.965599 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca0a45-640c-40a9-a951-a85a0bd467f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a88ae51543497382d34573afc2bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82cb5f6cfa0e46b28a37565fc2b560ed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79724) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 03:23:11.966291 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca0a45-640c-40a9-a951-a85a0bd467f6 service placement] REQUEST_METHOD: `GET` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 03:23:11.966543 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca0a45-640c-40a9-a951-a85a0bd467f6 service placement] SCRIPT_NAME: `/identity` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 03:23:11.966818 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca0a45-640c-40a9-a951-a85a0bd467f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79724) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 03:23:11.968872 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.fernet_utils [None req-8cca0a45-640c-40a9-a951-a85a0bd467f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79724) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 03:23:11.980535 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca0a45-640c-40a9-a951-a85a0bd467f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 03:23:11.982175 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca0a45-640c-40a9-a951-a85a0bd467f6 service placement] RBAC: Authorization granted {{(pid=79724) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 03:23:11.992313 dv-cinder-837443-1-iscsi devstack@keystone.service[79724]: [pid: 79724|app: 0|req: 1458/2894] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 03:23:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)